In order for your Job to roll back automatically, you need to add the Palette item Update Environments to the Pipeline Rule with which the Job is being launched.