Atonement is an act of recompense. You're trying to even out the wrongs you've done.

Forgiveness, meanwhile, is basically being told that atonement is unneeded.

Vincent, I think, does not want forgiveness. I think he feels that he actually DOES need to go through the acts of atonement, for whatever reason.