Yeah, but when you lose your memories you still have a connection to your 'past life'. Your family members still know you, and there's always a chance your memories will come back. You know basic functions and you dont crap yourself and such.

Karma is the universe's way of balancing things, like if you do bad things bad things come back to you. Reincarnation is what you're looking for.