So you can still be a nice, caring person while also taking care of yourself and respecting yourself.
If you are nice to the point that you are not taking care of/respecting yourself - then you could be "too nice". But that's not a failing of being "nice", I feel, it's something else. Generally I agree there is no such thing.