The implication is that what's floating your boat is fine because it isn't bothering anyone else.