Yeah, no problem. You don't have to "declare war" on anyone. You don't even need to invade anyone to take their land, or whatnot. However, you may want to be careful if they want to invade you. =-o