For me it depends on the game, and sometimes even depends on the character.

There is a character in Soul Calibur III (he's in all of the games, but this is the only time this was a problem) who is basically portrayed as a calm and collected samurai, and his English voice (very calm and unfazed) is perfect for this, but his actual Japanese voice (shouty and over excited) isn't.