Essentially, weapons are interchangeable, stat-wise. However, each has unique effects that determine how they boost certain play styles. So until you know which weapon you want, it is better to avoid upgrading.

Although, really, you're better off not upgrading at all. Except for the Long GUI, nothing requires upgrades, and it makes five-star ratings much easier to get.