Only the character with the stat-boosting materia gets the benefit.
I'm pretty sure you can use as many HP/MP Plus materia as you like, and they'll all count, but not when your HP reaches 9999, or 999 for MP. The additional bonus will have no effect.

Not sure what happens if you use two EXP Plus...