The Four Swords element to the game isn't that big really. Once you've been to the Elemental Sancuary you have the ability to clone Link using coloured panels on the floor. To start with you can have Link plus 1 copy. You'll get more as you go through the game.

The only time you need the Four Swords element is to hit multiple switch's , stand on button's or to push blocks out of your way. But you can only do it in certain areas not when ever you want.