You'll have to visit them all anyway, so you shouldn't worry. The key to it is you have to use the Destructions Sphere in each temple and obtain the secret treasure. If you don't get all six treasures, you can't get Anima. When you get the airship, revisiting the temples will be easier, and you can go back to them whenever you want if you missed a treasure.