I feel like mallets are available early on so you can enter the mini village without mp, but I don't remember anything about an item to inflict toad. The bigger problem might be completing the Nepto Shrine if you don't roll a mage for your first crystal, since you have to do the whole thing mini'd and physical attacks deal no damage under that status.