crash - do you actually WANT to start over? Because this is mind-numbingly simple.
First off, this could've been entirely avoided if you didn't rename the folder.
Secondly, it's really simple to fix. Say your original folder was C:\Program Files\ZSNES and you renamed the folder to C:\Program Files\ZS. However, in the .cfg file, it will still have C:\Program Files\ZSNES listed as the filepath to look for save files. So you need to double-click the .cfg file, click on Notepad when it brings up a list of programs, and then change the save directory to the new filepath (in this example, C:\Program Files\ZS). It will take approximately three seconds, and you won't have to start over. That will work, unless you deleted some files.
And if you don't understand that, you fail at the Internet.