There's a slightly trimmed down version of Gimp called Gimp Portable, if you want it for a flash drive:
GIMP Portable | PortableApps.com - Portable software for USB drives
Though at 16mb it's still a little hefty compared to the other suggestions.