I'm not sure if they still make these, but I have one. Amazon.com: PS3 Memory Card Adaptor: Video Games

That's definitely the easiest way to get your own PS2 saves onto the PS3. I'm sure there are old ways of digitally backing up your PS2/PS1 memory cards onto your computer, but that likely involves buying other hardware like a Gameshark or doing some other kinds of modding.