The default is set to PS1's loading speed, to maintain compatibility issues. Some games won't start with faster disc access, some games stream audio too fast.
Start the PS2 with no game inserted, push triangle twice to get to the Playstation driver settings. Set the disc speed to fast. If you're playing a game with textures, you should also set texture mapping to smooth. makes the games look a little better.