I only use special characters in random battles if I need a break from levelling my regular characters. I also find that their special skills make battles too easy.