Well other then beating them with dark swords (which if your in the first cave with them you won't have any) The only other option is black magic, or if your lucky, doing enough damage in a single attack to kill them prevents them from multiplying.

Or if anything just run.