If I recall correctly, you can use certain status effects to deal with them before you find that armor. If only I could remember what status effects work on them. Was it Sleep, maybe?