You have to buy it in Memoria. I forget the name of who sells it to you, but you find them hidden from view behind some rocks/coral in Memoria.

EDIT: Yeah, I think that's where you get the hammer. Maybe it's the other pumice piece you buy?