The auction house charges a small transaction fee for the service they offer. In your home town its 1-3 Gil for single items, 5 Gil for stacks. In other towns it's higher, for instance in Jeuno they currently charge me 100Gil per single item.

They do not charge you the reserve price.