I usually sell them.

However, dungeons like Ipsen's Castle are a good argument to hold onto your stuff.