Not if you refine them, no. If you lose them to certain people, you may be able to get it back by playing them or another person.