I had the same problem as Julian. Everything I gave Lydia ended up as her "starting equipment" in addition to being stolen. When she died - heroically - I went and sold all the crap she had nicked off me. Then I stored the Legendary Glass Battleaxe she had been using in my house as a symbol of rememberence.