Does anyone remove the lables from there empty perscription bottles ... Does anyone remove the lables from there empty perscription bottles before recycling them? Am I being paranoid? I worry about identity thief so I am a compulsive shredder before recycling my junk mail (you know those preapproved credit applications etc.) and paid bills after seven years. I am very careful about removing the labels from my prescription bottles before recycling them.