For record shopping, I think Recollect is the best shop in town. They specialize in jazz, funk, soul, hip hop, and international stuff, but they have a decent rock section too. There are always really good records in their $3 backroom too.
Wax Trax is also a great place for digging. They have...