I do the same thing quite frequently, and leave record stores empty handed. This is due to me preordering the albums I want directly from the bands or labels or from other indie shops online that offer better pricing (and no sales tax). And some of the record stores by me are just way overpriced, especially on used titles.
Then again, if I lived near Plaidroom where they have an enormous, well-curated used section that is priced fairly, that would be another story. I would be broke. I have about 1325 albums, which for me is nearing the limit for storage space and time for me to listen to them all.