There are loads of record shops around these days. Also consider checking out charity shops (though they're usually full of standard crap like "_____ sings the hits", you do get some cool finds, like my Phil Collins albums).

Sadly, Rush is the only one of those I'm still interested in, but when I get a better player I'll get a more varied collection. Some Vinyls I'm thinking of getting:
Medeski, Martin and Wood - Radiolarians: The Evolutionary Sethttp://ecx.images-amazon.com/images/I/61N88LkapLL.jpg