I've found old sheet music at flea markets and antique stores. Places like that. Sometimes it shows up at garage sales. It's all hit or miss.
Some stores that sell band/orchestra instruments will also sell sheet music. Typically this is classical music for students to perform at solo and ensemble (like a clarinet solo piece) but particularly in book format you can find jazz, blues and rock scored for piano/voice or piano/guitar/voice.