little gem 1/4" speaker out?

[janus]

Hello,
real rookie question. But I want to add a speaker out to a little gem I built. The way I was thinking of doing it is going from lug 2 of the volume pot to the tip of the out jack, and then take the + speaker connection  and connect it to the same tip connection(tip) on the output jack. And then ground the sleeve of the output jack and the (-) of the speaker to the circuit. Is that the correct way? I tried last night and the volume got sucked down to a whisper through the 3" speaker I have enclosed with the little gem. If it is correct then I need to debug elswhere. It worked great till I tried this but I also switched the resistor on an led..so it could be a couple of things.
any help appreciated.
Brian