Step 6: Electrical tape

Picture of electrical tape
put some electrical tape around the contact points to cover them. you can also keep the tape going and use it to hold the socket tight to the bottle.
I got a plug at home depot that comes apart with a screw, then used wire strippers to clear the ends of my lamp wire, and bolted them into the new plug. Its easy and clean, and the plug was only $1.99, about the same price as electrical tape.