Oh, you're right. It looked like the wire was in the wrong hole. My bad! Maybe the diodes you are using put up too much resistance. Bigger diodes put up bigger resistance most of the time. Try smaller ones.
Is it just me, or is that red wire in the upper right corner of your picture that that is supposed to attach the switch to the LED in the wrong row of holes?
Powering Arduino with a Battery