Tell us about yourself!
Some power supplies are designed for halogen/xenon only and will not function with LEDs. Replacing the power supply with one that is LED compatible will probably fix your problem. (If you're unsure about the requirements of your LED bulbs, get a DC power supply. Some LED bulbs will work with some AC power supplies, but all low voltage LED bulbs work on DC.)