Tell us about yourself!
This is ridiculously dangerous. It probably needs a new thermocouple, or whatever senses the flame, or the amplifier for same. Get some professional assistance; your plumber is not a boiler or HVAC tech, more than likely. This is Russian Roulette with a bomb in your house.