FluidSynth, for some reason, doesn't play nice with the python scripts that are trying to use it. To fix this, I installed pyFluidSynth. It seems to work nicely.
Unpackage in your downloads folder
Navigate in terminal to unpacked folder and install
$ cd Downloads/pyFluidSynth-1.2.4
$ sudo python setup.py install