Hot glue is safe for electronics. Just don't put it in the actual port-connector.
Just make sure to use a low heat hot glue gun. I have had one heat up the solder until it melted.
No problem at all - I had a bare USB drive which I covered with hot glue to protect it and it works a treat. The LED glows nicely through the glue too.