It was past warranty, and Jabra does not offer a replacement part, so I simply took it apart (the case pries open if your careful) and noticed the physical switch was covered by the side of the case. I simply took an X-acto knife and removed the small piece of plastic that covered the switch, and now i can get to it with a pen or other small pointy object.
I just could not justify purchasing a new ($40-60) headset for a simple quick fix I found to get to the switch.
My cut marks are in red on the photo. The micro switch is in Blue.