The device works flawlessly when powered though USB-connector or Garmin power connector. Power issues are only when used on batteries. There has to be a problem with how the batteries are connected to the board.
The problem was also more frequent when boating because of the vibration.
Clearly the connection is not rugged enough. So I decided to dissassemble (and reassemble) the device.