Same issue. I have no idea why closing the map sometimes teleports me to a waypoint. It's not all the time, but when it happens, it can be super annoying, especially when exploring.