Update:
Found my issue...my ISP has a thing called CGN (carrier grade networking).
After a short call with them explaining my situation she was all like "oh, thats likely CGN, ill just turn it off for you now.".
BAM - problem solved.
This ISNT a fix for the "player already connected" issue.
This fixes the "joining failed: connection issue" problem.