The warlock invocation is a little less friendly, unfortunately - you don't get a free reasign with it because you can trade out that same invocation later. It's one of those invocations you should try to decide whether you're taking in advance, so you don't short yourself.
It's quite disappointing that they still haven't rectified this much reported issue with the double up and loss in character creation though. If anyone has reported it recently, I'd be interested to hear what Larian's official word on it is, in their bug report responses.