Unfortunately, there is no way to avoid the portrait regeneration, or reset the portraits.
I just double checked in a new game, and don't see a change in the portrait when clicking on cancel; maybe it's too subtle at the resolution and graphics settings I'm using, but clicking accept does change the portrait, with slight differences in Lohse's hair, and the neck and shoulder area reflecting the starting equipment rather than that shown in character creation.