They don´t specfy this in the description but when you take a short rest, you have to make 3 different "mini-missions" to regain them. They appear next to your character portrait. Once completed you regain a dice per mission.
Did see this later (though doesn't follow the description) and did the 3 tasks. On short rest received 1 portent die back and 2 new tasks, not 3.