I wouldn't say that people are being 'difficult' - They're expressing a distaste for how it's being handled at the moment, and suggesting things that would make it more palatable, that's all. By far a bigger problem is the way that the dreams themselves are invasive, creepy and, if you don't choose the head-over-heels dialogue choices, downright rapey... and yet, despite them being that way, everyone around you, including your character, acts like they were temping and appealing and seductive... and you absolutely cannot, in any way, act or suggest that they weren't or that you didn't find them so. There's a huge dissonance there, and if they fix that in a good way, then my complaints about building the daisy will be much reduced.
It's a fundamental (mis)conception that Larian has around role playing games and agency. They wouldnt even have non origin stories if people didn't complain, you would just be playing out their interactive novel.
You have to try and let it go as much as possible, because they do it in lots of places.
Edit: which isn't really to say there's a huge problem with this. But it can be done better than Larian does (like say Disco Elysium's interactive story).
