Yes, I think that would be a great idea.
Without something like this, it is like the developers have had a "Silence" and "Darkness" spell cast over them. Early Access players are just the sort of people who would be keen to provide such feeback. It would be timely, hopefully actionable and if the feedback were being monitored, the developers could respond in real time through a dialogue window, which would be very encouraging and perhaps helpful for follow up questions/re-testing.
Using the same functionality, Larian could also decide to trigger this screen-freeze/feedback-dialogue during particular moments of the game (ideally, not many!) where feedback is urgently needed or highly desired. It might be possible to reward participants with in-game perks, like particularly ornate armour, or beautiful bodies!
