I'm assuming this is just an early access problem. A lot of the checks aren't even face character checks. I've seen lots of Arcana checks for instance. The game should let every party member roll vs some of this stuff.