When you roll the dice with different chars in your party it automatically adjusts the needed score with that chars bonuses. For example you need a 18 with one char and a 15 with another char. It will be better to keep the dice difficulty and add your modifier to the result.