As someone who likes soloing for the challenge and in this game to make combat feel faster, I do not want to gain xp faster than I would in a group. Why can't there just be two options, xp for 4 and xp for 6, or just warn players that it will be easier for them with 6 and keep it balanced for 4? Or just change it to allow 5 as a compromise.
That's fair. The solution is, as is for most things, a toggle. "Full exp for all party members" or "split exp."
I will be very impressed if you beat the game solo without increased exp (assuming you don't completely abuse cheese).