Yeah it's annoying.
Feels like you are being punished for choosing the easier difficulty setting.
Was going to play some split screen with my wife who is not a gamer and thus would play on explorer difficulty but now we can't multi-class unless we bump the difficulty up.
It's just really strange. I hope they change this in the future at some point.