Having more options for your player base is going to be better. I don't think anyone can reasonably argue to take away options (e.g. remove difficulties, remove spells, remove classes) and so I would think the inverse would be true. There seems to be quite a lot of people who would be interested in some sort of higher difficulty without having to use a bunch of mods. The mods are still available to go beyond that point of course.
You'd be surprised: some people have been quite insistent about removing the "easier" difficulties. Because apparently the risk of alienating a chunk of Larian's player base is somehow a good idea... somehow. Likewise removing functionality they claim to not use, e.g. save anywhere as often as you want.