I think Inquisitions problems (frostbyte the source of most of them) have been well documented. Inquisition couldn't compete with the success of Skyrims and Witchers? Well yeah, Skyrim is a bit of a flash in the pan, isn't it. Not a whole lot that can compete with it. Regarding The Witcher 3, the reason why Inquisition flops miserably in comparison is that it's simply a worse game. It plays worse, it looks worse, it's just worse in most regards. The Witcher 3 is a masterpiece. Inquisition sure isn't. I believe this correlates directly to mainstream success / appeal (and lack thereof) regarding these two established franchises & developers. I don't think party based / RTwP is the reason why Inquisition didn't have a chance to begin with (although their choice of engine might very well be).
3rd person action or RTwP, solo or party based.. It's all in the implementation, the execution. The finished product. This is where Witcher 3 (and Skyrim, over contemporary games such as DA 2 and Witcher 2) shines.