Are ya'll playing on Tactician?
Yep on Tactician! I noticed (especially on the very low scaling or none at all) if you have a good weapon on you it is very easy to destroy enemies armor in one go, usually no one I am focusing manages to survive enough to be hit by my full party (usually dead when my second character ends their turn). Maybe it is the combination of having the perfect weapon and optimal stats distribution, but I feel that in the no scaling version, either HP or (or both perhaps) armor need to be buffed. Personally, I would feel that increasing base HP by 50%, and doubling how much armor everything (player and NPCs) has will fix the how fast things die. To be very clear, I am not necessarily saying that the game is objectively easier because NPCs can burst as hard as you, but the player has a huge advantage in knowing what to do considering the situation. So if HP and/or armor are buffed, this element can be remedied.