Is it just the level they are when recruiting them that you can't change, or is it the case that if they level up after joining your party, you can't change their stats?
If the former, that would be irksome, but I could deal with it, but it's the latter, then that is definitely a big problem.
The former. They'll join your party at-level with their stats allocated, however after they join your party you have full control of how they level. That's my experience at least
