Are you sure you only have 4 characters who can become party members or is it that you can only have 4 at a time?