You can select them with 1,2,3,4 keys too I believe. But I agree there should be a more intuitive and easier way to select, group and ungroup characters.
The default keys are F1 to F4, you can always change them in the menu. I've rebound the TAB key so i use that one to switch between them, still to control and move around with only one i have to use the portraits.
