In that case, unselecting the summon from the group may help, as well (since they are not going to move when encumbered, anyway).
In act 3, after exploring around town and checking out the architecture, I left a summon standing indoors (so the roofs would not be displayed), while I ran around with the main characters.
