Thanks for all the replies! I did try to get high (errr...) but they just followed me up and beat my crew to a bloody pulp regardless. Think I'll explore a bit more and return when I've recruited a few Balrogs. Dont recgonise the dudes in the piccy.....
When they follow you up just move around them and shove them off the ledge. The fight is significantly easier if you can trick them into going up the ladders than just fighting them on the ground.
