There's a ladder right by the waypoint of the goblin camp that leads up to a ridge with plenty of room to move around. Climb to the top, destroy the ladder once you're up there so the goblins can't get up there and then rain hell and damnation down on them. That's what I do. Works everytime. Like shooting fish in a barrel.

Once you've killed everything you can just fast travel to the same waypoint down below to collect your goodies, since you destroyed the ladder.