I just stay on the ground and teleport the stuff out, though it's probably the more fiddly approach.
That's a generally good idea, but you can't get the charming arrowhead or fire arrows by teleporting everything down. You need to send someone up there if you want to loot it all.
and as Ix07 said
Ignore it. Just teleport in. The cloud may stun you but it wears off and it doesn't hurt you.