Is the quest trigger a circular radius? It seems like that might be what's causing the quest to trigger in that area.