Ok Raze from Larian helped me actually there is alternate solution to this you can kill two groups of mushroms and the barrier is dissapearing.