Others have done this, and AFAIK it shouldn't break anything. You need something from the murder suspect's lair (north of Cyseal, through the cave with Arhu's failed experiment, and beyond) to get through the barrier properly. If you don't get it there, there are multiple copies in the game, so you can continue to Silverglen and then return when you have one.