The inn is still there and a certain activity there even triggers a quite important quest line (bring Wyll). It's just West of the cave where Rugan was. Whether you reach it before the goblins or after, it shouldn't make a difference to the state it is inn (pun intended).