Druid Grove is not a town - more of an encampment behind walls. The town equivalents we encounter so far are basically destroyed remains, but they are indicative of actual buildings you can enter. Once we reach an actual, functioning town or city (Baldurs Gate) I anticipate you will see something more along the lines of what you describe.
