I don't think any stat is meant to be a "dump stat". All of them, even Charisma, were intended to have a purpose. You've missed quite a few things in the first area by not having points in Perception.