This map has the location of the cave. (number 12)
http://beyond.divinedivinity.net/help/act2_forest_sw.htm

As far as the set, no, there are no bonuses for getting all of them.