It seems that you can't just go in, kill everything, leave, then go right back in. I assumed that's what it meant when I was hearing about respawning monsters. Regardless, after playing for a bit I ran past that Abandoned Cave again that's near the entrance to Aleroth, and went back in it and there were monsters in there again. Thankfully, I can actually earn experience now >_>.