Did you clear the whole cave? The spider there can Feint Death, so you may have walked away too soon (though usually they do not stay down that long).