You sometimes get surplus quest items: I know I've ended up with quite a few odds and ends that serve no purpose. But I don't think they add to your encumbrance, so I wouldn't worry about it...

J'aime le fromage.