No, you can't remove the mod after playing with it for a while. I only added the bard skills (white skillbooks), three racial skills, and some weapon/armor skills (appear on legendary weapons or occasionally rares). But yeah, if you never played vanilla, than you won't really know what is default and what isn't.
You'll probably just want to restart without the mod for a completely vanilla experience.
