Affinity with stave bonus means -2AP... I think the staff bonus should be applicable on one particular spell only then, not an entire spell category. It's a lot better than 15% chance to blind on a staff but it wouldn't be over powering
Looking at item stats it looks like it wouldn't be too bad adding staff only modifiers, provided Larian gives us better tools to add resources like that.