There is never a time it'd not be advantageous to manipulate something at a distance and if you do want to do it up close, manually walking up to something to use "point-blank telekinesis" on it is still a superior solution that requires no new skill/toggle/stuff.
Having it as a skill would only work if the entire mechanic was made into just the skill.
