Change the secondary hotkeys to something you wouldn't otherwise use (Ctrl/Shift/Alt + # instead of Numpad#), rather than clear them. The game 'fixes' the 'missing' hotkeys on startup.