If a Pact Of The Blade Warlock used Bind Pact Weapon at any point; even after respeccing the class the weapon will remain permanently bound to the Warlock.
*As can be seen in this example a weapon remains permanently bound to Wyll, despite him changing into a Pact Of The Tome Warlock.