Keep practicing mate, you'll get it. I think it was Shadiversity on Youtube that said swords couldn't be drawn from the back at all, and he had to correct himself.
Its not a practice issue. The scabbard is not made for backdraw. Hince it doesnt work. Backdraw needs a specialized scarbbard, like i said in my op
