there are wepons like flame blade which use your casting stat instead of str or dex but generally yes proficiency matters

Luke Skywalker: I don't, I don't believe it.
Yoda: That is why you failed.