Your also giving up 2 ASI bonuses to do that. Which means your primary stat is never going to be 20, unless you use hag hair.
2 Things: 1 - You only need one ASI to get your main stat to 20 ... you get 3 (or more with certain classes) ... so you should be fine. 2 - With some items, you dont really need any. You may want watch this:
I still dont understand why cant we change Race for our hirelings. Lets us play Githyanki as racist as they trully are!