Yes, you need to add the arrow head and arrow recipe or whatever you like.

The recipes to craft debuff all potions still exist in EE.