Have you also tried opening the inventory - with the N key - and right clicking the bottle? I've had to do this at some point to select "Throw" for an item.