To split a stack, hold down control and drag the stack onto the ground or into any container.
Only one bottle is used when creating a potion, the others may be covered by other things in the inventory, making them invisible.