You don't have to accept Lady Ester's quest. You can beat her up to your heart's content, get the egg and it should be fine.