It wont affect your ability to complete the game. AFAIK you're "only" missing some conversation with the gods. Bummer nonetheless tho.