Yeah, Astarion wants nothing to do with the gods. Wyll doesn't consider himself a pious man, but he's not actually opposed to them or anything. There's an opportunity to pray with Karlach near the end of the game, but I can't remember which gods she mentions - she picks out a few.
