During the scene where Voss visits your camp to talk about the prism, inactive party members are not present, so you can't speak to them until the morning.