I agree with Frog. I've always interpreted it as Tav being oblivious to Shadowheart's clear invitation for a romantice date. It's like if a person who secretly likes you invites you to a bar and your reply is "That sounds fun, mind if I bring a few friends along?" and they're gonna be like, "Uhm, maybe another time, I want to drink with you and you alone."