That's frustrating! The only thing I thought at the end was just to ask if he actually knows how to spend time with his family? If he doesn't do it a lot and you are pretty streamlined as a team, perhaps he feels there's not an easy place for him besides silent bump on a log. Maybe next time he could be in charge of where you go and for how long, etc.? I don't know the dynamic of history, so please forgive me if I am off base here. Some are simply uninterested, but some I think are shy to ask about how they can fit in.
"Any idiot can face a crisis; it is this day-to-day living that wears you out." -Anton Chekhov