There is only so far he will trust them, and the same goes for Xavier and the Summers clan in return.

"You will live together in your own household with a mixture of helpers from each family. You will come to our household for Shabbat and to his families for other holidays." Not alone of course, there will be bodyguards at the very least and very little trust for a long time he's sure.