Any hope Prince Harry and Meghan had that their children might one day play an active role in the royal family is fading fast ...