There have been rumors that Prince Harry and Meghan Markle are considering a move to the United States following continued negative perception of them after their explosive documentary and lawsuit against members of the press. However, if the pair does actually decide to try and leave the UK, it may leave two other members of the royal family devastated.

According to royal author Phil Dampier, rumored plans that the Duke and Duchess of Sussex are thinking of a part-time move to the US and are possibly using their planned six-week break there over the holidays to scope out homes is something that is particularly difficult for the royals—specifically, Prince William and Kate Middleton.

According to Express UK, Dampier feels that the Duke and Duchess of Cambridge would actually be hurt if the pair moved, and in an effort to stop it from happening and to keep Queen Elizabeth from also being hurt by it, the Duchess is trying to help her sister-in-law cope.

“It would be a disaster if Harry and Meghan quit and lived abroad—William and Kate would be devastated,” he said. “Behind the scenes I’m told Kate is doing her best to bring everyone together and help Meghan. None of them want to let the Queen down so Kate is trying to patch things up in private.”

“I’m told she has reached out to Meghan and spoken to her on the phone,” he added. “Kate feels sorry for her and knows that Meghan is struggling. Catherine has told Meghan that every royal—including herself—goes through a bad patch with the press but the important thing is to learn by mistakes, move on and get through it.”

However, even as she reportedly works to convince her brother and sister-in-law not to leave, reports have stated that Prince Harry and Markle have come to terms with the fact that their planned lives in the UK just haven’t been working out the way they should be.

“There’s an acceptance that things haven’t worked out with the Sussexes full-time in Windsor so they could have a second base in America,” sources previously said. “The Duke and Duchess will be taking some family time towards the end of the year, once their diary commitments are done. We are unsure at this time but it will likely be spent between the UK and US. Any further inference on their plans is pure speculation.”

Prince William, Prince Harry, Meghan Markle and Kate Middleton
Pictured [L-R]: The Duke of Cambridge, Duke of Sussex, Duchess of Sussex and Duchess of Cambridge arrive at Westminster Abbey to attend a service to mark the centenary of the Armistice on Nov. 11, 2018 in central London. Paul Grover/AFP/Getty Images