Prince Andrew was once faced with the awkward dilemma of choosing between Prince Philip or Sarah Ferguson. The Duke of Edinburgh and Fergie were known to dislike each other.

While speaking with Vanity Fair, American journalist Edward Klein claimed that Prince Philip bullied his third child into kicking his ex-wife out of the Royal Lodge following their split. The incident left the Duke of York choosing between his dad and Ferguson.

Prince Philip also managed to convince Queen Elizabeth II to dislike Ferguson as well. Instead of clearing Her Majesty’s head after the Duchess of York’s toe-sucking scandal, the dad of four continued to loathe on Prince Andrew’s ex-wife.

“Philip’s almost irrational loathing of Sarah Ferguson led the Queen, who normally shows shrewder judgment, to cast Fergie out of the royal orbit without a penny after her divorce from Andrew, which guaranteed that Fergie would turn into a high-profile beggar and an embarrassment to the throne,” Klein said.

And according to royal expert Richard Fitzwilliams, it seems that there’s no hope for a reconciliation between Prince Philip and Ferguson. In fact, recent reports claimed that Ferguson immediately left Balmoral Castle after the Duke of Edinburgh arrived at the Queen’s vacation home much earlier than expected.

“I don’t think the rift between Prince Philip and Sarah Ferguson will ever heal. He recognizes the damage she did when she was a member of the royal family and the way she has behaved in subsequent years has done nothing to give him any confidence in her judgment… “He naturally attended Eugenie’s wedding last year but those who thought this indicated any feelings of warmth towards Sarah were much mistaken,” Fitzwilliams told Express.

Ferguson has not spoken to Prince Philip since she separated from Prince Andrew. In fact, it is only now that the two are able to be in the same room together. In the past, Ferguson was snubbed from royal family events for the simple reason that Prince Philip was there.

Prince Andrew, Sarah Ferguson
Pictured: Prince Andrew, Ferguson attend the Virgin London Marathon on April 25, 2010 in London, England. on April 25, 2010 in London, England. Getty Images/Gareth Cattermole