Prince Charles may be the heir to the British Throne, but during his marriage to Princess Diana, Queen Elizabeth’s son once joked he felt less than royal whenever he attended events with his wife.

In the memoir, “The Making of a Justice: Reflections on My First 94 Years,” retired Supreme Court Justice John Paul Stevens reflected on some of the most memorable moments throughout his life.

According to People, one of those sacred memories included the first time he met Prince Charles and Princess Diana. The three met in 1985 at the National Gallery of Art in Washington, D.C. during a formal dinner.

While Stevens doesn’t remember much of the art, he hasn’t forgotten the conversation he had with the Prince of Wales.

“Diana, an unforgettably beautiful and gracious woman, was the center of attention for one group of admirers after another,” the former Supreme Court Justice recalled.

“I remember standing with Charles nearby as he remarked about his second-class appeal whenever he and Diana were in joint attendance at similar events.”

Prince Charles was well aware of Princess Diana’s beauty and grace. However, others would frequently remind him of his wife’s effortless charm.

Queen Elizabeth’s cousin, Lady Elizabeth Anson previously told People the attention Diana received didn’t sit well with Charles. “[Diana] sort of metamorphosed into a very, very elegant blonde beauty,” she explained.

“They did a visit to Wales which was the beginning of, for Prince Charles, realizing, ‘They’ve come out to see my wife, they haven’t come out to see me.’ ”

Years after the gathering, Prince Charles and Princess Diana’s marriage fell apart and the couple divorced in 1996. The following year, Diana died in a car crash in Paris. Diana’s sons, Prince William and Prince Harry continue to keep their mother’s memory alive and often speak fondly of her in the press.

Prince Charles and Princess Diana
Prince Charles and Princess Diana are pictured attending a centenary service for the Royal College Of Music on Feb. 28, 1982 at Westminster Abbey, London. Fox Photos/Hulton Archive/Getty Images