Camille Grammer, a former cast member on "The Real Housewives of Beverly Hills," was recently slammed by her ex-husband, Kelsey, when he made a joke on the late-night talk show "Conan," that he didn't have sex "for a decade" during his marriage to Camille.

Welcoming Kelsey onto the show, Conan began by inquiring about the former "Frasier" star's love life, asking, "your life has changed since I last saw you, you have a new wife?" Kelsey responded that he had gotten remarried to his new wife, Kayte Walsh -- a British flight attendant who is 26 years his junior --  in February of 2011. Grammer then announced that he wanted to use the opportunity to clear up some of the rumors he had read online about the genesis their relationship, which began while he was still married to Camille.

"I did want to clear this up," said the 55-year-old actor. "[An online tabloid] said something about how Kayte and I had met and hooked up in London and that she'd spent the night with me, you know, a one-nighter. That's not true. We kissed that night .... we didn't do much more than kiss, actually, for several months."

"I would think that would be difficult," retorted Conan. "You meet someone, there's obviously passion there ..." Laughing, Grammer responded, "Oh, for a guy who hadn't had sex for a decade it wasn't that hard."

But now Camille Grammer, 44, who was married to Kelsey for 13 years and had 2 children with him before he left her for Walsh, isn't laughing. In an interview with RumorFix, Camille vehemently denied her ex-husband's claims, saying "That's simply not true!"

According to a source allegedly close to Camille, the couple's love life took a nosedive after Grammer suffered a near-fatal heart attack in 2008. "Doctors told him he couldn't have any strenuous activity and that includes sex. So of course that would diminish their sexual activity," said the source, according to a report by Perez Hilton.

 "He lied on Conan," added Grammer in a private tweet to the Huffington Post. "He really needs to move on."

The couple was formally divorced in 2011, just 2 weeks before Grammer wed Walsh. The marriage was the fourth for Grammer and the first for Walsh, who gave birth to a daughter, Faith Evangeline Elisa Grammer.

Camille was reportedly awarded a $30 million settlement in the divorce, and is dating 36-year-old attorney Dimitri Charalambopoulos.