Grammy Award-winning gospel singer Israel Houghton openly admitted he sinned during his 20-year marriage to wife Meleasa, but it came at a cost. Houghton was kicked out of Joel Osteen‘s Lakewood Church amid rumors Houghston cheated on his wife with Rob Kardashian’s ex-girlfriend Adrienne Bailon. The singer served as a minister for five years at the Texas super-church.

“Lakewood Church released Israel Houghton from his responsibilities as a worship leader [in February] and placed him on indefinite leave. Since that time, he has not been featured in any Lakewood Church related activities,” a rep for Lakewood told Radar Online in a statement Wednesday. “Lakewood Church is not at liberty to discuss publicly any details regarding Israel’s personal situation, but stands ready to provide Israel with spiritual counseling and guidance should he choose to seek it.”

The timing coincides with when Houghton revealed his marriage with Meleasa was over. “Several years ago I failed and sinned in my marriage. Though this is new to many, it is not new to us as we have been working through this for over five years,” he wrote in a February Facebook post. “Although we tried, the challenges in our relationship have proven too much to overcome.”

But when he showed up on a romantic vacation with Bailon, it wasn’t long before rumors claimed the co-host of “The Real” was the cause for his failed marriage. He denied this allegation in a new post Tuesday. “It deeply saddens me that an innocent party would be dragged into this situation that I have taken personal responsibility for,” Houghton wrote. “Adrienne is a woman of integrity and character. Most of all she is a true friend, and she should not be blamed for my past indiscretions.”

Bailon, 32, hasn’t responded to the drama. Instead, she enjoyed her Tulum, Mexico, vacation with her new beau. “They normally hang out in group circles but over spring break decided to take a trip alone together for the first time,” an insider told Us Weekly on Tuesday.

Follow me on Twitter @mariamzzarella