James Corden
James Corden said that speculations that his “The Late Late Show” and Stephen Colbert's “The Late Show” would be swapping time slots are “silly.” Pictured: Corden after being awarded an OBE by the Princess Royal at an investiture ceremony at Buckingham Palace on June 25, 2015 in London, England. Getty Images/WPA Pool

James Corden's decision to take back his apology after being accused of "abusive" behavior toward servers at a New York City restaurant has left the owner outraged.

Earlier this week, Corden was briefly banned from the NYC restaurant Balthazar after owner Keith McNally blasted the "Late, Late Show" host over two incidents in which the comedian was rude to the staff.

McNally later lifted the ban after Corden called him to apologize, but during an interview with the New York Times on Thursday, Corden retracted his apology.

"I haven't done anything wrong, on any level," Corden told the reporter. "So why would I ever cancel this? I was there. I get it. I feel so Zen about the whole thing. Because I think it's so silly. I just think it's beneath all of us. It's beneath you. It's certainly beneath your publication."

On Friday, McNally criticized Corden's comments and demanded an apology for the Balthazar servers.

"I've no wish to kick a man when he's down. Especially one who's worth $100 Million, but when James Corden said in yesterday's NY Times that he hadn't done 'anything wrong, on any level,' was he joking? Or was he denying being abusive to my servers? Whatever Corden meant, his implication was clear: he didn't do it," McNally wrote in an Instagram post.

McNally continued, "Although I didn't witness the incident, lots of my restaurant's floor staff did. They had nothing to gain by lying. Corden did. I wish James Corden would live up to his Almighty initials and come clean."

"If the supremely talented actor wants to retrieve the respect he had from all his fans (all 4 of them) before this incident, then he should at least admit he did wrong. If he goes one step further and apologizes to the 2 servers he insulted, I'll let him eat for free at Balthazar for the next 10 years."

McNally's response came hours after he offered Corden a year of free meals if the comedian apologized to the staff.

"I have no wish to kick a man when he's down, but I believe the best way for James Corden to retrieve some of the vast respect the public had for him before this incident is to own up to it and apologize to the young servers he abused," McNally told TMZ.

"If he's big enough to do that, he can eat free at Balthazar for the rest of the year."

Corden has not publicly addressed McNally's latest comment about the restaurant drama.