Jim Irsay, the owner of the Indianapolis Colts said Tuesday afternoon that he would not vote to approve talk show Rush Limbaugh buyout of the St. Louis Rams.

I myself couldn't even think of voting for him, Irsay said from the NFL's fall ownership meeting in Boston, NBC's Profootballtalk reported. Irsay also denied speaking to other owners about Limbaugh's candidacy at the meeting. 

Irsay's comments come a day after Reverend Al Sharpton and Jesse Jackson asked Roger Goodell, the NFL commissioner, to block Limbaugh's bid. Some athletes also criticized Limbaugh's bid saying they won't play in a team owned by him.

Limbaugh admitted trying to buy the Rams last week but has gained opposition ever since. Among the claims against Limbaugh is that he has been divisive and made inappropriate, incendiary and insensitive racist comments in the past.

Limbaugh's once compared the NFL with the gangs and said The NFL all too often looks like a game between the Bloods and Crips without any weapons.