Colts owner Jim Irsay vowed to vote against Rush Limbaugh in his bid to buy the St. Louis Rams while Commissioner Roger Goodell said the conservative commentator’s “divisive” comments would not be tolerated from any NFL insider.

At an owners meeting, Irsay said, “I, myself, couldn’t even consider voting for him. When there are comments that have been made that are inappropriate, incendiary and insensitive…our words do damage, and it’s something that we don’t need.

While establishing himself as one of the most successful broadcasters in history, Limbaugh has long been a hero of conservatives and villain to the left, thriving on his place in the political spectrum. But the NFL tries to avoid controversy, as Limbaugh learned in 2003 when he was forced to resign from ESPN’s Sunday Night Football broadcast after saying of Philadelphia’s Donovan McNabb: “I think what we’ve had here is a little social concern in the NFL. The media has been very desirous that a black quarterback do well.”

On Tuesday, Goodell repeatedly distanced the league from Limbaugh’s statements, calling them “polarizing comments that we don’t think reflect accurately on the NFL or our players.”

(via ESPN)