Donald Trump told his staff, visitors and advisers he was convinced Robert Mueller was a part of “witch hunt” against him and contemplated on firing the special counsel, the New York Times reported Tuesday. However, the president refrained from doing so after his senior aides advised against it, the report added.

Trump was also bothered by reports from conservative news outlets that said Mueller was close to ex-FBI Director James Comey, sources told the Times. The president thought because of Mueller’s closeness to Comey — who was fired by Trump on May 9 — the special counsel would be partial in his supervision of the investigation into Trump campaign’s ties to Russia. Mueller served as FBI director prior to Comey was appointed to that position in September 2013.

Read: What Robert Mueller Will Actually Investigate

However, Trump’s staff talked him out of firing Mueller — a decision they believed would have been bad for his administration, the sources told the Times. However, people close to the president said he may not change his mind if he comes to know the Russia investigation was compromised.

CEO of Newsmax Media, Chris Ruddy, a longtime friend of Trump first told PBS Monday that Trump was thinking of dismissing Mueller.

“I think he’s considering perhaps terminating the special counsel,” Chris Ruddy told “PBS NewsHour” on Monday. “I think he’s weighing that option.”

Ruddy maintained he thinks in case the president makes such a decision, it would be unwise of him — especially after Comey’s firing got him lot of criticism.

“I personally think it would be a very significant mistake,” Ruddy said.

Ruddy also said the president would be within his right to dismiss the special counsel because of the two’s history. The special counsel’s law firm WilmerHale represented Trump's former campaign manager and some Trump family members. He also interviewed Mueller for the role of FBI director before he was appointed special counsel.

Newt Gingrich, former speaker of the House of Representatives tweeted Monday that he would not believe Mueller would handle the Russian investigation in an impartial way.

Read: Lawmakers React To Robert Mueller's Appointment To Oversee Russia Probe

“Republicans are delusional if they think the special counsel is going to be fair. Look who he is hiring.check fec reports. Time to rethink,” Gingrich tweeted.

However, Adam Schiff, a Democrat member of the House Intelligence Committee Adam Schiff, said the House would not tolerate Trump firing Mueller.

"If President fired Bob Mueller, Congress would immediately re-establish independent counsel and appoint Bob Mueller. Don't waste our time," Schiff tweeted Monday.

However, on Tuesday night White House spokeswoman Sarah Huckabee Sanders said Trump is not considering to fire Mueller

“While the president has the right to, he has no intention to do so,” Sanders said.