Japan's gaffe-prone Tokyo Olympics chief apologised on Thursday for making sexist remarks that prompted outrage, but refused to resign and dug a deeper hole when he admitted he didn't "speak to women much".

Yoshiro Mori's comments, in which he said women speak too much in meetings, are the latest headache for organisers already battling public disquiet about the pandemic-postponed Games.

The 83-year-old former prime minister triggered further criticism when he admitted "I don't speak to women much" in a hastily organised press conference called to make his apology.

And while Mori said his initial remarks were "inappropriate" he became defensive when questioned, insisting he had heard complaints that women speak at length.

"Board of directors meetings with many women take a lot of time," Mori said Wednesday, according to the Asahi Shimbun daily.

A former Japanese prime minister, the 83-year-old has a history of making public gaffes
A former Japanese prime minister, the 83-year-old has a history of making public gaffes POOL / Takashi Aoyama

"When you increase the number of female executive members, if their speaking time isn't restricted to a certain extent, they have difficulty finishing, which is annoying," he was quoted as saying.

Mori, who is known for his gaffes, did not dispute the report and told reporters he wanted to "retract" his comments.

"What I said... went against the spirit of the Olympics and Paralympics, and I recognise that it was inappropriate," he said.

"I will reflect deeply on this. I would also like to retract what I said. I would like to apologise to everyone who was offended."

But he added that he was "not thinking about resigning" and insisted he was responding to comments he had heard about women speaking for too long.

The delayed Tokyo Olympics are due to start on July 23
The delayed Tokyo Olympics are due to start on July 23 AFP / Philip FONG

"I hear those things often," Mori said.

"I don't speak to women much recently, so I wouldn't know," he added.

"You are asking all these questions because you wanted to write funny stories, aren't you?"

The International Olympic Committee (IOC) reacted by stating that gender equality was one of its fundamental principles and "one of the key pillars of Olympic Agenda 2020", a roadmap for organising future Games.

"President Mori has apologised for his comments today. With this the IOC considers the issue closed," an IOC spokesperson said when contacted by AFP.

The World Economic Forum's 2020 report on disparities bewtween the sexes.
The World Economic Forum's 2020 report on disparities bewtween the sexes. AFP / John SAEKI

The comments sparked a furious reaction in Japan, with the phrases "enough already", "misogyny" and "we demand Yoshiro Mori resigns" all trending on Twitter.

Mori's remarks were heavily criticised by opposition lawmakers in parliament, and Prime Minister Yoshihide Suga was booed loudly when he said he was "not aware of the details".

After being read Mori's comments, he said they were something "that should not be allowed".

Mori told a newspaper earlier Thursday that his wife had given him a "thorough scolding" over his comments.

He made the remarks to members of the Japan Olympic Committee, some of whom were reported to have laughed in response.

The JOC decided last year to aim to have 40 percent female board members, but as of November, there were just five women among the board's 24 members.

"We have about seven women at the organising committee but everyone understands their place," Mori reportedly told JOC members.

While ranking high on a range of international indicators, Japan persistently trails on promoting gender equality -- ranking 121 out of 153 nations surveyed in the World Economic Forum's 2020 global gender gap report.

"It's shameful," tweeted Renho, a prominent Japanese opposition politician who uses one name, pointing out the Olympic Charter's commitment to "practising sport, without discrimination of any kind".

Japan's Olympic Minister Seiko Hashimoto, herself a former Olympian, said she wished to hold "thorough discussions" with Mori.

"The Olympics' fundamental principle is to promote women's advancement in sport at all levels and organisations in order to realise gender equality," Hashimoto said, according to public broadcaster NHK.

Mori has a history of making controversial remarks, and made waves earlier this week by insisting the Games would go ahead this summer "however the coronavirus (pandemic) evolves".

The comments came with polls showing around 80 percent of Japanese oppose holding the Games this year, and as several parts of Japan are under a virus-related state of emergency.