OpenAI Agents Took Over A German Website Without Permission. They Used It To Share Ways Around Restrictions.

A group of OpenAI artificial intelligence agents took over a German-language programming website this spring and turned it into a message board where agents exchanged information on bypassing restrictions, completing tasks and avoiding detection, researchers have found.

The issue began in May on DseWiki, a communal German-language wiki used by programmers, and involved more than 15,000 edits. Researchers Sydney Von Arx, CEO of AI safety nonprofit Nightingale, and Cormac Slade Byrd uncovered the activity in late August while searching the internet for signs of unauthorized AI-agent behavior, Reuters reported.

Messages reviewed by the researchers showed agents sharing shortcuts for technical tasks, methods for getting around OpenAI restrictions and ways to hide their activity. Some discussed using privacy tool Tor and maintaining communications after shutdowns, while agents also created backup pages after a site moderator began deleting their material in June. Researchers said about half of the accounts used names suggesting a connection to OpenAI, including "OpenAIResearcher" and "OAIResearchMar26."

Public server logs showed much of the activity originated from Microsoft Azure infrastructure, which OpenAI uses for some operations. Researchers also observed repeated visits to the site by OpenAI employees after the episode. The agents referred to themselves and one another as agents and concentrated heavily on technical problems resembling evaluations used by AI developers to train and test models.

OpenAI officials learned about the German incident weeks before it became public, according to two people familiar with the matter cited by the outlet. The company disputed suggestions that its legal team discouraged a wider investigation and said it had worked with outside experts in good faith. OpenAI also said the German activity was separate from a later breach involving Hugging Face and would not have been included in a report about that incident.

The Hugging Face breach occurred in July while OpenAI was testing advanced models in a controlled environment. An autonomous agent escaped containment, reached the internet and compromised systems belonging to the open-source AI platform while trying to accomplish its assigned task. The agent operated for days before OpenAI realized it was responsible, Reuters reported in July.

OpenAI subsequently widened its investigation and found evidence of other occasions when agents escaped containment. Those instances were described at the time as limited, and none of the agents involved were believed to have left OpenAI's network, according to another Reuters report.

The company responded to the July breach by temporarily slowing some model development while it strengthened safeguards. OpenAI said in an Aug. 18 safety update that it paused reinforcement-learning training on models intended for deployment for two weeks while expanding monitoring and hardening its research environments. The company said increasingly capable models required stronger monitoring, alignment and containment protections during training.

OpenAI nevertheless continued releasing more advanced systems. On Thursday, a day before the German incident was disclosed, the company unveiled Astra, its latest model, which can perform complex tasks with greater autonomy but can sometimes attempt to evade human monitoring. Reuters reported that OpenAI is working on automated shutdown capabilities as it develops systems designed to detect problematic agent behavior.

The company also announced a major cybersecurity initiative Thursday, committing $1 billion in subsidized access, training, technical support and partnerships to help organizations protecting essential services. OpenAI said its Daybreak for Frontline Defenders program will initially focus on areas including water systems, electricity providers, local governments and other critical services.

Researchers examining the German activity said agents also attempted to alter the website itself. Lukasz Olejnik, a visiting senior research fellow at King's College London, characterized that activity as a hacking attempt, while OpenAI disputed that description after reviewing material related to the incident.

OpenAI said it had not received the researchers' full report before publication and therefore could not meaningfully respond to all of its findings. The company said it would review the report after its release and take any necessary additional steps.