Credited from: INDIATIMES
OpenAI banned clusters of accounts linked to covert influence operations originating from Russia and Iran that utilized its ChatGPT AI software to facilitate deceptive messaging strategies. The artificial intelligence company described these operations as combining AI-generated content with traditional deceptive methods, effectively running "false front" campaigns aimed at influencing public opinion in various geopolitical contexts, according to NPR and Channel News Asia.
Specifically, OpenAI's report indicated that the Russian operation, deemed the most complex it had ever disrupted, utilized a fake research organization named the Social Research Center (SRC) to conduct activities primarily aimed at undermining Ukraine's reputation in Latin America. This campaign allegedly employed unsuspecting local employees who contributed original content, completely unaware of their involvement with Russian operatives, as detailed in reports from India Times and NPR.
Meanwhile, the Iranian influence operation utilized fake journalist personas to disseminate nearly 100 articles related to the US-Iran conflict across various media outlets. OpenAI noted that articles were published under fictitious bylines and included content strategically pitched to real editors, highlighting the sophisticated nature of the operation. This aspect of the campaign was rated Category 4 in terms of impact, indicating significant reach into target audiences, according to Channel News Asia and India Times.
OpenAI has categorized the Russian operation as a Category 5 on its influence operations scale, marking it as a high-impact effort that had visible repercussions, including public responses from politicians. The covert nature of these operations, which included attempts to fake incidents and misattribute accomplishments, underscores the potential dangers of AI-assisted information campaigns, as highlighted by reports from India Times and Channel News Asia.
The tactics used in both operations illustrated how AI can enhance the efficiency and credibility of covert influence strategies, allowing operatives to manipulate narratives with greater ease than previous tactics permitted. OpenAI emphasized the need for vigilance against such misuse of technology in order to protect the integrity of information channels globally, as discussed in NPR, Channel News Asia, and India Times.