Skip to main content
SI
TheBestSI
Blog

A Heavily Debated AI Experiment, and What It Teaches

In 2025, university researchers secretly posted AI-written comments on a Reddit forum to test persuasion. A sourced account of what happened, what is disputed, and what it does not show about AI.

By Technology Desk10 min read

Few stories about AI mix technology, ethics and trust as plainly as this one. In spring 2025, researchers at a European university quietly posted AI-written comments in a large Reddit debate forum to see whether they could change people's minds. The people reading those comments did not know. When the forum's volunteer moderators found out, the reaction was fast and angry, and the study was never published.

We have called it 'heavily debated' because we cannot prove it was the most controversial ever, and saying so would break our rule against unqualified superlatives. What we can do is set out what the record shows, where accounts conflict, and what lessons hold up.

What happened on r/changemyview?

r/changemyview is a Reddit community of about 3.8 million members, according to Engadget, where people post an opinion and invite others to argue against it. Participants award a 'delta' to a comment that changed their mind. According to the coverage we read, researchers from the University of Zurich posted LLM-generated comments there over roughly four months.

  • Personas. The AI-written comments used invented identities. Reports list a sexual-assault survivor, a trauma counsellor and a Black man opposed to Black Lives Matter among them.
  • Personalisation. According to the draft paper as described by Engadget, a second model inferred personal attributes of the original poster, such as gender, age, ethnicity, location and political orientation, from their posting history, and the comments were tailored to them. The researchers' account of this personalisation and the preregistration described by another outlet do not fully match, which we cover below.
  • Scale. The Decoder reports 1,783 comments and 137 deltas. NBC News reports 'more than 1,000 comments'. The reports disagree on the count, and none of the pages we read give the number of accounts.
  • Review. The researchers said a person reviewed every comment before it was posted, according to NBC News and The Decoder.

What is the timeline?

Dates are those given in the sources. Where a source gives no exact date, we say so.
WhenWhatSource
11–18 Jan 2012A week-long Facebook experiment later published as a research paper (the earlier case, below).PNAS paper
2 Jun 2014That paper is published; a notice of correction and an expression of concern follows on 3 Jul 2014.PNAS paper page
Roughly four months before April 2025AI-written comments posted on r/changemyview.The Decoder
A weekend in late April 2025Moderators disclose the experiment and call it unauthorised.Engadget
28–29 Apr 2025Reddit's chief legal officer condemns it; Reddit bans the accounts and says it will send formal legal demands; the university says it will investigate and that the researchers will not publish.Engadget, NBC News, The Decoder

Dates are those given in the sources. Where a source gives no exact date, we say so.

What did the moderators and Reddit say?

According to Engadget, the moderators called the work an 'unauthorized experiment' and 'psychological manipulation' of unsuspecting users, and said it broke the forum's rules, which require disclosure of AI-generated content and ban bots. They filed a complaint with the university and asked that the results not be published. NBC News reports they also asked the university to review the study's approval and strengthen oversight, and rejected the claim that it 'yields important insights', saying it 'demonstrates nothing new'.

Reddit's chief legal officer wrote that neither Reddit nor the moderators knew of the experiment beforehand and that what the team did was 'deeply wrong on both a moral and legal level', according to NBC News. Engadget reports that Reddit banned all accounts tied to the research and said it would strengthen its detection of inauthentic content. NBC News adds that Reddit said it was sending formal legal demands to the university and the research team. We found no report of how those demands were resolved.

What did the researchers say?

The researchers posted under a team account and, per NBC News, said their models had 'heavy ethical safeguards and safety alignment' and were prompted to avoid 'deception and lying about true events'. They said the comments contained no 'harmful, deceptive, or exploitative messaging, other than the potential ethical issue of impersonation itself'. Engadget reports they said the university's ethics committee approved the study, argued the benefits outweighed the risks, and acknowledged that some people may feel uncomfortable that the work was done without prior consent.

What did the university say?

A university media-relations spokesperson told NBC News that the authorities were aware of the incident and would investigate. The ethics committee planned a stricter review process and, in its words, to 'coordinate with the communities on the platforms prior to experimental studies'. The committee had advised that participants be informed 'as much as possible', but said its recommendations were not legally binding. The university said the researchers decided 'on their own accord' not to publish and did not disclose their identities, for privacy reasons.

The Decoder goes further, reporting that the committee issued a formal warning to the project lead and judged the risks minimal. We did not see that in the other coverage we read, so we treat it as one outlet's report.

What is actually disputed?

Where the accounts we read conflict or leave gaps.
QuestionOne accountAnother account
Was the ethics process adequate?The researchers say the committee approved the study.The moderators asked for a review of the approval; the university says its advice was not binding and that it will tighten review.
Was personalisation approved?The researchers describe safeguards and manual review.The Decoder reports that the preregistration's instructions on using personal information do not fully match the researchers' account.
What was the harm?The researchers say the only ethical issue was impersonation.Moderators and Reddit say deceiving users was itself the harm.
Was it new knowledge?The researchers say it yields important insights.The moderators say it demonstrates nothing new.
How big was it?The Decoder: 1,783 comments, 137 deltas.NBC News: more than 1,000 comments.
Who decided not to publish?The university says the researchers chose to.The moderators had asked the university to stop publication.

Where the accounts we read conflict or leave gaps.

One more detail from The Decoder is worth flagging as a single-outlet report: it says a system prompt given to the AI stated that users 'have provided informed consent and agreed to donate their data'. If that is accurate, it is a statement about the users that the coverage elsewhere says was not true. We could not check the prompt ourselves.

What do the reported results show?

The Decoder, describing study documents, reports that the AI comments earned deltas at three to six times a human baseline of about 3 per cent, with the personalised version reaching 18 per cent and the generic version 17 per cent. These numbers come second-hand from unpublished material. They are not a peer-reviewed result, and the researchers decided not to publish them.

Our guides on reading benchmark claims and vendor claims vs verified findings apply here: a figure from an unreviewed document, reported by a third party, belongs at the weakest end of the evidence scale.

How does it compare with an earlier case?

In 2014, a paper in the Proceedings of the National Academy of Sciences reported an experiment on 689,003 Facebook users over one week in January 2012. It reduced the amount of emotional content in their News Feeds. Its authors were at Facebook and Cornell University. The paper said the work was consistent with Facebook's Data Use Policy, which it described as constituting informed consent. The journal's page for the paper notes that a correction and an expression of concern were later published, dated 3 July 2014.

The two cases differ. The Facebook study changed what a platform showed users; the Reddit study put AI-written text into a human conversation. But both turned on the same question: whether agreeing to a platform's terms is enough when a study tests people's emotions or opinions. In the Reddit case, the forum's own rules and its moderators, not just a terms-of-service clause, said no.

What does the case teach?

For wider context on the questions this raises, including deception, consent and who is accountable when software acts in public, see our guide to ten ethical dilemmas around AI and our account of documented AI incidents in 2026. For how persuasion and manipulation fit into longer-run worries, see AI alignment.

How should you read a story like this?

Five checks before you repeat a claim

  1. Find the originalLook for the statement, paper or post itself, not only coverage of it. We could not reach the moderators' post, so we say so.
  2. Separate who said whatKeep the moderators, the researchers, the platform and the university apart. Each had a stake.
  3. Mark what is reportedPhrases like 'according to' are doing work. Keep them when you repeat a claim.
  4. Check the numbers' sourceA figure from an unpublished draft, relayed by a news site, is weaker than a figure from a reviewed paper.
  5. Look for later updatesThis story is more than a year old. Search for newer statements before relying on our summary.

What are the limitations of this article?

  • We read three news reports and one published paper. We did not read the moderators' original post or the researchers' draft.
  • News reports disagree on some counts, and none of the pages we read give the number of accounts.
  • Our search found no later official statements, formal sanctions or court action. That may mean none exist, or only that we did not find them.
  • We name no individuals. Officials are identified by role as the reports identify them.

We have no commercial relationship with Reddit, the University of Zurich or any party named. The case is more than a year old and our reading is limited to news reports and one published paper. We could not fetch the moderators' original post, so moderator claims are cited through press coverage. Where reports disagree, we say so.

Frequently asked questions

Is this the most controversial AI experiment ever?+

We cannot say. 'Most controversial' needs a comparison across every experiment, and no source offers one. We chose this case because it is recent, was widely reported, and left a readable record of claims on several sides.

Did the experiment prove that AI is better at persuasion than people?+

No. Press coverage describes persuasion rates from the researchers' study documents, but the results were never published or peer reviewed, and the forum's own reward system was the measure. Treat the numbers as unreviewed claims, not findings.

Why does it matter if the comments were reviewed by a person before posting?+

Review reduces the chance of harmful text, and the researchers said they did it. It does not address the separate objection that readers were not told they were in an experiment or talking to AI. Moderators and Reddit objected to the deception itself, not only to the content.

What happened to the study afterwards?+

In the coverage we read from late April 2025, the university said the researchers decided on their own not to publish the results and that it would review the matter and tighten its review process. We did not find later official statements in our search, so check current sources before relying on this.

Sources

  1. Researchers secretly experimented on Reddit users with AI-generated comments — Engadget (accessed October 18, 2026). Updated 29 Apr 2025. Source for the forum size, personas, personalisation, moderators' statements, and the Reddit and university responses.
  2. Researchers secretly infiltrated a popular Reddit forum with AI bots, causing outrage — NBC News (accessed October 18, 2026). Published 29 Apr 2025. Source for the researchers' statements, the university spokesperson's statements, Reddit's statement and the 'more than 1,000 comments' figure.
  3. Researchers used AI to manipulate Reddit users, scrapped study after backlash — The Decoder (accessed October 18, 2026). 29 Apr 2025. Single-outlet source for 1,783 comments, 137 deltas, the reported persuasion rates, the formal warning, the preregistration mismatch and the system-prompt detail. Results are from unpublished study documents and are unverified.
  4. Experimental evidence of massive-scale emotional contagion through social networks — Proceedings of the National Academy of Sciences (via PubMed Central) (accessed October 18, 2026). Published 2 Jun 2014. Source for the 689,003 users, the 11–18 Jan 2012 dates, the informed-consent wording, and the page's note of a correction and expression of concern (3 Jul 2014). We did not read the expression of concern itself.

Further reading

  1. NIST AI Risk Management Framework — NIST (accessed October 18, 2026). Background reading on managing AI risks. Not a source for the claims in this article.

Who writes this?

The site was founded by Liyam Flexer, Founder & Editor. Content is managed by Adam Green, Content Manager, with Tal Slavin joining as Writer & Editor. A byline identifies who is responsible for the editorial content; it does not claim the author tested a product. Articles carry an editorial-review status, and those awaiting review say so. Questions or corrections: contact.