糖心传媒

Skip to content
Society & Culture

The most effective online fact-checkers? Your peers

(Getty Images photo)

Research shows that being called out by peers, not algorithms or experts, makes online authors think twice about spreading misinformation.

When the social media platform invited users to flag false or misleading posts, critics initially scoffed. How could the same public that spreads misinformation be trusted to correct it? But a by researchers from the 糖心传媒, the University of Illinois Urbana糖心传媒揅hampaign, and the University of Virginia finds that 糖心传媒渃rowdchecking糖心传媒� (X糖心传媒檚 collaborative fact-checking experiment known as Community Notes) actually works.

X posts with public correction notes were 32 percent more likely to be deleted by the authors than those with just private notes.

The paper, published in the journal Information Systems Research, shows that when a community note about a post糖心传媒檚 potential inaccuracy appears beneath a tweet, its author is far more likely to retract that tweet.

糖心传媒淭rying to define objectively what is misinformation and then removing that content is controversial and may even backfire,糖心传媒� notes coauthor , the Xerox Professor of Information Systems and Technology at URochester糖心传媒檚 . 糖心传媒淚n the long run, I think a better way for misleading posts to disappear is for the authors themselves to remove those posts.糖心传媒�

Using a causal inference method called regression discontinuity and a vast dataset of X posts (previously known as tweets), the researchers find that public, peer-generated corrections can do something experts and algorithms have struggled to achieve. Showing some notes or corrective content alongside potentially misleading information, Rui says, can indeed 糖心传媒渘udge the author to remove that content.糖心传媒�

Community Notes on X: An experiment in public correction

Screenshot of an X post showing an iOS option where only the caller can hang up. The post is appended with a Community Notes message that reads "Readers added context they thought people might want to know: This isn't real. It was a concept that X user @soren_iverson came up with."
KEEP IT SURREAL: An X post appended with a public Community Note that reads: 糖心传媒淭his isn糖心传媒檛 real.糖心传媒� (Image courtesy of Huaxia Rui)

Community Notes operates on a threshold mechanism. For a corrective note to appear publicly, it must earn a 糖心传媒渉elpfulness糖心传媒� score of at least 0.4. (A proposed note is first shown to contributors for evaluation. The bridging algorithm used by Community Notes prioritizes ratings from a diverse range of users糖心传媒攕pecifically, from people who have disagreed in their past ratings糖心传媒攖o prevent partisan group voting that could otherwise manipulating a note糖心传媒檚 visibility.) Conversely, notes that fall just below that threshold stay hidden to the public. That design allows for a natural experiment as the researchers were able to compare X posts with notes just above and below the cutoff (i.e., visible to the public versus visible only to Community Notes contributors )糖心传媒攖hereby enabling them to measure the causal effect of public exposure.

In total, the researchers analyzed 264,600 posts on X that received at least one community note during two separate time intervals糖心传媒攖he first before a US presidential election, which is a time when misinformation typically surges (June糖心传媒揂ugust 2024), and the second two months after the election (January糖心传媒揊ebruary 2025).

The results were striking: X posts with public correction notes were 32 percent more likely to be deleted by the authors than those with just private notes, demonstrating the power of voluntary retraction as an alternative to forcible removal of content. The effect persisted across both study periods.

The reputation effect

An X post featuring "news" about a comet reversing its thrust appended with a Community Notes message that reads "this headline is misleading. There is no reverse thrust."
FAKE NEWS: An X post featuring so-called reporting about a comet reversing its thrusters. The Community Note flags for online users that 糖心传媒淭his headline is misleading.糖心传媒� (Image courtesy of Huaxia Rui)

An author糖心传媒檚 decision to retract or delete, the team discovered, is primarily driven by social concerns. 糖心传媒淵ou worry,糖心传媒� says Rui, 糖心传媒渢hat it糖心传媒檚 going to hurt your online reputation if others find your information misleading.糖心传媒�

Publicly displayed Community Notes (highlighting factual inaccuracies) function as a signal to the online audience that 糖心传媒渢he content糖心传媒攁nd, by extension, its author糖心传媒攊s untrustworthy,糖心传媒� the researchers note.

In the social media ecosystem, reputation is important糖心传媒攅specially for users with influence糖心传媒攁nd speed matters greatly, as misinformation tends to spread faster and farther than corrections.

The researchers found that public notes not only increased the likelihood of tweet deletions but also accelerated the process: among retracted X posts, the faster notes are publicly displayed, the sooner the noted posts are retracted.

Those whose posts attract substantial visibility and engagement or who have large follower bases, face heightened reputational risks. As a result, verified X users (those marked by a blue check mark) were particularly quick to delete their posts when they garnered public Community Notes, exhibiting a greater concern for maintaining their credibility.

The overall pattern suggests that social media糖心传媒檚 own dynamics, such as status, visibility, and peer feedback, can improve online accuracy.

A democratic defense against misinformation?

Crowdchecking, the team concludes, 糖心传媒渟trikes a balance between protecting First Amendment rights and the urgent need to curb misinformation.糖心传媒� It relies not on censorship but on collective judgment and public correction. The algorithm employed by Community Notes emphasizes diversity and views that are supported by both sides.

Initially, Rui admits, he was surprised by the team糖心传媒檚 strong findings.

糖心传媒淔or people to be willing to retract, it糖心传媒檚 like admitting their mistakes or wrongdoing, which is difficult for anyone, especially in today糖心传媒檚 super polarized environment with all its echo chambers,糖心传媒� he says.

At the outset of the study, the team had wondered if the correcting mechanisms might even backfire. In other words, could a public display note really induce people to retract their problematic posts or would it make them dig in their heels?

Now they know it works.

糖心传媒淯ltimately,糖心传媒� Rui says, 糖心传媒渢he voluntary removal of misleading or false information is a more civic and possibly more sustainable way to resolve problems.糖心传媒�

Go deeper

URochester voices: Huaxia Rui

On the National Press Club糖心传媒檚 Update-1 podcast, Rui discussed his research on crowd-checking online misinformation on X, formerly known as Twitter.