On X, contributors manage roughly 250 public community notes per day — a number that has taken a sharp dive since X tweaked the algorithm to make it more difficult for notes to appear.
As for speed, research has found that some community notes do indeed appear quickly, but not quickly enough to curb the reach of harmful misinformation.
LaForme: Crowdsourcing, in my experience, is a wild ride. You can get some really great, unexpected stuff, but you’re often dealing with piles and piles of chaff. Are there examples of community notes going very right — or very wrong?
Mahadevan: I am glad you asked this, because I don’t want to turn this into a community notes roast. I love the idea of crowdsourced fact-checking. And research has shown that people trust community fact checks more than the pros.
On X, Community Notes contributors are good at quickly flagging misleading advertisements and AI-generated slop. There is lots of agreement on those items, so notes appear quickly — faster than a professional fact-checker could manage, I’ll admit. I have seen lots of fake disaster footage debunked quickly.
But, when it comes to harmful misinformation, community notes fall short. The most prominent sharers of misinformation on X are also the most polarizing. That means it’s nearly impossible to get a community fact check appended to a post from someone like Musk.
Back to the positives: X’s Community Notes is radically transparent. The algorithm and data on every note and rating are available to download. That’s what drew me to the system in the first place. I was sitting in a coffee shop, messing around with Birdwatch data.
I’m always impressed with how quickly the team behind Community Notes responds to user feedback. They’ve pushed a lot of meaningful changes to the system over the last few years. So I hate ragging on them. To be clear, Community Notes is a brilliant system if it existed within a true trust and safety program.
And the bridging algorithm — the thing that requires consensus from all sides — would also be a great replacement for the newsfeed or “for you” tab. I'd love to see Meta and X put their money where their mouths are: If the bridging algorithms are so awesome, use them — instead of the polarizing, engagement-focused ones they have now.
LaForme: Could professional and crowdsourced fact-checking coexist in a meaningful way? Could TikTok's plan prove it? Or is that just lip service?
Mahadevan: Absolutely. That was how Birdwatch was supposed to work, according to Yoel Roth, former head of trust and safety for then-Twitter.
And if TikTok honors its commitment to keep professional fact-checkers engaged on the platform, Footnotes can prove to be the best model for crowdsourced fact-checking.
In the ideal world, fact-checkers can debunk the most harmful and viral misinformation, especially around complex political topics. Footnotes contributors can add context to everything else.
I don’t know whether professional fact-checkers will have any involvement in the Footnotes system, but ideally they could serve as a backstop when a note gets lots of upvotes but not enough consensus to appear on TikTok.
Also, on X and Meta, note quality and accuracy seem to be based on how many “helpful” votes they get. Professional fact-checkers could fill in the gap by regularly auditing notes to check source quality and accuracy.
LaForme: Do you think we’ll look back on this moment as a turning point in how we understand truth online?
Mahadevan: Yes. The tools to deceive people are cheaper and more powerful — think about generative AI slop — the rewards for deception are higher than ever — think about all that engagement farming on every platform — and the guardrails against online deception are much lower than they’ve been in years.
Platforms, with the rollout of community notes, are telling users: “Hey, it’s a hostile digital world out there, and you’re on your own.”
Part of me worries that trust in legitimate journalists and fact-checkers will continue to decline as people embrace community notes. But, then I remember: The highest-rated notes I see have links to the Associated Press, Reuters, PolitiFact, the BBC. Fact-checkers are among the top sources for community notes on X.
The platforms may think they’re leaving fact-checkers and newsrooms behind, but the users are telling a different story. The platforms need us.
Corso to retire from ‘GameDay’