A
About
The Iffy Quotient is an open-access analytics and research tool developed by the University of Michigan's Center for Social Media Responsibility (CSMR). It measures the share of social media engagement—on Facebook and Twitter—that flows to news sites frequently associated with misinformation, referred to as 'Iffy' sites. The term 'Iffy' is intentionally lighthearted, acknowledging the inherent subjectivity in categorizing news sources. The tool's dataset begins in early 2016 and extends to the present, providing rich longitudinal context. Users can compare the Iffy Quotient across platforms, explore how specific events (such as the COVID-19 pandemic lockdowns or the January 6, 2021 Capitol riot) affected misinformation engagement, and examine how platform policy changes—such as content moderation actions—impacted the spread of unreliable news. The Deep Dive feature empowers users to conduct custom analyses, compare engagement between specific news sites, identify which misinformation sites gained or lost audience in a given period, and view the most popular content from both Iffy and credible news outlets. Data is sourced via NewsWhip queries. The Iffy Quotient is particularly valuable for academic researchers studying misinformation, investigative journalists, media literacy educators, and policymakers monitoring platform accountability. Its no-cost, browser-based design makes it accessible to a broad audience without requiring technical expertise.
Key Features
- Platform Comparison: Compare the Iffy Quotient between Facebook and Twitter to see how each platform performs in limiting misinformation engagement over time.
- News Event Impact Analysis: Examine how major news events—like COVID-19 lockdowns or political incidents—affected the share of engagement with Iffy news sites.
- Policy Change Evaluation: Assess the real-world effect of platform moderation decisions, such as account suspensions, on misinformation site engagement.
- Popular Content Explorer: View the most-shared stories from both Iffy and reputable news sites during any selected time period to understand what content was driving engagement.
- Site-Level Audience Tracking: Identify which specific Iffy news sites gained or lost the most audience on Facebook or Twitter within any given timeframe.
Use Cases
- Researchers studying the spread of misinformation on social media platforms over time.
- Journalists investigating whether platform moderation policies are effectively reducing engagement with unreliable news sources.
- Policymakers and advocacy groups monitoring platform accountability and the real-world impact of content moderation decisions.
- Media literacy educators illustrating how misinformation sites compete for audience attention alongside credible news outlets.
- Think tanks and nonprofits tracking which specific misinformation sites are gaining or losing influence during election cycles or major news events.
Pros
- Free and Publicly Accessible: Fully free to use with no registration required, making it accessible to researchers, journalists, and the general public alike.
- Long Historical Record: Data spanning from early 2016 to the present enables robust longitudinal analysis of misinformation trends across multiple major events.
- Interactive Visualizations: The Deep Dive feature lets users create custom charts and comparisons without needing data science or programming skills.
Cons
- Limited Platform Coverage: Currently tracks only Facebook and Twitter, excluding other major platforms like YouTube, TikTok, or Instagram where misinformation also spreads.
- Subjective Site Classification: The categorization of sites as 'Iffy' relies on imprecise criteria and human judgment, which may not be universally agreed upon.
- No Real-Time Data: The tool may have data latency and is not designed for real-time monitoring of breaking misinformation events.
Frequently Asked Questions
What does the Iffy Quotient measure?
The Iffy Quotient measures the share of total social media engagement—on Facebook and Twitter—that goes to news sites categorized as 'Iffy,' meaning they frequently publish misinformation. A lower Iffy Quotient is better, indicating less attention to unreliable sources.
How far back does the data go?
The Iffy Quotient's dataset begins in early 2016 and continues to the present day, allowing for long-term trend analysis across multiple major news and political events.
How is the Iffy Quotient calculated?
The team queries NewsWhip for engagement data on a defined list of Iffy news sites and calculates their share of total engagement for each platform and time period. The methodology acknowledges that site categorization involves imprecise criteria and human judgment.
Is the Iffy Quotient free to use?
Yes, the Iffy Quotient is a free, publicly accessible research tool developed by the University of Michigan's Center for Social Media Responsibility (CSMR). No login or subscription is required.
Can I create my own custom analyses?
Yes. The Deep Dive feature on the Iffy Quotient site allows users to build custom analyses and graphics, such as comparing engagement between specific news sites or examining the Iffy Quotient during a user-defined time window.
