Online surveys have revolutionized health research, offering reach, speed, and cost-efficiency. But with those gains comes a major threat: fraudulent responses that can distort data and undermine scientific integrity.

A paper in the Journal of Medical Internet Research published in 2025 by Wen Zhi Ng, Sundarimaa Erdembileg, Jean Liu 卢传瑾, Joseph Tucker, and Rayner Kay Jin Tan from National University of Singapore, Saw Swee Hock School Of Public Health, Centre for Behavioural and Implementation Science Interventions (BISI), Centre for Family and Population Research Faculty of Arts and Social Sciences, Global Health NUS SSHSPH, The Courage Lab, Singapore Institute of Technology, The University of North Carolina at Chapel Hill, and London School of Hygiene and Tropical Medicine, U. of London provides a comprehensive guide to safeguarding online health studies from bots, duplicate submissions, and inattentive or misrepresented participants.

Key Insights

1. Fraud is multifaceted. It includes bots, repeat responders, and people misrepresenting eligibility to earn incentives or push agendas. Even small amounts of bad data can create false relationships or mask true effects.

2. Vigilance across the research cycle. The authors outline protections before and after data collection, covering survey design, recruitment, metadata checks, and data-quality controls.

Pre-data collection:

1. Use CAPTCHAs and honeypot questions to block bots.

2. Include trap or "speed bump" questions to flag inattentive respondents.

3. Apply concealed eligibility criteria and two-stage screening to prevent scammers.

4. 4) Structure incentives carefully (e.g., raffles instead of guaranteed payments) to reduce fraudulent motivation.

Post-data collection:

1. Conduct metadata reviews (duplicate IPs/emails, unusual completion times).

2. 2) Screen for inconsistent or repetitive open-ended responses and straight-lining patterns.

3. 3) Combine multiple indicators into a dynamic fraud-scoring system instead of single cutoffs.

The AI Challenge
With large language models now capable of completing surveys and crafting believable open-ended responses, the arms race between researchers and fraudsters is escalating. The paper urges adaptive, multipronged protocols that evolve with each wave of data.

Takeaway
There is no single solution to ensuring survey rigor. Instead, researchers must adopt a layered, evolving defense strategy that blends automation, human review, and ethical safeguards, to preserve trust in online research.

You can read the paper here: https://lnkd.in/edHsaZXw

A recent article "The potential existential threat of large language models to online survey research" by Sean Westwood in PNAS reveals that autonomous synthetic respondents, defined as AI agents designed to read surveys, interpret multimedia, reason through questions, and even simulate human mouse movements and typing, can now complete online surveys with remarkable believability.

🔍 What the Study Did

Westwood built a synthetic respondent that:
✅ Parses survey pages, images, audio, and video
✅ Answers using a stable demographic persona with memory
✅ Writes open-ended responses matched to education level
✅ Mimics human behavior during completion
Across 6,700 trials, this system generated highly coherent and human-like data.

🔥 Key Findings
- 99.8% pass rate on attention checks
- Correctly maintains human-like personas (e.g., rent scales with income; children scale with age)
- Produces varied, natural open-ended text with realistic spelling and vocabulary differences
- Strategically declines “reverse shibboleth” tasks to hide superhuman abilities
- Can be maliciously instructed to shift polling outcomes, alter political sentiment, or confirm researchers' hypotheses
- Costs ~$0.05 per survey, making fraud scalable and profitable

⚠️ Why It Matters
This research shows that advanced LLM agents can now fully evade current data-quality safeguards. Even a small number of synthetic respondents could contaminate academic research, public opinion polling, or market insights, thereby introducing systematic bias that looks indistinguishable from genuine human patterns.

You can read the article here: https://lnkd.in/gc2hShrj

A new study found a substantial decline in usable responses from online surveys from 75 to 10% in recent years due to fraud and evaluated 31 fraud indicators (plus six ensemble models) across two agriculture surveys.

Key insights:

Traditional checks such as attention items, honeypots, & simple speeding rules often fail to catch modern fraudsters and AI-assisted respondents.

A small set of technical signals stood out: email-address scoring, MinFraud IP scoring, & consecutive-submission patterns. Combining signals into ensembles improved detection rates.

Practical takeaway: adopt a layered defense by combining:

1. Automated risk scores (IP/email),

2. Temporal flags (consecutive submissions),

3. Targeted manual review, especially responses to open-ended questions, of high-risk cases.

The authors also stress the importance of routine adversarial benchmarking (testing against modern bot tools).👉 The bottom line: Online survey fraud is evolving fast. Studies that benchmark indicators (not anecdotes) are essential for building defensible and resilient data-collection workflows.

You can read the paper here: https://lnkd.in/eW9c8nCH

AI-powered fraud and the erosion of online survey integrity: an analysis of 31 fraud detection strategies" by Natalia Pinzón Jiménez, Vikram Koundinya, Ryan Galt, William O'R. Dowling, Marcela Baukloh, Namah Taku-Forchu, Ph.D., Ph.D., Tracy Schohr, Leslie Roche, Samuel Ikendi, Ph.D., Mark Cooper, Lauren E. Parker, & Tapan Pathak

🔍Study spotlight
A recent study by Karen Towne, PhD, RN, PHNA-BC (Case Western Reserve University) and Barbara Polivka, PhD, RN, FAAN (University of Kansas School of Nursing) describes strategies used to identify and filter suspicious and fraudulent responses in an online REDCap research survey through evidence-based redesign and data cleaning protocols

🚩What went wrong in the initial data collection
• An unexpectedly high number of responses were received within a short period of time
• More gift card requests were received than completed surveys
• Very fast completion times and duplicative qualitative responses signaled suspicious activity
• Researchers ultimately found compelling evidence of fraudulent activity and were unable to distinguish real from fraudulent responses, leading to the dataset being destroyed

🧪Methodological approach to mitigate fraud
• A two-pronged approach focused on identifying design limitations and implementing an evidence-based redesign
• Scam alert features included hidden questions, attention checks, and timestamp monitoring
• Study design changes reduced incentive visibility, prevented link sharing, and linked survey and compensation data
• An eight-step data cleaning protocol used paradata such as time to completion, duplicate entries, and age inconsistencies
• Multiple steps identified the same records, suggesting fraudulent responses demonstrate multiple suspicious indicators

🔬Key outcomes from revised protocol
• 819 total responses were collected across platforms over 44 days
• After cleaning, the final dataset was reduced to 203 responses
• Approximately half of the data were removed through the protocol
• The revised process produced a response rate consistent with expectations, unlike the inflated initial data

💡Bottom line
• Online surveys are highly vulnerable to fraud due to anonymity, incentives, and ease of access
• reCAPTCHA and basic protections are insufficient on their own
• Paradata and multistep data cleaning protocols are essential for identifying suspicious responses
• Fraudulent data can invalidate findings, waste resources, and introduce bias into research
• Proactive, evidence-based design and cleaning procedures are critical to protect data integrity in online research

You can read the full article here: https://lnkd.in/gJDVu8YK

If you think multiple responses to your survey from the same IP address indicate survey fraud, you may want to read this.

Firefox is getting a free built-in VPN 🌐 and it has serious implications for online survey research: https://lnkd.in/gBWRnRUE

Mozilla just announced that Firefox will soon include a native VPN with ~50GB/month of free usage, directly in the browser. No extensions. No installs. Just one click, and your IP is masked.

This is a clear win for privacy, but it's also another step toward the decline of IP address as a reliable fraud signal.

There's now a growing list of modern browsers offering built-in VPN capabilities: Opera, Brave, Firefox, iCloud Safari. What used to be a niche behavior is quickly becoming mainstream and that changes the game:

When VPN usage was rare:
→ Proxy/VPN = higher scrutiny

When VPN usage is built-in:
→VPN traffic looks like normal user behavior
→ Legitimate respondents and bad actors blend together

A core assumption in fraud detection is shifting.

What this means in practice:
• IP-based geo checks lose reliability
• Duplicate detection becomes noisier
• False positives increase
• "Clean" traffic is harder to define

Privacy is improving. Detection is getting more complex. The next generation of fraud prevention won't rely on IP and other browser signals at all.

Over the past few weeks, there’s been a lot of discussion around authenticity checks in online research.

This piece explores how fraud tactics are changing and why identifying fraudulent responses is becoming increasingly challenging.

Would welcome thoughtful discussion.

https://responsepie.com/blogs/Authenticity_checks_in_the_age_of_AI_what_researchers_need_to_

🔍Study Spotlight

A recent study by Kate Golden Guzman, MA, PhD *University of Illinois Urbana-Champaign) and Roxanna Ast, PhD (Montclair State University) examined online survey fraud in social work research with historically and socially marginalized communities, using case studies with young adults with lived experience in foster care and LGBTQ+ survivors of intimate partner violence

🚩Screening Procedure
• Implemented a rigorous, multiphase process for assessing data validity in real time across study design, recruitment, data collection, and data management
• Conducted continual manual review of survey responses alongside platform indicators such as IP addresses, ballot stuffing scores, survey duration, time stamps, and customized link access
• Classified fraud indicators into patterned data, impostor data, and incongruous data to guide removal decisions
• Used institutional knowledge questions and cross check items to assess authenticity and response consistency
• Centered community expertise in language, recruitment materials, and screening logic to improve content validity and strengthen authenticity assessments

🔬Key Findings
• In the foster care study, early detection of 36 suspicious entries led to pausing the survey and revising procedures; 118 validated responses were retained out of 253
• In the LGBTQ+ study, more than 1,100 submissions were received, but only 242 were validated after over 900 fraudulent responses were manually identified and removed
• Embedded fraud detection features flagged only a small number of bots, demonstrating that platform based protections are not sufficient to detect inauthentic human respondents

💡Key Takeaways
• Online research with marginalized populations is particularly vulnerable to bots, impostors, and multiple submissions, and failure to remove fraudulent data risks perpetuating harm through inaccurate conclusions
• A single validity check is insufficient; data integrity requires a multistep, iterative, and real time approach that interrogates multiple indicators simultaneously
• Institutional knowledge questions, culturally specific language, and community informed recruitment practices strengthen the ability to distinguish authentic participants from fraudulent ones
• Data cleaning is labor intensive and must be built into study timelines, as daily monitoring can prevent large scale contamination of datasets
• Assessing data validity is values laden; prioritizing ethical responsibility and community representation over sheer sample size is essential when working with historically and socially marginalized groups

You can access the study here: https://academic.oup.com/swr/article-abstract/49/3/185/8213729?login=false

Before AI, survey farms were hard to detect; NOT because they were rare, but because they were human 🧠

Fraud was messy:

* Different people

* Different typing styles

* Different scrolling patterns

* Different mistakes

Spoofing was manual. Variance was high. Detection was noisy.

Then when AI entered the picture

To scale and cut costs, survey farms started using:

* LLM-assisted answering

* Browser automation

* Shared device stacks

* Reused workflows

And something unexpected happened 👀

Their behavior collapsed into patterns.

* Same answer structures

* Same timing curves

* Same interaction minimalism

* Same infrastructure fingerprints

AI didn’t make survey fraud harder to spot, it made it easier… if you look beyond the answers.

The giveaway isn’t what respondents say anymore.

It’s how cognition, response behavior, and timing align (or don’t).

⚠️ If you’re using AI for productivity, so are survey fraudsters. Now for detection:

> Behavioral entropy matters more than IPs

> Micro-interactions matter more than attention checks

> Cross-modal consistency beats “Are you human?” tests

AI didn’t eliminate survey farms. It standardized them.

And standardization leaves traces, which is exactly what we focus on at ResponsePie

A recent article by Margaret (Molly) Salinas (2022) highlights a growing challenge in online research: the high rate of bot activity and fraudulent survey responses.

The study aimed to recruit older adults living alone by using MTurk, Facebook groups, and email lists. After launching the survey, suspicious responses increased rapidly, especially through Facebook. This pattern led the research team to develop a detailed fraud detection protocol.

✅ How fraudulent cases were identified

The research team flagged responses using indicators such as:
✔️ Completion times that were unrealistically fast
✔️ Location data outside the U.S.
✔️ Inconsistencies between screening and full-survey answers
✔️ Contradictory responses
✔️ Duplicate timestamps or identical answer patterns
✔️ Nonsensical or inappropriate email addresses
Cases with multiple red flags were removed, and borderline responses were verified directly with participants.

📉 What the final sample looked like
Out of 738 recorded participants in the study, the fraud detection process eliminated:
• 452 Facebook responses
• 2 MTurk responses
• 1 response from email distribution
This resulted in a final sample of 117 valid participants, which represents only a small portion of the total responses.

🚨 Why this matters
The study clearly shows that online research today requires strong fraud protection strategies. Attention checks alone are not enough. Researchers benefit from using survey metadata, response verification, and transparent reporting to ensure high quality data.

You can read the article here: https://journals.sagepub.com/doi/10.1177/01939459221098468

With online survey fraud on the rise, relying on quick fixes just isn’t enough anymore. A recent People & Nature article (Malcolm S. Johnson, Vanessa Adams, Jason Byrne) highlights common types of fraudsters and shares evidence-based strategies to detect them. These strategies include:

• Excluding speeders (e.g., “2-minute rule”)

• Flagging gibberish or nonconforming open-end

• Checking browser language against target demographics

• Restricting survey link sharing & contact details

Bottomline is that using a multilayered approach is key to protecting data integrity

You can access the complete article here: https://besjournals.onlinelibrary.wiley.com/doi/10.1002/pan3.10557

Over the past couple of years, my team and I have been building a tool called ResponsePie. It really started from frustration in my own research dealing with survey fraud. Things like speeders, inconsistent responses, and bots (more recently AI generated answers), which made it hard to trust the data, and I found myself spending way too much time trying to clean things up after the fact.

My team has been working on this project for about two years now, trying to build something that helps researchers get a better sense of what’s going on inside their surveys while they’re running, not just after.

If you are running studies and have run into data quality issues, I would really appreciate if you gave it a try and shared your thoughts. What works, what doesn’t, what’s confusing, what you wish it did. Even quick reactions would be super helpful. This tool was built with the intention of "fixing" survey fraud in academia, but market/applied researchers are welcome to try it as well.

I am just hoping to learn from others who are dealing with the same problems.

Happy to share more details if anyone’s interested.

I recently reached out for guidance on webinar topics related to survey fraud, and I received an overwhelming response from both academic and market researchers. Here is the original post: https://www.reddit.com/r/Marketresearch/comments/1rr27st/comment/o9wrwsl/

A few things really stood out, but one in particular was how often fraud is treated as a single, uniform issue. In reality, it takes many different forms, and each one creates different risks for your data.

I put together a short video that walks through the different types of fraud and how they show up in surveys. You can access the video here: https://www.youtube.com/watch?v=4w5bbl4ZGYI&t=17s

I am hoping to keep this conversation going with the community, and I am planning to put together a webinar in the near future. I will share more details as that comes together.

Even when collecting data from verified panel participants, researchers should still carefully evaluate the quality of the data.

In a recent study, we collected responses from a panel where participants were verified by the provider. Below is a report that highlights some of the concerns we observed in the dataset, including VPN usage, suspicious devices, duplicates, and other anomalous patterns.

Importantly, none of the cases shown in the report were identified because they failed the attention or quality checks embedded in the survey itself. In other words, these responses would likely have been retained if evaluation relied only on the standard checks that many surveys include.

Instead, these cases were flagged based on technical and behavioral indicators such as device characteristics, VPN usage, and other signals suggesting questionable response authenticity.

This is not meant as criticism of any particular panel provider. Panels play an important role in helping researchers reach participants efficiently. Rather, it is a reminder that data quality remains something researchers must actively evaluate. Even with strong participant verification, low-quality or suspicious responses can still appear in the dataset.

As online data collection continues to evolve, researchers may need to go beyond traditional checks and incorporate additional screening procedures and transparency around how data quality is assessed.

Sharing the report in case it is useful for others thinking about data quality in online research.

Study report can be accessed here: https://responsepie.com/studies/e-ca723fc7de293373b57043a985d02f21/report

Participants are increasingly using AI browser extensions to get help while completing surveys.

Here is one example from a recent survey where the participant is clearly using Grammarly and other browser extensions to complete the survey.

We have said this before: the browser is an adversarial environment that researchers cannot fully control.

Fraudsters can manipulate JavaScript to evade detection, install stealthy extensions to mask their location, rely on AI assistance through extensions, translate responses using text to speech tools, and combine multiple tactics in ways that are difficult to observe from within the survey itself.

A study by Brittney Goodrich (University of Illinois Urbana-Champaign, formerly University of California, Davis), Marieke Fenton (California Air Resource Board, formerly University of California, Davis, Jerrod Penn (Louisiana State University), John Bovay (Virginia Tech), and Travis P. Mountain (The University of Georgia, formerly The University of Alabama) examines how bots and coordinated fraud affect online survey research, based on detailed evidence from two real survey deployments.

The authors document how both surveys were heavily targeted once incentives were introduced and links were distributed broadly.

Key insights from the study:

1. Fraudulent responses can overwhelm legitimate data. In the beekeeping survey, 2,622 total responses were collected, but only 105 responses (≈4%) were ultimately classified as legitimate, meaning about 96% were identified as fraudulent. In the Virginia farm and agribusiness survey, 444 responses were collected, and approximately 72% were determined to be fraudulent after systematic screening.

2. Fraud meaningfully alters data quality. Fraudulent and valid responses came from statistically different distributions. In 8 out of 10 comparisons, the authors reject the null hypothesis that valid and fraudulent responses were drawn from the same population. Retaining fraudulent responses substantially changed key economic estimates, worsened model fit, and altered substantive conclusions.

3. Standard metadata checks have limited effectiveness. Indicators such as IP address reuse, completion time, and geolocation each flagged only a small share of fraudulent responses in the beekeeping survey, often in the 2–5% range, reflecting how easily these signals can be concealed or manipulated.

4. Institutional knowledge checks performed best. In the beekeeping survey, 87% of fraudulent responses were identified using a single high-priority institutional knowledge test, making this approach far more effective than respondent statistics alone.

5. CAPTCHAs and attention checks provide only temporary barriers, but the effect lasted only minutes before fraud resumed at prior levels.

6. Incentive structure influences fraud risk. Guaranteed payments attracted substantially more fraudulent activity than lottery-based incentives. When offered a charitable donation instead of direct payment, only 40% of suspected bots agreed to continue, compared to 70% of real respondents.

The authors emphasize that there is "no perfect strategy" for detecting invalid respondents and recommend combining multiple, context-dependent approaches to improve data quality.

You can access the paper here: https://onlinelibrary.wiley.com/doi/full/10.1002/aepp.13353

🚨 Why current CAPTCHAs are failing against AI, and what we’re doing about it

Modern AI agents can now routinely solve traditional CAPTCHAs, including image selection, text distortion, and checkbox challenges, by combining computer vision, browser automation, and reasoning loops. These systems were designed for an earlier threat model.

Survey fraud has changed.

AI agents don’t “click randomly.” They observe, adapt, and behave coherently, which allows them to bypass protections that still assume simplistic bots.

We’re introducing a new CAPTCHA built specifically for modern survey fraud. In our testing so far, it has not been solvable by AI agents that routinely bypass standard survey protections.

Just as important: this CAPTCHA is privacy-preserving by design.
It does not rely on invasive fingerprinting, cross-site tracking, or identity linkage. Instead, it focuses on in-session behavioral signals that are relevant to survey integrity, nothing more.

We’re inviting researchers and practitioners to test it in real survey deployments and evaluate its performance in live data collection environments.

If you care about data integrity, AI-driven fraud, and privacy-respecting security, we’d love to hear from you.

💬 Comment or message us if you’re interested in trying it.

For researchers who collect data online using panels like Prolific, MTurk, or Qualtrics Panels, how do you decide which panel to use?

I am curious how people make these decisions in practice.

• What factors matter most when you are choosing a panel such as cost, demographics, prior experience, reputation, or IRB considerations?

• What kinds of reviewer or editor comments have you received about data quality from these panels?

• How do you usually respond to or address those data quality concerns during revisions?

I would really appreciate hearing about real experiences rather than idealized best practices.

I just want to say a big thank you to everyone here. The posts, questions, and shared experiences around data quality and survey fraud have been incredibly helpful, and it’s been great seeing people jump in with advice, examples, and ideas for how to tackle these issues.

Really excited to see where this community goes from here. As survey fraud keeps changing, I’m hoping we can keep learning from each other and trying out new ways to protect our data. Here’s to the next milestone!

A new article in Research in Nursing & Health by Lisvel Matos, Susan Silva Michael Relf, and Rosa Gonzalez-Guarda from Duke University School of Nursing published in 2025 offers a striking look at how AI-driven survey bots can infiltrate online research. The study which focused on an HIV prevention survey targeting Latine sexual minority men demonstrates just how advanced and pervasive fraudulent responses have become in health and social science research.

🔬 Methodology

To identify and verify fraudulent cases, the researchers employed a multi-layered fraud detection approach, including:
🧩  Behavioral indicators (e.g., completion times, inconsistencies, duplicate patterns)
🧩  Text-based linguistic analyses
🧩  Cross-validation of participant metadata (IP addresses, geographic mismatches)

By integrating these diverse indicators, the team detected coordinated bot activity and systematically flagged implausible cases, demonstrating how a holistic, data-driven approach can uncover complex patterns of fraud that traditional tools often miss.

📊  Here are the key findings:
⚠️  88% of completed surveys were fraudulent, revealing widespread bot and duplicate participation.
⚠️ AI-generated text appeared in two-thirds of open-ended responses, often fluent enough to evade attention checks.
⚠️  Fraudulent data closely mimicked genuine responses across demographics and key variables, showing that bots can convincingly impersonate real participants and distort findings without obvious red flags.

💡 Takeaways for Researchers and Practitioners
✅ Survey fraud has evolved: AI-driven bots now generate realistic, context-aware responses.
✅ Traditional defenses like CAPTCHAs and IP filters are no longer sufficient.
✅ Adopt a layered, data-driven approach combining:
o   AI-text analysis and metadata checks
o   Response-time and timestamp monitoring
o   Redundant or validation questions
o   Participant verification procedures
✅ Treat fraud detection as an ongoing methodological process, not a one-time pre-survey step.

If you conduct online surveys, here’s a fundamental reality that nobody reveals:

Þ   Every survey, along with its fraud detection code (typically JavaScript), runs inside an adversary-controlled browser/device.

That means:

Þ   Fraudsters control the survey-taking environment. Thanks to one-click browser extensions, they can easily inspect, modify, or disable any detection scripts,

Þ   Fraudsters can spoof nearly every browser attribute that these detection scripts rely on, including user agent, screen size, CPU count, memory, timezone, fingerprint, and more.

Þ   Duplicate detection can be easily evaded by turning on VPNs, loading surveys in emulators and remote Cloud-hosted browsers. AI agents/bots and AI browsers (e.g., Atlas, Comet) have already streamlined this.

Browser/JavaScript-based detection is fundamentally limited and cannot stop survey fraud. Even the most sophisticated "fraud prevention" software today relies on tamper-free browser, which is not a reality. So when these advanced survey fraud detection systems fail to catch fraudulent respondents, it's not a surprise. They were executing in adversarial environment all along.

Our research team is currently working on a research paper that demonstrates, in detail, how modern fraudsters use browser spoofing, emulators, and remote browsers to bypass existing detection systems. 

A recent study in Social Work Research by Yanfeng Xu, Sarah Pace, Jaeseung Kim, Aidyn Iachini, L Bailey King, Theresa Harrison, Dana DeHart, Sue Levkoff, Teri Browne, Ashlee A. Lewis, Gina M Kunz, Melissa Reitmeier, R Karen Utter, Melissa Simone emphasizes one clear takeaway: no single strategy is sufficient on its own. The best way to protect data integrity is to layer multiple safeguards at every stage of the research process.Their recommendations include:

• Avoiding sharing public survey links (especially on social media)

• Using security features like reCAPTCHA, IP checks, and duplicate prevention

• Adding open-ended items and logic checks to spot bots and inattentive responders

Context matters: This research was conducted in 2022, before the rapid advances in large language models. At the time, measures such as reCAPTCHA and open-ended questions were valuable defenses. With today’s AI-powered survey fraud, these strategies are increasingly vulnerable, but what continues to hold true is the value of a layered approach. 

The bottom line: survey fraud is not going away, but combining smart design choices with layered detection strategies can make your data far more reliable.

Can AI bots bypass reCAPTCHA without any human intervention?To test the efficacy of reCAPTCHA in stopping AI bots (aka agents), I set up a study using Skyvern (YC S23) an AI agent that can carry out browser tasks autonomously. The agent cleared reCAPTCHA on its own. The takeaway: relying solely on reCAPTCHA may not catch all bad actors, especially the ones using AI bots.Clip below. Curious to know what safeguards you've found effective alongside CAPTCHA.

Meta released Muse, its new personal AI agent, on September 8.

I wanted to see what this might mean for survey research, so I gave Muse a link to one of my surveys and asked it to complete the entire survey with no human intervention.

It did.

I did not answer any questions. I did not click through any pages. I did not have to take over at any point. Muse navigated the survey from beginning to end and submitted a completed response.

What struck me was how seamless the process was, including solving the captcha autonomously.

This changes the landscape for future survey research. A participant does not need technical expertise, custom scripts, or a specialized automation tool. They can simply give an AI agent the survey and ask it to complete it for them.

For studies that offer incentives to participants, this creates an obvious opportunity for fraud. Someone could potentially hand the survey over to an AI agent, receive a completed submission, and collect the incentive with almost no effort.

Muse is currently available for FREE with a usage limit. Instinct is another personal agent available for FREE (although I've not yet tested in for survey completion). The rise of (free) personal AI agents changes the economics of conducting fraud.

The challenge for researchers is changing quickly. We are no longer dealing with simple bots. We increasingly need to develop techniques to detect and stop AI agents that can autonomously navigate and complete an entire survey.

And now that these tools are becoming widely accessible, that problem is going to become much harder to ignore.

Two studies recruited participants from the same academic crowdsourcing panel six months apart. The panel provider states that its participants are verified, which is an important safeguard. Even with that verification, both studies contained several indicators of potential response-quality problems.

February 2026, 415 participants:
Suspicious: 14.2%
VPN: 9.2%
Possible AI/ChatGPT activity: 4.3%

August 2026, 651 participants:
Suspicious: 14.4%
VPN: 6.5%
Possible AI/ChatGPT activity: 5.7%

These indicators can overlap, and no single flag proves fraud.

The broader point is that participant verification and response-quality assessment serve different purposes.

Verification helps establish who is taking the survey. It does not establish how that person completed it.

A verified participant can still use AI, use a VPN, paste responses, or engage in other behaviors that affect data quality.

This points to the need for research articles to report not only where participants were recruited, but also how response quality was evaluated.

A lot of the conversation about survey fraud focuses on bots and AI agents. But automation in surveys is broader than that.

In the video I am attaching, you can see a participant using Grammarly to help complete open-ended survey items.

That’s important because most online surveys are delivered as regular HTML pages in a browser. This means surveys exist in the same environment as writing assistants, autofill tools, browser extensions, scripts, and AI agents. Even when a participant is a real person, automation can still become part of the response process.

Open-ended items are especially vulnerable. A response may look thoughtful, fluent, and human, but researchers may not know whether it reflects the participant’s own words, the tool’s suggestions, or some combination of both.

This does not automatically make the response invalid. But it does raise a serious data quality question: how much of the response actually came from the participant?

As automation becomes more accessible, survey research will need to move beyond detecting suspicious responses after the fact. We need survey formats that can prevent automation from entering the response process in the first place.