---
"title": "Appendix B: Additional tables"
"description": "### Different models get different questions correct"
"date": "2026-09-30"
"authors":
  -
    "name": "Athena Chapekis"
    "job_title": "Computational Social Scientist"
    "link": "https://alpha.pewresearch.org/pewresearch-org/staff/athena-chapekis/"
  -
    "name": "Arnold Lau"
    "job_title": "Research Methodologist"
    "link": "https://alpha.pewresearch.org/pewresearch-org/staff/arnold-lau/"
  -
    "name": "Samuel Bestvater"
    "job_title": "Associate Director, Data Labs"
    "link": "https://alpha.pewresearch.org/pewresearch-org/staff/samuel-bestvater/"
  -
    "name": "Sono Shah"
    "job_title": "Former Associate Director, Research"
    "link": "https://alpha.pewresearch.org/pewresearch-org/staff/sono-shah/"
  -
    "name": "Andrew Mercer"
    "job_title": "Principal Methodologist"
    "link": "https://alpha.pewresearch.org/pewresearch-org/staff/andrew-mercer/"
  -
    "name": "Aaron Smith"
    "job_title": "Director, Data Labs"
    "link": "https://alpha.pewresearch.org/pewresearch-org/staff/aaron-smith/"
"url": "https://alpha.pewresearch.org/pewresearch-org/data-labs/2026/09/30/appendix-b-additional-tables-6/"
"categories":
  - "Artificial Intelligence"
  - "Methodological Research"
  - "Uncategorized"
---

# Appendix B: Additional tables

### Different models get different questions correct

*Questions where each synthetic sample achieved a question-level average absolute error of 5.0 percentage points or less, when compared with real ATP data*

| Independent variable | n1 | n2 |
| --- | --- | --- |
| Germany | 40 | 60 |
| Spain | 50 | 50 |
| France | 60 | 40 |

Note: Refer to the Wave 185 questionnaire for full question wording.Source: Survey of U.S. adults and “digital twins” synthetic analysis using models set to low reasoning with extended profile information and expert reflection. Survey was conducted Jan. 20-26, 2026 (replicated March 2-3 with OpenAI GPT-5.1; and replicated March 9-12 and April 7-10 with Claude Opus 4.6).

“Can AI Stand In for Human Survey-Takers? Not Really”

---

**Next:** [Appendix C: Full list of variables in profile information](https://alpha.pewresearch.org/pewresearch-org/data-labs/2026/09/30/appendix-c-full-list-of-variables-in-profile-information/markdown)