---
"title": "Appendix E: Validation of GPT-4 topic classification"
"description": "For our latest survey data about news influencers, read the “News Influencers Fact Sheet.”"
"date": "2024-11-18"
"authors":
  -
    "name": "Galen Stocking"
    "job_title": "Associate Director, Research"
    "link": "https://alpha.pewresearch.org/pewresearch-org/staff/galen-stocking/"
  -
    "name": "Luxuan Wang"
    "job_title": "Research Associate"
    "link": "https://alpha.pewresearch.org/pewresearch-org/staff/luxuan-wang/"
  -
    "name": "Michael Lipka"
    "job_title": "Associate Director, Research"
    "link": "https://alpha.pewresearch.org/pewresearch-org/staff/michael-lipka/"
  -
    "name": "Katerina Eva Matsa"
    "job_title": "Director, News and Information Research"
    "link": "https://alpha.pewresearch.org/pewresearch-org/staff/katerina-eva-matsa/"
  -
    "name": "Regina Widjaya"
    "job_title": "Computational Social Scientist"
    "link": "https://alpha.pewresearch.org/pewresearch-org/staff/regina-widjaya/"
  -
    "name": "Emily Tomasik"
    "job_title": "Research Analyst"
    "link": "https://alpha.pewresearch.org/pewresearch-org/staff/emily-tomasik/"
  -
    "name": "Jacob Liedke"
    "job_title": "Former Research Analyst"
    "link": "https://alpha.pewresearch.org/pewresearch-org/staff/jacob-liedke/"
"url": "https://alpha.pewresearch.org/pewresearch-org/journalism/2024/11/18/appendix-e-validation-of-gpt-4-topic-classification/"
"categories":
  - "Influencers"
  - "Media Industry"
  - "News Influencers"
  - "Politics & Media"
  - "Politics Online"
  - "Social Media"
  - "Social Media & the News"
"datasets":
  -
    "name": "American Trends Panel Wave 150"
    "url": "https://alpha.pewresearch.org/pewresearch-org/dataset/american-trends-panel-wave-150/"
---

# Appendix E: Validation of GPT-4 topic classification

*For our latest survey data about news influencers, [read the “News Influencers Fact Sheet.”](https://alpha.pewresearch.org/pewresearch-org/journalism/fact-sheet/news-influencers-fact-sheet/)*

[![Table showing topic labeling accuracy metrics](https://alpha.pewresearch.org/pewresearch-org/wp-content/uploads/sites/20/2024/11/PJ_2024.11.18_news-influencers_E-01.png?w=310)](https://alpha.pewresearch.org/pewresearch-org/journalism/2024/11/18/appendix-e-validation-of-gpt-4-topic-classification/pj_2024-11-18_news-influencers_e-01/)

[![Table showing subtopic labeling accuracy metrics](https://alpha.pewresearch.org/pewresearch-org/wp-content/uploads/sites/20/2024/11/PJ_2024.11.18_news-influencers_E-02.png?w=410){.aligncenter width=400}](https://alpha.pewresearch.org/pewresearch-org/?attachment_id=191823)