{"id":11323,"date":"2018-02-15T10:04:36","date_gmt":"2018-02-15T15:04:36","guid":{"rendered":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/short-reads\/%year%\/%monthnum%\/%day%\/voter-files-study-qa\/"},"modified":"2024-04-14T03:15:16","modified_gmt":"2024-04-14T08:15:16","slug":"voter-files-study-qa","status":"publish","type":"short-read","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/short-reads\/2018\/02\/15\/voter-files-study-qa\/","title":{"rendered":"Q&A: The growing use of \u2018voter files\u2019 in studying the U.S. electorate"},"content":{"rendered":"
\"After<\/a><\/p>\n

\"(Saul<\/a>
(Saul Gravy\/Getty Images)<\/figcaption><\/figure><\/figure>\n\n

Since the rise of modern survey research three-quarters of a century ago, much of what we know about voter attitudes has been based on interviews with random samples of voters, sometimes combined with tallies of actual votes and the characteristics of voters in particular locations. But relatively new technologies and public policy changes have given pollsters, academics and other researchers \u2013 not to mention candidates and political professionals \u2013 a potentially powerful new tool for probing the electorate: digital databases that claim to cover most of the U.S. adult population.<\/p>\n\n

Despite their widespread use, these national databases (commonly called \u201cvoter files\u201d) are little known by the general public and haven\u2019t received much scholarly attention. Pew Research Center\u2019s Ruth Igielnik, a research associate, and Senior Survey Advisor Scott Keeter recently released an extensive study<\/a> of the completeness and accuracy of commercially available voter files, which they assessed by matching participants from the Center\u2019s nationally representative American Trends Panel<\/a> to five different voter files. We asked Keeter and Igielnik to talk about their work, including how voter files are built and what they\u2019re used for. Their replies have been edited for clarity and concision.<\/p>\n\n

What is a \u201cvoter file\u201d anyway? Isn\u2019t voting information private?<\/strong><\/p>\n\n

\"After<\/a><\/p>\n

\"Ruth<\/a>
Ruth Igielnik, Pew Research Center research associate<\/figcaption><\/figure><\/figure>\n\n

Good question! These digital databases \u2013 commonly known as \u201cvoter files\u201d \u2013 are built by commercial organizations using official, publicly available government records of who is registered to vote and who cast ballots in past elections. They not only give a nationwide picture of voter registration and election turnout, but also usually include information from outside data sources (such as consumer data vendors, credit bureaus and political organizations) and are marketed as providing a rich and comprehensive record for nearly every American adult.<\/p>\n\n

However, while information on the voter file record indicates whether<\/em> or not<\/em> someone voted in a given election, it does not indicate whom<\/em> they voted for. That stays with you in the voting booth.<\/p>\n\n

Who uses these voter files, and how?<\/strong><\/p>\n\n

\"After<\/a><\/p>\n

\"Scott<\/a>
Scott Keeter, Pew Research Center senior survey advisor<\/figcaption><\/figure><\/figure>\n\n

Beyond campaigns, voter files are used by pollsters, academic researchers and journalists who want to better understand Americans and answer specific questions about voters and elections. Some useful applications of voter files include the demographic composition<\/a> of the electorate, what kinds of voters tend to vote early or by absentee ballot<\/a>, who votes in primary elections<\/a> and what kinds of people are habitual vs. episodic voters<\/a>.<\/p>\n\n

Why did you decide that now was a good time to evaluate the quality of voter files, as opposed to, say, five or 10 years ago?<\/strong><\/p>\n\n

While campaigns have been using these databases for years, the recent rise in use by academics, researchers and journalists drew our attention to voter files as another potential tool in understanding the U.S. electorate. Research on voter files also fits into the Center\u2019s broader agenda to study new polling methodologies. Pollsters are increasingly using voter files as a potential sampling source for surveys, and in the future we plan to study the files\u2019 usefulness for this purpose.<\/p>\n\n

You said earlier that voter files are built by commercial organizations. Do results differ much between these vendors, given that they all get their basic data from the same official sources?<\/strong><\/p>\n\n

It\u2019s true that official election records about registration and turnout don\u2019t vary much. What does differ is what other information gets added to the files, such as turnout in past elections and other addresses \u2013 or, in the case of our study, who gets matched from our American Trends Panel survey data. While commercial voter file companies, or vendors, all get their data from official government records, how they gather and match those records and what additional information they provide about people make up the \u201csecret sauce\u201d that distinguishes them from each other.<\/p>\n\n

First, vendors vary in how they track Americans as they move across states. Although federal law (the Help America Vote Act of 2002<\/a>) requires each state to keep an individual list of its voters, the administration of elections in the U.S. historically has been highly decentralized, so harmonizing state records can be challenging. According to June 2017 data from our American Trends Panel, 16% of Americans said they had lived at their current address for less than one year. Those people become even harder to find if they\u2019ve changed their name or moved often.<\/p>\n\n

Then there\u2019s the additional analysis vendors provide. Commercial voter files typically offer scores for things like partisanship and expected turnout for future elections. These scores are generated through a process known as predictive modeling, and they vary in their availability and accuracy. For example, on the whole, models provided by the vendors in this study were better at predicting someone\u2019s party affiliation and race than their education or income.<\/p>\n\n

How did you choose which voter file vendors to use for this study?<\/strong><\/p>\n\n

The vendors used in this study represent five of the most prominent and commonly used voter files. The vendors included ones that were traditionally nonpartisan, as well as those whose clients were mainly Democratic and politically progressive or Republican and politically conservative.<\/p>\n\n

The purpose of the study, though, wasn\u2019t to focus on individual vendors or single out specific vendors as particularly good or bad. We wanted to look at a representative sample of the major commercial voter files so we could get a sense of their strengths and weaknesses with regard to supplementing existing survey data or serving as sampling frames for new public opinion surveys. Because of that, we anonymized the files and left the vendor names out of this analysis.<\/p>\n\n

How much did the completeness and accuracy of the five voter files you studied vary?<\/strong><\/p>\n\n

A lot, depending on what you were measuring. For example, the vendors were all relatively accurate (and similar) in how well they predicted someone\u2019s party affiliation. On average, they were accurate 67% of the time, and all of the files did a better job at correctly identifying Democrats than Republicans. By contrast, the files varied widely in terms of accurately classifying respondents\u2019 education \u2013 they ranged from 27% correct to 66% correct depending on the file, and some files were missing education entirely.<\/p>\n\n

You compared what was in the voter files with data from Pew Research Center\u2019s American Trends Panel. What finding struck you the most?<\/strong><\/p>\n\n

The relatively high quality of many of the modeled variables produced by the vendors was an important finding. For example, prior to the 2016 general election, each vendor provided a measure of turnout likelihood in the election. Applying these measures improved the accuracy of the American Trends Panel\u2019s estimate of voter preferences in the presidential race. The estimate narrowed Hillary Clinton\u2019s advantage from 7 percentage points among all registered voters to a range of 3 to 5 points among likely voters, using the modeled turnout scores. On Election Day, Clinton ended up with a 2-point advantage over Donald Trump in the popular vote. Past voter history is a key component of these models, but the exact algorithms the vendors use aren\u2019t public.<\/p>\n\n

Similarly, the vendors\u2019 models for predicting someone\u2019s partisanship and race were pretty accurate. On average across the five files, modeled<\/em> party affiliation matched self-reported<\/em> party affiliation for about two-thirds of panelists (67%). And 79% of the time, on average, the models available in the voter files accurately predicted the race of our respondents.<\/p>\n\n

You found that the five voter files collectively were more complete and accurate in matching to our American Trends Panel data than any individual file. What lessons should researchers and other users of voter files draw from that?<\/strong><\/p>\n\n

That\u2019s right. Together, the five files we studied were able to match more than nine-in-ten panelists (91%), but the match rates for the individual files were lower, ranging from 50% to 79%. However, each file was able to find people that other files missed, probably because of the different matching algorithms the vendors used.<\/p>\n\n

What we learned in the matching process is that there\u2019s a trade-off between matching accuracy (i.e., do you believe the voter file match received is the correct person?) and coverage (i.e., the percent of people able to be matched). Lower match rates generally appeared more accurate, but disproportionately excluded younger and mobile people. High match rates produced more representative samples but may have included more inaccurate matches.<\/p>\n\n

Although we were able to use five different voter files in this research, most researchers will only use a single file. In that case, it\u2019s important to think about the goals of your research \u2013 depending on what you\u2019re investigating, you might value coverage over accuracy or vice versa.<\/p>\n\n

You also found that the files are more reflective of the registered voter population than of the general public as a whole \u2013 which makes sense, given the way they are derived. How does that limit their usefulness for researchers and other users?<\/strong><\/p>\n\n

When voter files first came to prominence for political practitioners and researchers, many were just what the name suggests \u2013 lists of registered voters. But as use of voter files for research and targeting has become more widespread, most vendors have tried to cover all<\/em> U.S. adults, including those who aren\u2019t registered to vote. Because the core component of the files is a combination of official state lists of registered voters, vendors have sought out commercial databases \u2013 available from sources such as credit rating agencies \u2013 to locate Americans missing from state voter rolls.<\/p>\n\n

The collective results of the five files provide evidence that the unregistered are not completely invisible to commercial files of the sort examined in this study. Two-thirds of those who told us they were certain that they were not registered were located by at least one of the files. However, researchers should proceed with caution when using this tool to study the general population as a whole, since the kinds of people missed by the files may be very different politically and demographically from the people vendors are able to find.<\/p>\n\n

Given the results of your study, what\u2019s your takeaway about how voter files should and shouldn\u2019t be used?<\/strong><\/p>\n\n

Our work doesn\u2019t address the use of the files for campaign targeting, which is arguably their most common application. But for researchers, the files offer a relatively easy way to examine the real electorate \u2013 who really voted \u2013 and to add registration and turnout data to surveys. Campaign pollsters have long relied on the files to provide evidence about past voting as a predictor of future turnout, as well as to provide a sampling frame for election surveys, and we see continued value in that. We haven\u2019t yet evaluated the files as sources of samples for surveys of the general public, but stay tuned \u2013 we may have more to say on that in the future.<\/p>\n\n

For more on voter files, read the full study, \u201cCommercial Voter Files and the Study of U.S. Politics.<\/a>\u201d<\/em><\/p>","protected":false},"excerpt":{"rendered":"

Read a Q&A with Pew Research Center\u2019s Ruth Igielnik and Scott Keeter about a recent study about voter files. <\/p>\n","protected":false},"author":145,"featured_media":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"sub_headline":"","sub_title":"","_prc_public_revisions":[],"_ppp_expiration_hours":0,"_ppp_enabled":false,"ai_generated_summary":"","apple_news_api_created_at":"","apple_news_api_id":"","apple_news_api_modified_at":"","apple_news_api_revision":"","apple_news_api_share_url":"","apple_news_cover_media_provider":"image","apple_news_coverimage":0,"apple_news_coverimage_caption":"","apple_news_cover_video_id":0,"apple_news_cover_video_url":"","apple_news_cover_embedwebvideo_url":"","apple_news_is_hidden":"","apple_news_is_paid":"","apple_news_is_preview":"","apple_news_is_sponsored":"","apple_news_maturity_rating":"","apple_news_metadata":"\"\"","apple_news_pullquote":"","apple_news_pullquote_position":"","apple_news_slug":"","apple_news_sections":[],"apple_news_suppress_video_url":false,"apple_news_use_image_component":false,"relatedPosts":[],"_prc_fork_parent":0,"_prc_fork_status":"","_prc_active_fork":0,"datacite_doi":"","datacite_doi_citation":"","_prc_seo_qr_attachment_id":0,"spoken_article_player_enabled":true,"displayBylines":true,"footnotes":"","prc_watchers":[]},"categories":[36,57,360,50],"bylines":[842],"collection":[],"datasets":[],"_post_visibility":[],"formats":[467],"_fund_pool":[],"languages":[],"regions-countries":[515],"research-teams":[528],"workflow-status":[],"class_list":["post-11323","short-read","type-short-read","status-publish","hentry","category-methodological-research","category-political-civic-engagement","category-voter-files","category-voter-participation","bylines-drew-desilver","formats-short-read","regions-countries-united-states","research-teams-methods"],"label":"Short Read","post_parent":0,"word_count":1826,"canonical_url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/short-reads\/2018\/02\/15\/voter-files-study-qa\/","art_direction":{"A1":{"id":21715,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/02\/PM_17.11.30_commercialVoterFile_featured2-1-jpg.webp","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/02\/PM_17.11.30_commercialVoterFile_featured2-1-jpg.webp?w=564&h=317&crop=1","width":564,"height":317,"chartArt":false},"A2":{"id":21715,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/02\/PM_17.11.30_commercialVoterFile_featured2-1-jpg.webp","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/02\/PM_17.11.30_commercialVoterFile_featured2-1-jpg.webp?w=268&h=151&crop=1","width":268,"height":151,"chartArt":false},"A3":{"id":21715,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/02\/PM_17.11.30_commercialVoterFile_featured2-1-jpg.webp","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/02\/PM_17.11.30_commercialVoterFile_featured2-1-jpg.webp?w=194&h=110&crop=1","width":194,"height":110,"chartArt":false},"A4":{"id":21715,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/02\/PM_17.11.30_commercialVoterFile_featured2-1-jpg.webp","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/02\/PM_17.11.30_commercialVoterFile_featured2-1-jpg.webp?w=268&h=151&crop=1","width":268,"height":151,"chartArt":false},"XL":{"id":21715,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/02\/PM_17.11.30_commercialVoterFile_featured2-1-jpg.webp","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/02\/PM_17.11.30_commercialVoterFile_featured2-1-jpg.webp?w=640&h=320&crop=1","width":640,"height":320,"chartArt":false},"social":{"id":21715,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/02\/PM_17.11.30_commercialVoterFile_featured2-1-jpg.webp","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/02\/PM_17.11.30_commercialVoterFile_featured2-1-jpg.webp?w=640&h=320&crop=1","width":640,"height":320,"chartArt":false}},"_embeds":[],"watchers":[],"table_of_contents":[],"datacite_doi":"","prc_seo_data":{"title":"Voter files: What are they, how are they used and are they accurate?","description":"Read a Q&A with Pew Research Center\u2019s Ruth Igielnik and Scott Keeter about a recent study about voter files.","og_title":"Q&A: The growing use of \u2018voter files\u2019 in studying the U.S. electorate","og_description":"Read a Q&A with Pew Research Center\u2019s Ruth Igielnik and Scott Keeter about a recent study about voter files. ","schema_type":"Article","noindex":false,"canonical_url":"","primary_terms":[],"custom_schema":[],"og_image":21715,"indexnow_submitted_at":null,"gsc_index_status":null},"prepublish_checks":{},"apple_news_notices":[],"jetpack_sharing_enabled":true,"relatedPostsOrdered":[],"bylinesOrdered":[{"key":"ea5f6c81-fdaf-4b68-b998-6df25f90965a","termId":842}],"acknowledgementsOrdered":[],"_links":{"self":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read\/11323","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read"}],"about":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/types\/short-read"}],"author":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/users\/145"}],"replies":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/comments?post=11323"}],"version-history":[{"count":2,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read\/11323\/revisions"}],"predecessor-version":[{"id":102075,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read\/11323\/revisions\/102075"}],"wp:attachment":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/media?parent=11323"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/categories?post=11323"},{"taxonomy":"bylines","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/bylines?post=11323"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/collection?post=11323"},{"taxonomy":"datasets","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/datasets?post=11323"},{"taxonomy":"_post_visibility","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_post_visibility?post=11323"},{"taxonomy":"formats","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/formats?post=11323"},{"taxonomy":"_fund_pool","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_fund_pool?post=11323"},{"taxonomy":"languages","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/languages?post=11323"},{"taxonomy":"regions-countries","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/regions-countries?post=11323"},{"taxonomy":"research-teams","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/research-teams?post=11323"},{"taxonomy":"workflow-status","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/workflow-status?post=11323"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}