{"id":27759,"date":"2024-03-13T09:51:25","date_gmt":"2024-03-13T14:51:25","guid":{"rendered":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/2024\/03\/13\/appendix-a-coding-methodology-democracy\/"},"modified":"2024-10-23T17:02:42","modified_gmt":"2024-10-23T21:02:42","slug":"appendix-a-coding-methodology-democracy","status":"publish","type":"post","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/appendix-a-coding-methodology-democracy\/","title":{"rendered":"Appendix A: Coding methodology"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">This Pew Research Center analysis on views of how to improve democracy uses data from nationally representative surveys conducted in 24 countries.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For non-U.S. data, this analysis draws on nationally representative surveys of 27,285 adults conducted from Feb. 20 to May 22, 2023. Surveys were conducted over the phone with adults in Canada, France, Germany, Greece, Italy, Japan, the Netherlands, South Korea, Spain, Sweden and the United Kingdom. They were conducted face-to-face with adults in Argentina, Brazil, Hungary, India, Indonesia, Israel, Kenya, Mexico, Nigeria, Poland and South Africa. In Australia, we used a mixed-mode probability-based online panel. All responses are weighted to be representative of the adult population in each country. <a href=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/methods\/interactives\/international-methodology\/all-survey\/all-country\/all-year\/\">Read more about international survey methodology<\/a>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In the U.S., we surveyed 3,576 adults from March 20 to March 26, 2023. Everyone who took part in this survey is a member of the Center\u2019s American Trends Panel (ATP), an online survey panel that is recruited through national, random sampling of residential addresses. This way, nearly all U.S. adults have a chance of selection. The survey is weighted to be representative of the U.S. adult population by gender, race, ethnicity, partisan affiliation, education and other categories. <a href=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/our-methods\/u-s-surveys\/the-american-trends-panel\/\">Read more about the ATP\u2019s methodology<\/a>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Respondents in all countries were asked the following question: \u201cWe\u2019d like to know more about your views of democracy in (survey country). What do you think would help improve the way democracy in (survey country) is working?\u201d For interviewer-administered surveys, responses were transcribed by interviewers in the language in which the interviews were conducted. In the sections that follow, we detail how we coded these responses to use for analysis, as well as properties of the responses.<\/p>\n\n\n\n<h3 data-is-section=\"true\" data-wp-context=\"{&quot;id&quot;:&quot;codebook-development&quot;}\" data-wp-interactive=\"{&quot;namespace&quot;:&quot;prc-block\\\/table-of-contents&quot;}\" class=\"wp-block-heading\" id=\"codebook-development\">Codebook development<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">To develop a codebook for the main ways people want to improve their democracy across the 24 countries surveyed, Center researchers iteratively reviewed random samples of native English responses and non-English responses translated by Google Translate and by a professional translation firm. Researchers mapped out the key concepts that commonly appeared in the responses using open coding. After developing an initial set of categories, researchers tested the codebook on multiple random samples of at least 75 native English responses to evaluate the codebook\u2019s conceptual validity. After each round, they reviewed disagreements and refined the codebook before testing it again on another sample.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">After five iterations of this process, researchers were able to determine that the codebook was clear enough for other coders to independently apply it in a consistent manner. The codebook\u2019s overall Krippendorff\u2019s alpha, measured using <a href=\"http:\/\/www.cs.columbia.edu\/nlp\/papers\/2006\/passonneau_06.pdf\">MASI distance<\/a> as a similarity measure, was 0.70 across the 25 codes in the codebook. Krippendorff\u2019s alpha, measured traditionally using a binary measure, was also above 0.70 for most individual codes.<\/p>\n\n\n\n<h3 data-is-section=\"true\" data-wp-context=\"{&quot;id&quot;:&quot;coding-responses&quot;}\" data-wp-interactive=\"{&quot;namespace&quot;:&quot;prc-block\\\/table-of-contents&quot;}\" class=\"wp-block-heading\" id=\"coding-responses\">Coding responses<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Using these intercoder reliability scores measured during codebook development as a benchmark of acceptable performance, researchers trained a larger group of Center coders and professional translators to apply the codebook at scale to the full set of responses. The full set did not include responses marked as a nonresponse by interviewers, which automatically received a code of \u201cDon\u2019t know\/Refused.\u201d In total, 25,005 responses in 36 different languages, including English, from 24 different countries were coded. <em>(For more on nonresponse, go to <\/em><a href=\"#characteristics-of-the-responses\"><em>Characteristics of the responses<\/em><\/a><em>.)<\/em><\/p>\n\n\n\n<figure class=\"wp-block-image size-640-wide\"><a rel=\"attachment wp-att-34389\" href=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/appendix-a-coding-methodology-democracy\/2024-03-13_democracy-open-end_a_a_01-png\/\"><img data-dominant-color=\"f2f2f2\" data-has-transparency=\"false\" style=\"--dominant-color: #f2f2f2;\" loading=\"lazy\" decoding=\"async\"  srcset=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/2024.03.13_democracy-open-end_a_a_01.png?resize=480,443 480w, https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/2024.03.13_democracy-open-end_a_a_01.png?resize=782,721 782w, https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/2024.03.13_democracy-open-end_a_a_01.png?resize=960,885 960w, https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/2024.03.13_democracy-open-end_a_a_01.png?resize=1200,1106 1200w, https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/2024.03.13_democracy-open-end_a_a_01.png?resize=1280,1180 1280w\" sizes=\"(max-width: 480px) 480px, (max-width: 782px) 782px, 640px\" height=\"590\" width=\"640\" src=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/2024.03.13_democracy-open-end_a_a_01.png?w=640\" alt=\"A table showing the Number of respondents and responses per language\" class=\"wp-image-34389 not-transparent\" \/><\/a><\/figure>\n\n\n\n<h4 id=\"professional-translators-as-coders\" class=\"wp-block-heading\">Professional translators as coders<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">To code the 17,526 non-English responses that were collected in 35 different languages, the Center partnered with a professional translation firm \u2013 cApStAn \u2013 and utilized Google Translate for select languages. (We have <a href=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/decoded\/2021\/12\/17\/the-pros-and-cons-of-using-professional-translators-vs-google-translate-to-analyze-open-ended-survey-responses\/\">previously experimented with using Google Translate<\/a> for open-ended survey responses.)<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For low-incidence languages, professional translators from cApStAn, hereinafter referred to as \u201ctranslators,\u201d converted all responses into English, and the translated responses were processed by in-house coders. For all other languages, translators coded and translated to English a random sample of 100 responses from each language after reviewing the codebook. The translators also recorded any questions and comments they had during the coding process. The sampled responses were concurrently translated to English using Google Translate and processed by in-house coders. To evaluate intercoder reliability, the translated responses were divided up and coded by Center researchers who developed the codebook.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">After coding the English translations provided by the translators, Center researchers reviewed the translators\u2019 notes and corresponding disagreements, and further refined the codebook with clarifying guidelines and decision-making rules. Center researchers also looked for possible systematic misunderstandings of the codebook within each language-country subset in the sample. For each subset (e.g., Spanish in Argentina), the Center identified disagreements and developed further guidelines to help resolve misunderstandings.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Based on the coding results from the translators and Google Translate, and in conjunction with results of <a href=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/decoded\/2021\/12\/17\/the-pros-and-cons-of-using-professional-translators-vs-google-translate-to-analyze-open-ended-survey-responses\/\">prior analysis<\/a>, Center researchers determined that Japanese responses could be coded in-house. Researchers also chose to code Spanish responses in-house based on the above results and the staff\u2019s language abilities.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For all other non-English languages, barring low-incidence languages translators were used as coders, following repeated sets of coding and feedback to ensure all of them achieved an acceptable enough understanding of the codebook that they could apply it independently (Krippendorff\u2019s alpha of 0.7 or higher).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Before the translators independently coded the remaining non-English responses, Center researchers provided a final round of extensive feedback. As the translators further improved their understanding of the codebook using this feedback, it is likely that the intercoder reliability scores reported below represent a lower-bound estimate of their actual coding performance on the remaining non-English responses.<\/p>\n\n\n\n<figure class=\"wp-block-image size-640-wide\"><a rel=\"attachment wp-att-34416\" href=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/appendix-a-coding-methodology-democracy\/2024-03-13_democracy-open-end_a_a_02-png\/\"><img data-dominant-color=\"f3f4f4\" data-has-transparency=\"false\" style=\"--dominant-color: #f3f4f4;\" loading=\"lazy\" decoding=\"async\"  srcset=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/2024.03.13_democracy-open-end_a_a_02.png?resize=480,576 480w, https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/2024.03.13_democracy-open-end_a_a_02.png?resize=782,938 782w, https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/2024.03.13_democracy-open-end_a_a_02.png?resize=960,1152 960w, https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/2024.03.13_democracy-open-end_a_a_02.png?resize=1200,1440 1200w, https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/2024.03.13_democracy-open-end_a_a_02.png?resize=1280,1536 1280w\" sizes=\"(max-width: 480px) 480px, (max-width: 782px) 782px, 640px\" height=\"768\" width=\"640\" src=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/2024.03.13_democracy-open-end_a_a_02.png?w=640\" alt=\"A table showing Intercoder reliability scores, overall and by individual code\" class=\"wp-image-34416 not-transparent\" \/><\/a><\/figure>\n\n\n\n<h4 id=\"english-responses-coded-in-house\" class=\"wp-block-heading\">English responses coded in-house<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">To code the responses that were collected natively in English from seven different countries and not already coded in the prior samples described above, Center researchers trained 13 additional in-house coders to apply the codebook independently. Each coder was given a sample of 100 English responses and evaluated for intercoder reliability. The sample was drawn from responses that the original researchers involved in the codebook\u2019s development had reached a consensus for during the codebook development process.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The additional coders were then evaluated against the coding results from Center researchers and given feedback, including notes on the cases where they disagreed with the baseline. Those whose overall MASI-distance Krippendorff\u2019s alpha was at or above 0.70 began independently coding the full queue of native English responses. Those below 0.70 were given additional random responses until they could apply the codebook independently.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The researchers and additional coders from the Center each coded between 65 and 2,677 responses. Weighted proportionally by their contribution to the total number of responses, these in-house coders achieved an overall effective intercoder reliability MASI-distance Krippendorff\u2019s alpha of 0.73. Their collective reliability (measured by standard binary Krippendorff\u2019s alphas) was also at or above 0.70 for most codes independently.<\/p>\n\n\n\n<h3 data-is-section=\"true\" data-wp-context=\"{&quot;id&quot;:&quot;collapsing-codes-for-analysis&quot;}\" data-wp-interactive=\"{&quot;namespace&quot;:&quot;prc-block\\\/table-of-contents&quot;}\" class=\"wp-block-heading\" id=\"collapsing-codes-for-analysis\">Collapsing codes for analysis<\/h3>\n\n\n\n<figure class=\"wp-block-image alignright size-310-wide\"><a rel=\"attachment wp-att-34406\" href=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/appendix-a-coding-methodology-democracy\/2024-03-13_democracy-open-end_a_a_03-png\/\"><img data-dominant-color=\"f2f2f2\" data-has-transparency=\"false\" style=\"--dominant-color: #f2f2f2;\" loading=\"lazy\" decoding=\"async\"  srcset=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/2024.03.13_democracy-open-end_a_a_03.png?resize=480,740 480w, https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/2024.03.13_democracy-open-end_a_a_03.png?resize=620,956 620w\" sizes=\"(max-width: 480px) 480px, (max-width: 782px) 782px, 640px\" height=\"478\" width=\"310\" src=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/2024.03.13_democracy-open-end_a_a_03.png?w=310\" alt=\"A table showing Primary codes and sub codes\" class=\"wp-image-34406 not-transparent\" \/><\/a><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">The original codebook for this analysis contains 25 unique codes applied to each unit of information in responses. Center researchers recategorized these 25 codes into 18 \u201cprimary\u201d codes \u2013 including 17 substantive primary codes and one primary code for nonresponse \u2013 and eight \u201csub\u201d codes to focus on overall themes throughout the text. For example, the \u201ceconomic reform\u201d code contains not only general mentions of changes to the economic system, but also any mentions of \u201cjobs.\u201d<\/p>\n\n\n\n<h3 data-is-section=\"true\" data-wp-context=\"{&quot;id&quot;:&quot;characteristics-of-the-responses&quot;}\" data-wp-interactive=\"{&quot;namespace&quot;:&quot;prc-block\\\/table-of-contents&quot;}\" class=\"wp-block-heading\" id=\"characteristics-of-the-responses\">Characteristics of the responses<\/h3>\n\n\n\n<figure class=\"wp-block-image alignright size-200-wide\"><a rel=\"attachment wp-att-34398\" href=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/appendix-a-coding-methodology-democracy\/2024-03-13_democracy-open-end_a_a_04-png\/\"><img data-dominant-color=\"f3f4f4\" data-has-transparency=\"false\" style=\"--dominant-color: #f3f4f4;\" loading=\"lazy\" decoding=\"async\"  srcset=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/2024.03.13_democracy-open-end_a_a_04.png?resize=400,1320 400w\" sizes=\"(max-width: 480px) 480px, (max-width: 782px) 782px, 640px\" height=\"660\" width=\"200\" src=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/2024.03.13_democracy-open-end_a_a_04.png?w=200\" alt=\"A table showing Item nonresponse across 24 countries surveyed\" class=\"wp-image-34398 not-transparent\" \/><\/a><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Item nonresponse<\/strong> varies significantly across the 24 countries included in the survey. In Spain, just 4% did not provide an answer to the open-ended question, while 47% did not respond in the U.S. Roughly a third of respondents did not answer the question in Argentina, Australia, Indonesia and Japan.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Previous research has established that item nonresponse is <a href=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/decoded\/2021\/10\/14\/why-do-some-open-ended-survey-questions-result-in-higher-item-nonresponse-rates-than-others\/\">higher for open-ended questions<\/a> than for closed-ended questions, which have a pre-fixed set of response options. Factors like the level of cognitive burden for the respondent and whether the topical focus is political can also contribute. The difficulty of this open-ended question as well as its political nature likely contributed to higher nonresponse rates.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">People with lower levels of formal education were more likely not to answer the question in most countries surveyed, as were younger adults relative to older adults in some countries.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Countries also vary in <strong>how much detail the average respondent provided<\/strong>. For example, Spanish responses in Spain averaged 32 words, more than double the 14 words in the average Spanish response in Mexico. While this particular gap may be attributable to mode differences \u2013 responses in Spain were collected over the phone, while responses in Mexico were collected in person \u2013 response length also varies between the publics that were surveyed in person. In Argentina, where the survey was also administered in Spanish and face-to-face, people provided an average of nine words.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Whether due to mode or to cultural, demographic or other factors, variation in response length ultimately manifests as <strong>variation in the number of topics mentioned in a given response<\/strong>. For example, across the 24 countries surveyed, a median of 73% mentioned only one topic in our codebook (e.g., politicians). The share in South Korea is much higher, with 92% suggesting only one area of improvement when describing what they think would improve democracy. In comparison, about a quarter or more mention two areas of improvement in France, Spain, Sweden and the U.S.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">These differences help explain why the <em>share<\/em> giving a particular answer in certain publics may appear much lower than others, even if it is the top-<em>ranked<\/em> suggestion for improving democracy. To give a specific example, 10% of respondents in Poland mention politicians, while 18% do so in South Africa \u2013 yet the topic is ranked second in Poland and third in South Africa. Given this discrepancy, researchers have chosen to highlight not only the share of the public that mentions a given topic but also its relative ranking among all topics coded, both in text and in graphics.<\/p>\n\n\n\n<h3 data-is-section=\"true\" data-wp-context=\"{&quot;id&quot;:&quot;selection-of-quotes&quot;}\" data-wp-interactive=\"{&quot;namespace&quot;:&quot;prc-block\\\/table-of-contents&quot;}\" class=\"wp-block-heading\" id=\"selection-of-quotes\">Selection of quotes<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Open-ended responses included in the report and in the interactive quote sorter have been edited for clarity (and, in some cases, translated into English by a professional firm). They have been purposefully \u2013 not randomly \u2013 selected to illustrate key points, and selected responses may not be representative of all responses for a given public. Quotes may also have been shortened in the report for brevity. Our analysis is not a fact check of participants\u2019 views.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n","protected":false},"excerpt":{"rendered":"<p>This Pew Research Center analysis on views of how to improve democracy uses data from nationally representative surveys conducted in 24 countries. For non-U.S. data, this analysis draws on nationally representative surveys of 27,285 adults conducted from Feb. 20 to May 22, 2023. Surveys were conducted over the phone with adults in Canada, France, Germany, [&hellip;]<\/p>\n","protected":false},"author":648,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"sub_headline":"","sub_title":"","_prc_public_revisions":[],"_ppp_expiration_hours":0,"_ppp_enabled":false,"ai_generated_summary":"","relatedPosts":[],"reportMaterials":[],"multiSectionReport":[],"package_parts__enabled":false,"package_parts":[],"datacite_doi":"","datacite_doi_citation":"","_prc_seo_qr_attachment_id":0,"spoken_article_player_enabled":true,"displayBylines":true,"footnotes":"","prc_watchers":[],"_prc_fork_parent":0,"_prc_fork_status":"","_prc_active_fork":0},"categories":[60,51,395],"tags":[],"bylines":[738,633,954,849],"collection":[],"datasets":[2393],"level_of_effort":[],"primary_audience":[],"information_type":[],"_post_visibility":[],"formats":[458],"_fund_pool":[],"languages":[],"regions-countries":[504,498,514,497,509,505,512,511,515],"research-teams":[525],"workflow-status":[],"class_list":["post-27759","post","type-post","status-publish","format-standard","hentry","category-democracy","category-election-system-voting-process","category-international-political-values","bylines-christine-huang","bylines-laura-clancy","bylines-laura-silver","bylines-moira-fagan","datasets-spring-2023-survey-data","formats-report","regions-countries-germany","regions-countries-india","regions-countries-international","regions-countries-israel","regions-countries-mexico","regions-countries-multiple-regions-worldwide","regions-countries-north-america","regions-countries-sub-saharan-africa","regions-countries-united-states","research-teams-global"],"label":false,"post_parent":27793,"word_count":1652,"canonical_url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/appendix-a-coding-methodology-democracy\/","art_direction":{"A1":{"id":34525,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/PG_24.03.13_DemocracyOpenEnds_Feature.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/PG_24.03.13_DemocracyOpenEnds_Feature.png?w=564&h=317&crop=1","width":564,"height":317,"caption":"Flags representing various political parties wave along a street in Jakarta, Indonesia, on Jan. 23, 2024, a few weeks ahead of a massive general election. Candidates from 18 national parties participated. (Azwar Ipank\/Anadolu via Getty Images)","chartArt":false},"A2":{"id":34525,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/PG_24.03.13_DemocracyOpenEnds_Feature.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/PG_24.03.13_DemocracyOpenEnds_Feature.png?w=268&h=151&crop=1","width":268,"height":151,"caption":"Flags representing various political parties wave along a street in Jakarta, Indonesia, on Jan. 23, 2024, a few weeks ahead of a massive general election. Candidates from 18 national parties participated. (Azwar Ipank\/Anadolu via Getty Images)","chartArt":false},"A3":{"id":34525,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/PG_24.03.13_DemocracyOpenEnds_Feature.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/PG_24.03.13_DemocracyOpenEnds_Feature.png?w=194&h=110&crop=1","width":194,"height":110,"caption":"Flags representing various political parties wave along a street in Jakarta, Indonesia, on Jan. 23, 2024, a few weeks ahead of a massive general election. Candidates from 18 national parties participated. (Azwar Ipank\/Anadolu via Getty Images)","chartArt":false},"A4":{"id":34525,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/PG_24.03.13_DemocracyOpenEnds_Feature.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/PG_24.03.13_DemocracyOpenEnds_Feature.png?w=268&h=151&crop=1","width":268,"height":151,"caption":"Flags representing various political parties wave along a street in Jakarta, Indonesia, on Jan. 23, 2024, a few weeks ahead of a massive general election. Candidates from 18 national parties participated. (Azwar Ipank\/Anadolu via Getty Images)","chartArt":false},"XL":{"id":34525,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/PG_24.03.13_DemocracyOpenEnds_Feature.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/PG_24.03.13_DemocracyOpenEnds_Feature.png?w=720&h=405&crop=1","width":720,"height":405,"caption":"Flags representing various political parties wave along a street in Jakarta, Indonesia, on Jan. 23, 2024, a few weeks ahead of a massive general election. Candidates from 18 national parties participated. (Azwar Ipank\/Anadolu via Getty Images)","chartArt":false},"social":{"id":34525,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/PG_24.03.13_DemocracyOpenEnds_Feature.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2024\/03\/PG_24.03.13_DemocracyOpenEnds_Feature.png?w=1200&h=628&crop=1","width":1200,"height":628,"caption":"Flags representing various political parties wave along a street in Jakarta, Indonesia, on Jan. 23, 2024, a few weeks ahead of a massive general election. Candidates from 18 national parties participated. (Azwar Ipank\/Anadolu via Getty Images)","chartArt":false}},"_embeds":[],"watchers":[],"table_of_contents":[{"id":27793,"title":"What Can Improve Democracy?","slug":"what-can-improve-democracy","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/what-can-improve-democracy\/","is_active":false},{"id":27747,"title":"1. Politicians, changing leadership and political parties","slug":"politicians-changing-leadership-and-political-parties","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/politicians-changing-leadership-and-political-parties\/","is_active":false},{"id":27766,"title":"2. Government reform, special interests and the media","slug":"government-reform-special-interests-and-the-media","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/government-reform-special-interests-and-the-media\/","is_active":false},{"id":27753,"title":"3. Economic and policy changes","slug":"economic-and-policy-changes","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/economic-and-policy-changes\/","is_active":false},{"id":27811,"title":"4. Citizen behavior and individual rights and equality","slug":"citizen-behavior-and-individual-rights-and-equality","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/citizen-behavior-and-individual-rights-and-equality\/","is_active":false},{"id":27775,"title":"5. Electoral reform and direct democracy","slug":"electoral-reform-and-direct-democracy","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/electoral-reform-and-direct-democracy\/","is_active":false},{"id":27824,"title":"6. Rule of law, safety and the judicial system","slug":"rule-of-law-safety-and-the-judicial-system","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/rule-of-law-safety-and-the-judicial-system\/","is_active":false},{"id":27759,"title":"Appendix A: Coding methodology","slug":"appendix-a-coding-methodology-democracy","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/appendix-a-coding-methodology-democracy\/","is_active":true},{"id":27805,"title":"Appendix B: Survey methodology","slug":"appendix-b-survey-methodology","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/appendix-b-survey-methodology\/","is_active":false},{"id":27783,"title":"Appendix C: Codebook","slug":"appendix-c-codebook-democracy","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/appendix-c-codebook-democracy\/","is_active":false},{"id":27837,"title":"Appendix D: Political categorization","slug":"appendix-d-political-categorization","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/appendix-d-political-categorization\/","is_active":false},{"id":27831,"title":"Appendix E: Classifying European political parties","slug":"appendix-e-classifying-european-political-parties","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/appendix-e-classifying-european-political-parties\/","is_active":false},{"id":27818,"title":"Acknowledgments","slug":"acknowledgments-democracy-2024","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/acknowledgments-democracy-2024\/","is_active":false}],"report_materials":[{"key":"_wwmjxe29h","type":"topline","attachmentId":53853,"url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/wp-content\/uploads\/sites\/2\/2024\/03\/2024.03.13_democracy-open-end_topline.pdf","label":"","icon":""},{"key":"_4l44i87ln","type":"report","attachmentId":53881,"url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/wp-content\/uploads\/sites\/2\/2024\/03\/2024.03.13_democracy-open-end_report.pdf","label":"","icon":""},{"type":"dataset","id":2420,"label":"American Trends Panel Wave 124","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/dataset\/american-trends-panel-wave-124\/"},{"type":"dataset","id":2393,"label":"Spring 2023 Survey Data","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/dataset\/spring-2023-survey-data\/"}],"report_pagination":{"current_post":{"id":27759,"title":"Appendix A: Coding methodology","slug":"appendix-a-coding-methodology-democracy","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/appendix-a-coding-methodology-democracy\/","is_active":true,"page_num":8},"next_post":{"id":27805,"title":"Appendix B: Survey methodology","slug":"appendix-b-survey-methodology","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/appendix-b-survey-methodology\/","is_active":false,"page_num":9},"previous_post":{"id":27824,"title":"6. Rule of law, safety and the judicial system","slug":"rule-of-law-safety-and-the-judicial-system","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/rule-of-law-safety-and-the-judicial-system\/","is_active":false,"page_num":7},"pagination_items":[{"id":27793,"title":"What Can Improve Democracy?","slug":"what-can-improve-democracy","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/what-can-improve-democracy\/","is_active":false,"page_num":1},{"id":27747,"title":"1. Politicians, changing leadership and political parties","slug":"politicians-changing-leadership-and-political-parties","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/politicians-changing-leadership-and-political-parties\/","is_active":false,"page_num":2},{"id":27766,"title":"2. Government reform, special interests and the media","slug":"government-reform-special-interests-and-the-media","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/government-reform-special-interests-and-the-media\/","is_active":false,"page_num":3},{"id":27753,"title":"3. Economic and policy changes","slug":"economic-and-policy-changes","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/economic-and-policy-changes\/","is_active":false,"page_num":4},{"id":27811,"title":"4. Citizen behavior and individual rights and equality","slug":"citizen-behavior-and-individual-rights-and-equality","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/citizen-behavior-and-individual-rights-and-equality\/","is_active":false,"page_num":5},{"id":27775,"title":"5. Electoral reform and direct democracy","slug":"electoral-reform-and-direct-democracy","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/electoral-reform-and-direct-democracy\/","is_active":false,"page_num":6},{"id":27824,"title":"6. Rule of law, safety and the judicial system","slug":"rule-of-law-safety-and-the-judicial-system","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/rule-of-law-safety-and-the-judicial-system\/","is_active":false,"page_num":7},{"id":27759,"title":"Appendix A: Coding methodology","slug":"appendix-a-coding-methodology-democracy","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/appendix-a-coding-methodology-democracy\/","is_active":true,"page_num":8},{"id":27805,"title":"Appendix B: Survey methodology","slug":"appendix-b-survey-methodology","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/appendix-b-survey-methodology\/","is_active":false,"page_num":9},{"id":27783,"title":"Appendix C: Codebook","slug":"appendix-c-codebook-democracy","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/appendix-c-codebook-democracy\/","is_active":false,"page_num":10},{"id":27837,"title":"Appendix D: Political categorization","slug":"appendix-d-political-categorization","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/appendix-d-political-categorization\/","is_active":false,"page_num":11},{"id":27831,"title":"Appendix E: Classifying European political parties","slug":"appendix-e-classifying-european-political-parties","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/appendix-e-classifying-european-political-parties\/","is_active":false,"page_num":12},{"id":27818,"title":"Acknowledgments","slug":"acknowledgments-democracy-2024","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/global\/2024\/03\/13\/acknowledgments-democracy-2024\/","is_active":false,"page_num":13}]},"parent_info":{"parent_title":"What Can Improve Democracy?","parent_id":27793},"materialsOrdered":[],"chaptersOrdered":[],"partsOrdered":[],"partsEnabled":false,"datacite_doi":"","prc_seo_data":{"title":"Appendix A: Coding methodology","description":"This Pew Research Center analysis on views of how to improve democracy uses data from nationally representative surveys conducted in 24 countries. For non-U.S. data, this analysis draws on nationally&hellip;","og_title":"Appendix A: Coding methodology","og_description":"","schema_type":"Article","noindex":false,"canonical_url":"","primary_terms":{"category":395,"formats":458,"regions-countries":515,"research-teams":525},"custom_schema":[],"og_image":34525,"indexnow_submitted_at":null,"gsc_index_status":null},"prepublish_checks":{"prc-image-alt-text":{"status":"complete","message":"All images have alt text.","data":null},"prc-about-this-research":{"status":"incomplete","message":"Add an \"About this research\" details block.","data":null},"prc-paragraph-count":{"status":"complete","message":"Found 24 paragraphs.","data":{"count":24}},"prc-internal-link":{"status":"complete","message":"Found 9 internal links.","data":{"count":9}}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"relatedPostsOrdered":[],"bylinesOrdered":[],"acknowledgementsOrdered":[],"_links":{"self":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/27759","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/users\/648"}],"replies":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/comments?post=27759"}],"version-history":[{"count":1,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/27759\/revisions"}],"predecessor-version":[{"id":46113,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/27759\/revisions\/46113"}],"wp:attachment":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/media?parent=27759"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/categories?post=27759"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/tags?post=27759"},{"taxonomy":"bylines","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/bylines?post=27759"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/collection?post=27759"},{"taxonomy":"datasets","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/datasets?post=27759"},{"taxonomy":"level_of_effort","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/level_of_effort?post=27759"},{"taxonomy":"primary_audience","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/primary_audience?post=27759"},{"taxonomy":"information_type","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/information_type?post=27759"},{"taxonomy":"_post_visibility","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_post_visibility?post=27759"},{"taxonomy":"formats","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/formats?post=27759"},{"taxonomy":"_fund_pool","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_fund_pool?post=27759"},{"taxonomy":"languages","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/languages?post=27759"},{"taxonomy":"regions-countries","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/regions-countries?post=27759"},{"taxonomy":"research-teams","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/research-teams?post=27759"},{"taxonomy":"workflow-status","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/workflow-status?post=27759"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}