The Color of News: How Different Media Have Covered the General Election is based on the aggregated data collected as part of the News Coverage Index from September 8 through October 16, 2008. This timeframe begins the Monday following the conclusion of the Republican National Convention and runs through the day after the final presidential debate between John McCain and Barack Obama. <\/p>\n\n
For an accurate account of the chronology of the general election, the period studied has been broken into six distinct phases. These phases have been dictated by the timing of campaign events. Therefore, some of these phases do not correspond with a typical calendar week. <\/p>\n\n
The complete methodology of the PEJ\u2019s News Coverage Index is available here<\/a>. <\/p>\n\n In addition to the coding already conducted as part of PEJ\u2019s weekly reports, researchers conducted secondary coding of many of the campaign-focused stories for tone. Details of that process are below. <\/p>\n\n Examining the news agenda of 48 different outlets in five media sectors, including newspapers, online, network TV, cable TV, and radio, the NCI is designed to provide news consumers, journalists and researchers with hard data about what stories and topics the media are covering, the trajectories of major stories and differences among news platforms. <\/p>\n\n Following a rotation system, PEJ monitors 48 different news outlets each week: 34 or 35 outlets each weekday as well as 7 newspapers each Sunday. Newspapers (13 in all, Sun-Fri)<\/strong> Web sites (Five in all, Mon-Fri) <\/strong> Network TV (Seven in all, Mon-Fri) <\/strong> Evening news <\/u> Cable TV (Fifteen in all, Mon-Fri) <\/strong> Radio (Six in all, Mon-Fri) <\/strong> From that content, PEJ analyzes all stories with a national or international focus that appear as follows: <\/p>\n\n For newspapers that are available in print in the Washington, D.C. area, we have hard copies delivered to our office each day. For newspapers that are not available for delivery, digital editions of the paper are retrieved either through the newspaper\u2019s own Web site, or through the use of digital delivery services such as pressdisplay.com and newsstand.com. When necessary, the text of articles are supplemented by the archives available in the LexisNexis computer database.<\/p>\n\n Radio programs are captured through online streams of the shows. Using automated software, we record several local affiliates that air the program in various markets throughout the country. The purpose of this method is to ensure that we have a version of the program in case one of the streams is unavailable on a particular day, and so that we record the show in a manner that represents the way a typical listener would hear the program with commercials and newsbreaks. <\/p>\n\n Online websites are captured manually by a member of PEJ\u2019s staff. The capture time is rotated daily between 9 am ET and 4 pm ET. The home pages and pages with the top articles for all five sites are saved so that when we reference the material, the format is the same as it appeared online at the time of capture. All television and radio programs are then coded by a member of PEJ\u2019s staff who watches or listens to the archived version of the program. <\/p>\n\n Coding Team & Process for Weekly Index Coding<\/strong> A majority of the codes and variables used in this study come out of the coding protocol created for the weekly Campaign Coverage Index which PEJ has been issuing throughout 2008. For the variables of frame\/campaign topic, significant presence, and lead newsmaker, the data came from all campaign stories that appeared in PEJ\u2019s weekly coding. The specific description of those variables can be found here<\/a>. <\/p>\n\n Between September 8 and October 16, the PEJ\u2019s overall Index included 2,412 campaign stories. To measure the tone of the campaign coverage of the major presidential and vice presidential candidates, PEJ\u2019s researchers conducted additional coding on a sample of the campaign stories that appeared in our weekly indexes. <\/p>\n\n Two categories of stories were excluded from the sample. Talk radio stories, which are part of PEJ\u2019s regular NCI, were not included in this campaign study of tone. Broadcast stories that were 30 seconds or less were also excluded. <\/p>\n\n PEJ conducted further sampling on the selected stories. This was done by arranging the stories from each outlet in chronological order and randomly selecting a first story. We then selected every-other story within each outlet to arrive at the final sample. <\/p>\n\n This process resulted in 857 total stories from 43 different media outlets. These included 72 newspaper stories, 78 stories from news websites, 213 stories from network TV, 448 from cable TV, and 46 from radio programs.<\/p>\n\n Coders then determined the tone of the story as a whole for each candidate who was a significant presence. In order for a story to be coded as either \u201cpositive\u201d or \u201cnegative,\u201d it must have either 1.5 times the amount of positive comments to negative comments, or 1.5 times the amount of negative comments to positive comments (with an exception for 2 to 3, which is coded as \u201cneutral\u201d). If the headline or lead has a positive or negative tone, it was counted twice into the total value. Also counted twice for tone were the first three paragraphs or first four sentences, whichever came first.<\/p>\n\n Any story where the ratio of positive to negative comments was less than 1.5 to 1 was considered a \u201cneutral\u201d story. <\/p>\n\n In some previous studies, PEJ used a ratio of 2 to 1 instead of 1.5 to 1 in determining the overall tone of news stories. <\/p>\n\n The 2:1 ratio makes sets the bar even higher for a story to be coded as either positive or negative overall. As we entered the 2008 election campaign, PEJ reviewed and retested both the 2:1 ratio and the 1:5 to 1 ratio. We also consulted with academics of content analysis. First, we found only minor shifts in the overall outcome of stories. Indeed, in past content studies where we coded using both ratios, the overall relationship of positive to negative stories changed very little. The bigger difference was in an increase in mixed or neutral stories. In our pre-tests in 2007, the Project felt that the 1.5 to 1 ratio more precisely represented the overall tone of the stories. The academics consulted concurred. <\/p>\n\n Still, in making comparisons to previous years, it is important to note the different measures used. The 1.5 to 1 ratio was used in our previous 2007 study about the Invisible Primary<\/a> season. The 2 to 1 ratio was used in PEJ\u2019s 2004 report called The Debate Effect<\/a> and the 2001 report on coverage of George W. Bush\u2019s first 100 days in office<\/a>. <\/p>\n\n The previous study that PEJ conducted in October 2007 using the same process for determining tone had a rate of agreement for intercoder reliability of 86%.<\/p>\n\n For this study, each of the five coders were trained (or re-trained) on the tone coding methodology and then were given the same set of 40 stories to code for tone for each of the four candidates. The rate of intercoder reliability agreement was 81%. <\/p>","protected":false},"excerpt":{"rendered":" The Color of News: How Different Media Have Covered the General Election is based on the aggregated data collected as part of the News Coverage Index from September 8 through October 16, 2008. This timeframe begins the Monday following the conclusion of the Republican National Convention and runs through the day after the final presidential […]<\/p>\n","protected":false},"author":139,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_crdt_document":"","sub_headline":null,"sub_title":"","_prc_public_revisions":[],"_ppp_expiration_hours":0,"_ppp_enabled":false,"ai_generated_summary":"","bylines":[{"key":"a23621a8-e650-47a0-9e61-0d7371f0c63a","termId":921}],"acknowledgements":[],"displayBylines":true,"prc_watchers":[],"relatedPosts":[],"reportMaterials":[],"multiSectionReport":[],"package_parts__enabled":false,"package_parts":[],"_prc_fork_parent":0,"_prc_fork_status":"","_prc_active_fork":0,"datacite_doi":"","datacite_doi_citation":"","_prc_seo_qr_attachment_id":0,"spoken_article_player_enabled":true,"footnotes":""},"categories":[],"tags":[],"bylines":[921],"collection":[],"datasets":[],"level_of_effort":[],"primary_audience":[],"information_type":[],"_post_visibility":[],"formats":[458],"_fund_pool":[],"languages":[],"regions-countries":[],"research-teams":[527],"workflow-status":[],"class_list":["post-90351","post","type-post","status-publish","format-standard","hentry","bylines-benjamin-wormald","formats-report","research-teams-journalism"],"label":false,"post_parent":90311,"word_count":1907,"canonical_url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2008\/10\/29\/methodology-12-6\/","art_direction":false,"_embeds":[],"watchers":[],"table_of_contents":[{"id":90311,"title":"The Color of News","slug":"the-color-of-news","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2008\/10\/29\/the-color-of-news\/","is_active":false},{"id":90321,"title":"Cable \u2014 Three Different Networks, Three Different Perspectives","slug":"cable-three-different-networks-three-different-perspectives","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2008\/10\/29\/cable-three-different-networks-three-different-perspectives\/","is_active":false},{"id":90332,"title":"Network TV \u2014 A More Balanced Medium","slug":"network-tv-a-more-balanced-medium","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2008\/10\/29\/network-tv-a-more-balanced-medium\/","is_active":false},{"id":90338,"title":"Newspapers","slug":"newspapers-2","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2008\/10\/29\/newspapers-2\/","is_active":false},{"id":90345,"title":"Online \u2014 Polls and Horserace Top the List","slug":"online-polls-and-horserace-top-the-list","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2008\/10\/29\/online-polls-and-horserace-top-the-list\/","is_active":false},{"id":90351,"title":"Methodology","slug":"methodology-12-6","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2008\/10\/29\/methodology-12-6\/","is_active":true},{"id":90357,"title":"Topline","slug":"topline-29","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2008\/10\/29\/topline-29\/","is_active":false}],"report_materials":"","report_pagination":{"current_post":{"id":90351,"title":"Methodology","slug":"methodology-12-6","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2008\/10\/29\/methodology-12-6\/","is_active":true,"page_num":6},"next_post":{"id":90357,"title":"Topline","slug":"topline-29","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2008\/10\/29\/topline-29\/","is_active":false,"page_num":7},"previous_post":{"id":90345,"title":"Online \u2014 Polls and Horserace Top the List","slug":"online-polls-and-horserace-top-the-list","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2008\/10\/29\/online-polls-and-horserace-top-the-list\/","is_active":false,"page_num":5},"pagination_items":[{"id":90311,"title":"The Color of News","slug":"the-color-of-news","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2008\/10\/29\/the-color-of-news\/","is_active":false,"page_num":1},{"id":90321,"title":"Cable \u2014 Three Different Networks, Three Different Perspectives","slug":"cable-three-different-networks-three-different-perspectives","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2008\/10\/29\/cable-three-different-networks-three-different-perspectives\/","is_active":false,"page_num":2},{"id":90332,"title":"Network TV \u2014 A More Balanced Medium","slug":"network-tv-a-more-balanced-medium","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2008\/10\/29\/network-tv-a-more-balanced-medium\/","is_active":false,"page_num":3},{"id":90338,"title":"Newspapers","slug":"newspapers-2","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2008\/10\/29\/newspapers-2\/","is_active":false,"page_num":4},{"id":90345,"title":"Online \u2014 Polls and Horserace Top the List","slug":"online-polls-and-horserace-top-the-list","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2008\/10\/29\/online-polls-and-horserace-top-the-list\/","is_active":false,"page_num":5},{"id":90351,"title":"Methodology","slug":"methodology-12-6","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2008\/10\/29\/methodology-12-6\/","is_active":true,"page_num":6},{"id":90357,"title":"Topline","slug":"topline-29","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2008\/10\/29\/topline-29\/","is_active":false,"page_num":7}]},"parent_info":{"parent_title":"The Color of News","parent_id":90311},"materialsOrdered":[],"chaptersOrdered":[],"partsOrdered":[],"partsEnabled":false,"datacite_doi":"","prc_seo_data":{"title":"Methodology","description":"The Color of News: How Different Media Have Covered the General Election is based on the aggregated data collected as part of the News Coverage Index from September 8 through…","og_title":"Methodology","og_description":"The Color of News: How Different Media Have Covered the General Election is based on the aggregated data collected as part of the News Coverage Index from September 8 through…","schema_type":"Article","noindex":false,"canonical_url":"","primary_terms":[],"custom_schema":[],"og_image":0,"indexnow_submitted_at":null,"gsc_index_status":null},"prepublish_checks":{"prc-image-alt-text":{"status":"complete","message":"No image blocks in content.","data":null},"prc-about-this-research":{"status":"incomplete","message":"Add an \"About this research\" details block.","data":null},"prc-paragraph-count":{"status":"complete","message":"Found 41 paragraphs.","data":{"count":41}},"prc-internal-link":{"status":"complete","message":"Found 6 internal links.","data":{"count":6}}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"relatedPostsOrdered":[],"bylinesOrdered":[{"key":"a23621a8-e650-47a0-9e61-0d7371f0c63a","termId":921}],"acknowledgementsOrdered":[],"_links":{"self":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/90351","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/users\/139"}],"replies":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/comments?post=90351"}],"version-history":[{"count":2,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/90351\/revisions"}],"predecessor-version":[{"id":135593,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/90351\/revisions\/135593"}],"wp:attachment":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/media?parent=90351"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/categories?post=90351"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/tags?post=90351"},{"taxonomy":"bylines","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/bylines?post=90351"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/collection?post=90351"},{"taxonomy":"datasets","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/datasets?post=90351"},{"taxonomy":"level_of_effort","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/level_of_effort?post=90351"},{"taxonomy":"primary_audience","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/primary_audience?post=90351"},{"taxonomy":"information_type","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/information_type?post=90351"},{"taxonomy":"_post_visibility","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_post_visibility?post=90351"},{"taxonomy":"formats","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/formats?post=90351"},{"taxonomy":"_fund_pool","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_fund_pool?post=90351"},{"taxonomy":"languages","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/languages?post=90351"},{"taxonomy":"regions-countries","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/regions-countries?post=90351"},{"taxonomy":"research-teams","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/research-teams?post=90351"},{"taxonomy":"workflow-status","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/workflow-status?post=90351"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}PEJ\u2019s News Coverage Index<\/h4>\n\n
The list of outlets and rotation is as follows: <\/p>\n\n
The New York Times every day<\/p>\n\n
Coded two out of these four every day<\/u>
The Washington Post
Los Angeles Times
USA Today
The Wall Street Journal <\/p>\n\n
Coded two out of these four every day<\/u>
Philadelphia Inquirer
Chicago Tribune
Arkansas Democrat-Gazette
San Francisco Chronicle<\/p>\n\n
Coded 2 out of these 4 every day<\/u>
New Hampshire Union-Leader
MetroWest Daily News
The Gazette (Colorado Springs)
Modesto Bee <\/p>\n\n
CNN.com
Yahoo News
MSNBC.com
Google News
AOL News <\/p>\n\n
Morning shows <\/u>
ABC \u2013 Good Morning America
CBS \u2013 Early Show
NBC \u2013 Today <\/p>\n\n
ABC \u2013 World News Tonight
CBS \u2013 CBS Evening News
NBC \u2013 NBC Nightly News
PBS \u2013 Newshour with Jim Lehrer (Rotated daily between the first 30 minutes and the second 30 minutes) <\/p>\n\n
Daytime (2:00 to 2:30 pm) coded 2 out of 3 every day<\/u>
CNN
Fox News
MSNBC
Nighttime CNN \u2013 coded 3 out of the 4 every day <\/u>
Situation Room (6 pm)
Lou Dobbs Tonight
CNN Election Center
Anderson Cooper 360
Nighttime Fox News \u2013 coded 3 out of the 4 every day <\/u>
Special Report w\/ Brit Hume
Fox Report w\/ Shepard Smith
O\u2019Reilly Factor
Hannity & Colmes
Nighttime MSNBC \u2013 coded 2 out of the 4 every day <\/u>
Race for the White House
Hardball (7 pm)
Countdown w\/ Keith Olbermann
Rachel Maddow<\/p>\n\n
ABC Radio headlines at 9am and 5pm
CBS Radio headlines at 9am and 5pm
NPR Morning Edition every day (Rotated daily between the first 30 minutes of the first hour and first 30 minutes of the second hour)<\/p>\n\n
Talk Radio <\/strong>
Rush Limbaugh every other day
One out of two additional conservatives each day <\/u>
Sean Hannity
Michael Savage <\/p>\n\n
One out of two liberals each day <\/u>
Ed Schultz
Randi Rhodes <\/p>\n\n\n
Capture and Retrieval <\/strong>
All outlets included in the weekly index are captured and included in PEJ\u2019s media archive. <\/p>\n\n
Finally, all television shows are recorded digitally and archived for coding purposes. PEJ is a subscriber to DirectTV satellite service and all programs are recorded onto multiple TiVo recording units before being burned onto DVDs for archival purposes. <\/p>\n\n
The data in this study derived from PEJ\u2019s regular Index coding was created by PEJ\u2019s team of 14 trained coders. We have tested all of the variables derived from the regular weekly Index coding and all the variables reached a level of agreement of 80% or higher. For specific information about those tests, see the methodology section for the NCI.<\/a><\/p>\n\n Additional Coding of Campaign Stories for Tone
<\/h4>\n\n
Sample Selection<\/strong>
Stories in the NCI are considered to be about the presidential election if 50% or more of the story was devoted to discussion of the on-going presidential campaign. To analyze stories about tone about a given candidate, only stories in which at least one of the four major presidential and vice presidential candidates (John McCain, Barack Obama, Sarah Palin, and Joe Biden) were a lead newsmaker were included. For a candidate to be considered a lead newsmaker, they must be featured in at least 50% of the time or space that makes up that story. <\/p>\n\n
Coding Design<\/strong>
The specific analysis of tone was conducted on the subset of campaign stories that was described above. The method of measuring tone was the same that had been used in previous PEJ studies. <\/p>\n\n
Unit of Analysis<\/strong>
The unit of analysis for this study was the story. Each story was coded for tone for each of the four politicians followed in the study. If a candidate did not appear in at least 25% of the story, they were not considered a significant figure in the story and where therefore coded as \u201cn\/a\u201d for not having a significant presence.<\/p>\n\n
Tone Variable<\/strong>
The tone variable measures whether a story\u2019s tone is constructed in a way, via use of quotes, assertions, or innuendo, which results in positive, neutral, or negative coverage for the primary figure as it relates to the topic of the story. While reading or listening to a story, coders tallied up all the comments that have either a negative or positive tone to the reporting. Direct and indirect quotes were counted along with assertions made by journalists themselves. <\/p>\n\n
Coding Team & Process for Specific Campaign-related Tone Coding<\/strong>
A team of five of PEJ\u2019s experienced coders worked with a coding administrator in order to complete the specific tone coding for the campaign stories. Of the five coders, all but one had previously coded for tone in a previous PEJ campaign study.<\/p>\n\n