{"id":15292,"date":"2013-10-09T14:01:45","date_gmt":"2013-10-09T19:01:45","guid":{"rendered":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/short-reads\/%year%\/%monthnum%\/%day%\/study-polls-may-underestimate-anti-gay-sentiment-and-size-of-gay-lesbian-population\/"},"modified":"2024-04-14T03:29:17","modified_gmt":"2024-04-14T08:29:17","slug":"study-polls-may-underestimate-anti-gay-sentiment-and-size-of-gay-lesbian-population","status":"publish","type":"short-read","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/short-reads\/2013\/10\/09\/study-polls-may-underestimate-anti-gay-sentiment-and-size-of-gay-lesbian-population\/","title":{"rendered":"Study: Polls may underestimate anti-gay sentiment and size of gay, lesbian population"},"content":{"rendered":"<p class=\"wp-block-paragraph\">Do conventional public opinion surveys under-report the proportion of gays and lesbians in the population? And do they underestimate the share of Americans who hold anti-gay views?<\/p>\n\n<p class=\"wp-block-paragraph\">A team of researchers from Ohio State and Boston Universities say the answer to both questions is yes.<\/p>\n\n<p>[lesbian, gay, bisexual and transgender]<\/p>\n\n\n<p class=\"wp-block-paragraph\">The study was conducted by economists Katherine B. Coffman and Lucas C. Coffman of Ohio State University and Keith M. Marzilli Ericson of Boston University.<!--more--><\/p>\n\n<p class=\"wp-block-paragraph\">They used a novel research method that, in addition to the usual privacy and anonymity afforded by the best practice survey techniques, goes further and makes it virtually impossible to connect individual respondents with their answers to sensitive questions. They call this technique the \u201cVeiled Report\u201d method.<\/p>\n\n<p class=\"wp-block-paragraph\">Then they compared their findings with the results obtained as part of the \u201cVeiled Report\u201d experiment with responses from a control group that answered questions posed in a more conventional way.\u00a0Their goal was to see how social desirability bias\u2014the tendency for people to not to reveal behaviors or attitudes that they fear may be viewed as outside the mainstream\u2014may affect reporting on these sensitive topics.<\/p>\n\n<figure><img loading=\"lazy\" decoding=\"async\" class=\"alignright size-full wp-image-250427\" alt=\"FT_13.10.08_LGBTsurvey\" src=\"https:\/\/assets.pewresearch.org\/wp-content\/uploads\/sites\/12\/2013\/10\/FT_13.10.08_LGBTsurvey.png\" width=\"420\" height=\"789\"><\/figure>\n\n<p class=\"wp-block-paragraph\">In the results using the experimental technique, self-reports of non-heterosexual identity amounted to 19% of those surveyed using the Veiled Report methods \u2013 65% higher than the 11% in the control group. The share reporting same-sex sexual experiences also grew from 17% in the control group to 27% in the Veiled Report group, they reported. (Because their experiment did not use a random sample of the adult population, the researchers do not attempt to estimate the actual size of the country\u2019s gay and lesbian population.)<\/p>\n\n<p class=\"wp-block-paragraph\">The experimental method also increased the rates of anti-gay sentiment.\u00a0 For example, the share who disapproved of having an openly gay manager at work increased from 16% in the control group to 27% in the Veiled Report group.\u00a0 The proportion who thought it should be legal to discriminate when hiring on the basis of sexual orientation also rose from 14% to 25%.<\/p>\n\n<p class=\"wp-block-paragraph\">However, those in the Veiled Report treatment were less likely than those in the Direct Report treatment to say that a homosexual person \u201ccan change their sexual orientation if they choose to do so\u201d (22% vs. 15%). As the authors suggest, \u201cThis indicates that participants saw it more socially desirable to report that sexual orientation is changeable, which goes in the opposite direction of a general \u2018pro-LGBT\u2019 norm.\u201d<\/p>\n\n<p class=\"wp-block-paragraph\">Here\u2019s how the experiment worked. Researchers went online to recruit more than 2,500 study participants. These recruits were randomly divided into two groups. Both groups took an online survey on their personal computer and never disclosed their names or other information that could identify them.<\/p>\n\n<p class=\"wp-block-paragraph\">Members of the two groups were asked eight questions about sexuality that people might be reluctant to answer truthfully, if at all. \u201cThree questions deal with participants\u2019 sexuality: whether they consider themselves heterosexual, whether they are sexually attracted to members of the same sex, and whether they have had a sexual experience with someone of the same sex,\u201d according to the researchers . \u201cThe remaining five questions examine attitudes and opinions related to sexuality\u2014participants are asked about public policy issues, such as legal recognition of same-sex marriage, as well as personal beliefs and feelings, such as being comfortable with LGBT individuals in the workplace.\u201d<\/p>\n\n<p class=\"wp-block-paragraph\">Depending on the group, the eight survey questions were asked in slightly different ways. The first group\u2014the \u201cDirect Report\u201d or control group\u2014started with a question that looked very different from those found in a standard public opinion poll.<\/p>\n\n<p class=\"wp-block-paragraph\">What they saw on their computer screen was a list of four statements and an instruction about how to answer. Here&#8217;s an example of one of the list questions used in the study the first of eight sensitive questions:<\/p>\n\n<figure><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-250433\" alt=\"FT_direct-report2\" src=\"https:\/\/assets.pewresearch.org\/wp-content\/uploads\/sites\/12\/2013\/10\/FT_direct-report2.png\" width=\"434\" height=\"489\"><\/figure>\n\n<p class=\"wp-block-paragraph\">Respondents never revealed their answers to any of the four individual questions on the list. Instead, they mentally added up their \u201cyes\u201d responses and circled entered their total.<\/p>\n\n<p class=\"wp-block-paragraph\">The remaining questions included the three that measured sexual orientation and the five that measured attitudes toward gays and lesbians. All eight appeared in a standard \u201cyes\u201d or \u201cno\u201d format as shown in the example and respondents in the control group were instructed to record their answer to each question below the question itself.<\/p>\n\n<p class=\"wp-block-paragraph\">The second group\u2014the \u201cVeiled Report\u201d group\u2014got all list questions.\u00a0 Altogether there were eight separate list questions, each of which had four more innocuous questions and one of the eight sensitive queries.<\/p>\n\n<p class=\"wp-block-paragraph\">They were again instructed to add up and record their \u201cyes\u201d responses to each one as a total. Unlike the control group, those in the Veiled Report group were never asked to record their answer to any of the individual items.<\/p>\n\n<p class=\"wp-block-paragraph\">Here\u2019s the list question asked of those in the Veiled Report group that is parallel to the one that the control group saw:<\/p>\n\n<figure><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-250434\" alt=\"FT_veiled-report2\" src=\"https:\/\/assets.pewresearch.org\/wp-content\/uploads\/sites\/12\/2013\/10\/FT_veiled-report2.png\" width=\"433\" height=\"487\"><\/figure>\n\n<p class=\"wp-block-paragraph\">The other seven sensitive questions were framed the same way: four more benign statements and a sensitive item. Each respondent in the test group saw five questions\u2014the original four and one of the three sexual identity questions and asked to total up and enter their \u201cyes\u201d responses.<\/p>\n\n<p class=\"wp-block-paragraph\">By comparing the average number of \u201cyes\u201d answers in the two groups, researchers could estimate the proportion of the respondents in the Veiled Report group that had said yes to the sensitive question measuring.<\/p>\n\n<p class=\"wp-block-paragraph\">Did the experiment work?\u00a0 You be the judge:<\/p>\n\n<p class=\"wp-block-paragraph\">\u201cIn the Direct Report treatment, 11% of the population reports that they do not consider themselves heterosexual (8% for men, 16% for women). In the Veiled Report treatment, this increases to 19% (15% for men, 22% for women). At the same time, share of participants reporting having had a sexual experience with someone of the same sex increases from 17% in the Direct Report treatment to 27% in the Veiled Report treatment, a 59% increase,\u201d they wrote.<\/p>\n\n<p class=\"wp-block-paragraph\">No significant difference was detected between the test groups on the question asking whether the respondent was attracted to members of the opposite sex.<\/p>\n\n<p class=\"wp-block-paragraph\">A cautionary note: There are many challenges in estimating the size or the composition of the LGBT population, starting with the question of whether to use a definition based solely on self-identification or whether to also include measures of sexual attraction and sexual behavior.\u00a0 For a detailed look at the demographic characteristics of the LGBT population, see <a href=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/social-trends\/2013\/06\/13\/a-survey-of-lgbt-americans\/\">A Survey of LGBT Americans<\/a> published earlier this year by the Pew Research Center.<\/p>\n\n<p class=\"wp-block-paragraph\">The study by the Ohio State and Boston University researchers, while raising questions about traditional public opinion polls, does not attempt to draw its own conclusions about size of the LGBT population or public attitudes about it since the participants were not a random or representative sample of all adults 18 and older. \u00a0(The researchers used Amazon\u2019s <a href=\"https:\/\/www.mturk.com\/mturk\/welcome\">Mechanical Turk website<\/a> to recruit participants.)<\/p>\n\n<p class=\"wp-block-paragraph\">In fact, they said their study group was younger, more educated, more politically liberal and less likely to be Republican or to describe themselves as being at least \u201cmoderately religious\u201d the country. They noted that some of the groups under-represented in their study are probably more likely to hold anti-gay views or be less willing to say that they are not heterosexual.<\/p>","protected":false},"excerpt":{"rendered":"<p>A study using a novel research method raises questions.<\/p>\n","protected":false},"author":67,"featured_media":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"sub_headline":null,"sub_title":"","_prc_public_revisions":[],"_ppp_expiration_hours":0,"_ppp_enabled":false,"ai_generated_summary":"","apple_news_api_created_at":"","apple_news_api_id":"","apple_news_api_modified_at":"","apple_news_api_revision":"","apple_news_api_share_url":"","apple_news_cover_media_provider":"image","apple_news_coverimage":0,"apple_news_coverimage_caption":"","apple_news_cover_video_id":0,"apple_news_cover_video_url":"","apple_news_cover_embedwebvideo_url":"","apple_news_is_hidden":"","apple_news_is_paid":"","apple_news_is_preview":"","apple_news_is_sponsored":"","apple_news_maturity_rating":"","apple_news_metadata":"\"\"","apple_news_pullquote":"","apple_news_pullquote_position":"","apple_news_slug":"","apple_news_sections":[],"apple_news_suppress_video_url":false,"apple_news_use_image_component":false,"relatedPosts":[],"_prc_fork_parent":0,"_prc_fork_status":"","_prc_active_fork":0,"datacite_doi":"","datacite_doi_citation":"","_prc_seo_qr_attachment_id":0,"spoken_article_player_enabled":true,"displayBylines":true,"footnotes":"","prc_watchers":[]},"categories":[218,357],"bylines":[941],"collection":[],"datasets":[],"_post_visibility":[],"formats":[467],"_fund_pool":[],"languages":[],"regions-countries":[515],"research-teams":[519],"workflow-status":[],"class_list":["post-15292","short-read","type-short-read","status-publish","hentry","category-lgbtq-attitudes-experiences","category-survey-methods","bylines-rich-morin","formats-short-read","regions-countries-united-states","research-teams-social-trends"],"label":"Short Read","post_parent":0,"word_count":1181,"canonical_url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/short-reads\/2013\/10\/09\/study-polls-may-underestimate-anti-gay-sentiment-and-size-of-gay-lesbian-population\/","art_direction":false,"_embeds":[],"watchers":[],"table_of_contents":[],"datacite_doi":"","prc_seo_data":{"title":"Study: Polls may underestimate anti-gay sentiment and size of gay, lesbian population","description":"A study using a novel research method raises questions.","og_title":"Study: Polls may underestimate anti-gay sentiment and size of gay, lesbian population","og_description":"A study using a novel research method raises questions.","schema_type":"Article","noindex":false,"canonical_url":"","primary_terms":[],"custom_schema":[],"og_image":0,"indexnow_submitted_at":null,"gsc_index_status":null},"prepublish_checks":{},"apple_news_notices":[],"jetpack_sharing_enabled":true,"relatedPostsOrdered":[],"bylinesOrdered":[{"key":"182dfe0c148e8cc2a4a455a9c1717022","termId":941}],"acknowledgementsOrdered":[],"_links":{"self":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read\/15292","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read"}],"about":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/types\/short-read"}],"author":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/users\/67"}],"replies":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/comments?post=15292"}],"version-history":[{"count":2,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read\/15292\/revisions"}],"predecessor-version":[{"id":104416,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read\/15292\/revisions\/104416"}],"wp:attachment":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/media?parent=15292"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/categories?post=15292"},{"taxonomy":"bylines","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/bylines?post=15292"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/collection?post=15292"},{"taxonomy":"datasets","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/datasets?post=15292"},{"taxonomy":"_post_visibility","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_post_visibility?post=15292"},{"taxonomy":"formats","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/formats?post=15292"},{"taxonomy":"_fund_pool","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_fund_pool?post=15292"},{"taxonomy":"languages","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/languages?post=15292"},{"taxonomy":"regions-countries","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/regions-countries?post=15292"},{"taxonomy":"research-teams","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/research-teams?post=15292"},{"taxonomy":"workflow-status","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/workflow-status?post=15292"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}