{"id":93590,"date":"2017-02-08T13:46:21","date_gmt":"2017-02-08T18:46:21","guid":{"rendered":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/2017\/02\/08\/theme-4-biases-exist-in-algorithmically-organized-systems\/"},"modified":"2024-04-14T04:17:02","modified_gmt":"2024-04-14T09:17:02","slug":"theme-4-biases-exist-in-algorithmically-organized-systems","status":"publish","type":"post","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/theme-4-biases-exist-in-algorithmically-organized-systems\/","title":{"rendered":"Theme 4: Biases exist in algorithmically-organized systems"},"content":{"rendered":"

There are two strands of thinking that tie together here. One is that the algorithm creators (code writers), even if they strive for inclusiveness, objectivity and neutrality, build into their creations their own perspectives and values. The other is that the datasets to which algorithms are applied have their own limits and deficiencies. Even datasets with millions or billions of pieces of information do not capture the fullness of people\u2019s lives and the diversity of their experiences. Moreover, the datasets themselves are imperfect because they do not contain inputs from everyone, or a representative sample of everyone. This section covers the respondent answers on both those fronts.<\/p>\n\n

Algorithms reflect the biases of programmers and datasets<\/h3>\n\n

Bias and poorly developed datasets have been widely recognized as a serious problem that technologists say they are working to address; however, many respondents see this as a problem that will not be remedied anytime soon.<\/p>\n\n

Randy Bush<\/strong>, Internet Hall of Fame member and research fellow at Internet Initiative Japan, wrote, \u201cAlgorithmic methods have a very long way to go before they can deal with the needs of individuals. So we will all be mistreated as more homogenous than we are.\u201d<\/p>\n\n

The result could be the institutionalization of biased and damaging decisions with the excuse of, \u2018The computer made the decision, so we have to accept it.\u2019\n Eugene H. Spafford<\/cite><\/p><\/blockquote>\n\n

Eugene H. Spafford<\/strong>, a professor at Purdue University, said, \u201cAlgorithmic decisions can embody bias and lack of adjustment. The result could be the institutionalization of biased and damaging decisions with the excuse of, \u2018The computer made the decision, so we have to accept it.\u2019 If algorithms embody good choices and are based on carefully vetted data, the results could be beneficial. To do that requires time and expense. Will the public\/customers demand that?\u201d<\/p>\n\n

Irina Shklovski<\/strong>, an associate professor at the IT University of Copenhagen, said, \u201cDiscrimination in algorithms comes from implicit biases and unreflective values embedded in implementations of algorithms for data processing and decision-making. There are many possibilities to data-driven task and information-retrieval support, but the expectation that somehow automatic processing will necessarily be more \u2018fair\u2019 makes the assumption that implicit biases and values are not part of system design (and these always are). Thus the question is how much agency will humans retain in the systems that will come to define them through data and how this agency can be actionably implemented to support human rights and values.\u201d<\/p>\n\n

An anonymous freelance consultant observed, \u201cBuilt-in biases (largely in favour of those born to privilege such as Western Caucasian males, and, to a lesser extent, young south-Asian and east-Asian men) will have profound, largely unintended negative consequences to the detriment of everybody else: women, especially single parents, people of colour (any shade of brown or black), the \u2018olds\u2019 over 50, immigrants, Muslims, non-English speakers, etc. This will not end well for most of the people on the planet.\u201d<\/p>\n\n

Marc Brenman<\/strong>, managing partner at IDARE, wrote, \u201cThe algorithms will reflect the biased thinking of people. Garbage in, garbage out. Many dimensions of life will be affected, but few will be helped. Oversight will be very difficult or impossible.\u201d<\/p>\n\n

Searching for images of \u2018professor\u2019 will produce pictures of white males … but to find representations of women or people of color, the search algorithm requires the user to include \u2018woman professor\u2019 or \u2018Latina professor,\u2019 which reinforces the belief that a \u2018real\u2019 professor is white and male.\nJenny Korn<\/cite><\/p><\/blockquote>\n\n

Jenny Korn<\/strong>, a race and media scholar at the University of Illinois at Chicago, noted, \u201cThe discussion of algorithms should be tied to the programmers programming those algorithms. Algorithms reflect human creations of normative values around race, gender and other areas related to social justice. For example, searching for images of \u2018professor\u2019 will produce pictures of white males (including in cartoon format), but to find representations of women or people of color, the search algorithm requires the user to include \u2018woman professor\u2019 or \u2018Latina professor,\u2019 which reinforces the belief that a \u2018real\u2019 professor is white and male. Problematic! So, we should discuss the (lack of) critical race and feminist training of the people behind the algorithm, not just the people using the algorithm.\u201d<\/p>\n\n

Adrian Hope-Bailie<\/strong>, standards officer at Ripple, noted, \u201cOne of the greatest challenges of the next era will be balancing protection of intellectual property in algorithms with protecting the subjects of those algorithms from unfair discrimination and social engineering.\u201d<\/p>\n\n

David Wuertele<\/strong>, a software engineer for a major company innovating autonomous vehicles, noted, \u201cI am optimistic that the services engineers build are capable of being free of discrimination, and engineers will try to achieve that ideal. I expect that we will have some spectacular failures as algorithms get blamed for this or that social tragedy, but I believe that we will have an easier time fixing those services than we will have fixing society.\u201d<\/p>\n\n

Eric Marshall<\/strong>, a systems architect, said, \u201cAlgorithms are tweaked or replaced over time. Similar to open source software, the good will outweigh the bad, if the right framework is found.\u201d<\/p>\n\n

Kevin Novak<\/strong>, CEO of 2040 Digital, commented, \u201cAlgorithms can lead to filtered results that demonstrate biased or limited information to users. This bias and limitation can lead to opinions or understanding that does not reflect the true nature of a topic, issue or event. Users should have the option to select algorithmic results or natural results.\u201d<\/p>\n\n

Author Paul Lehto<\/strong> observed, \u201cUnless the algorithms are essentially open source and as such can be modified by user feedback in some fair fashion, the power that likely algorithm-producers (corporations and governments) have to make choices favorable to themselves, whether in internet terms of service or adhesion contracts or political biases, will inject both conscious and unconscious bias into algorithms.\u201d<\/p>\n\n

An anonymous respondent commented, \u201cIf you start at a place of inequality and you use algorithms to decide what is a likely outcome for a person\/system, you inevitably reinforce inequalities. For example, if you were really willing to use the data that exist right now, we would tell African-American men from certain metro areas that they should not even consider going to college \u2013 it won\u2019t \u2018pay off\u2019 for them because of wage discrimination post-schooling. Is this an ethical position? No. But is it what a computer would determine to be the case based on existing data? Yes.\u201d<\/p>\n\n

And another respondent, Jeff Kaluski<\/strong>, predicted that trying to eliminate all bias may cause new problems, commenting, \u201cNew algs will start by being great, then a problem will emerge. The creator will be sued in the U.S. The alg will be corrected. It won\u2019t be good enough for the marginalized group. Someone else will create a better alg that was \u2018written in part by marginalized group\u2019 then we\u2019ll have a worse alg than the original+correction.\u201d<\/p>\n\n

Lisa Heinz<\/strong>, a doctoral student at Ohio University, said, \u201cThose of us who learn and work in human-computer areas of study will need to make sure our concerns about discrimination and the exclusionary nature of the filter-bubble are addressed in the oversight mechanisms of algorithm development. This means that all voices, genders and races need to be incorporated into the development of algorithms to prevent even unintentional bias. Algorithms designed and created only by young white men will always benefit young white men to the exclusion of all others.\u201d<\/p>\n\n

Following are additional comments by anonymous respondents regarding bias:<\/p>\n\n

Algorithms can only reflect our society back to us, so in a feedback loop they will also reflect our prejudices and exacerbate inequality.<\/p><\/blockquote>\n\n

    \n
  • \u201cThe rise of unfounded faith in algorithmic neutrality coupled with spread of big data and AI will enable programmer bias to spread and become harder to detect.\u201d<\/li>\n
  • \u201cThe positives of algorithmic analysis are largely about convenience for the comfortable; the negatives vastly outweigh them in significance.\u201d<\/li>\n
  • \u201cBias is inherent in algorithms. This will only function to make humans more mechanical, and those who can rig algorithms to increase inequality and unfairness will, of course, prevail.\u201d<\/li>\n
  • \u201cAlgorithms value efficiency over correctness or fairness, and over time their evolution will continue the same priorities that initially formulated them.\u201d<\/li>\n
  • \u201cAlgorithms can only reflect our society back to us, so in a feedback loop they will also reflect our prejudices and exacerbate inequality. It\u2019s very important that they not<\/em> be used to determine things like job eligibility, credit reports, etc.\u201d<\/li>\n
  • \u201cAlgorithms purport to be fair, rational and unbiased but just enforce prejudices with no recourse<\/em>.\u201d<\/li>\n
  • \u201cPoor algorithms in justice systems actually preserve human bias instead of mitigating it. As long as algorithms are hidden from public view, they can pose a great danger.\u201d<\/li>\n
  • \u201cHow can we expect algorithms designed to maximize \u2018efficiency\u2019 (which is an inherently conservative activity) to also push underlying social reform?\u201d<\/li>\n<\/ul>\n\n

    Algorithms depend upon data that is often limited, deficient or incorrect<\/h3>\n\n

    Some made the case that datasets upon which algorithmic decisions are made may exclude some groups of people, eliminate consumer choice and not recognize exceptions. They may include limited, skewed or incorrect detail, and the analysis based on that can cause harm. An anonymous respondent noted, \u201cUntil we begin to measure what we value rather than valuing what we measure, any insights we may gain from algorithms will be canceled out by false positives caused by faulty or incomplete data.\u201d<\/p>\n\n

    An anonymous senior program manager at Microsoft observed, \u201cBecause of inherent bias (due to a lack of diversity), many algorithms will not fully reflect the complexity of the problems they are trying to address and solutions will tend to sometimes neglect important factors. Unfortunately, it will take time until biases (or simply short-sighted thinking) baked into these algorithms will get detected. By then the American government will have banned innocent people from boarding planes, insurers will have raised premiums for the wrong people, and \u2018predictive crime prevention\u2019 will have gotten out of hand.\u201d<\/p>\n\n

    Real life does not always mimic mathematics. Algorithms have a limited number of variables, and often life shows that it needs to factor in extra variables.\nMasha Falkov<\/cite><\/p><\/blockquote>\n\n

    An anonymous respondent commented, \u201cAutomated systems can never address the complexity of human interaction with the same degree of precision as a person would.\u201d And artist Masha Falkov<\/strong> said, \u201cReal life does not always mimic mathematics. Algorithms have a limited number of variables, and often life shows that it needs to factor in extra variables. There should always be feedback in order to develop better variables and human interaction when someone falls through the cracks of the new normalcy as defined by the latest algorithm. A person may be otherwise a good person in society, but they may be judged for factors over which they do not have any control.\u201d<\/p>\n\n

    Randy Albelda<\/strong>, an economics professor at the University of Massachusetts-Boston, replied, \u201cMy research is on poor people. I\u2019ve been doing this for a long time (close to 30 years). And no matter how much information, data, empirical evidence that is presented about poor people, we still have horrible anti-poverty policies, remarkable misconceptions about poor people, and lots more poor people. Collecting and analyzing data does not \u2018set us free.\u2019 \u2018Facts\u2019 are convenient. Political economic forces shape the way we understand and use \u2018facts\/data\u2019 as well as technology. If we severely underfund health care or much of health care dollars get sucked up by insurance companies, algorithms will be used to allocate insufficient<\/em> dollars on patients. It will not improve health care.\u201d<\/p>\n\n

    Will Kent<\/strong>, an e-resources specialist on the staff at Loyola University-Chicago, observed, \u201cAny amount\/type of discrimination could occur. It could be as innocent as a slip-up in the code or a mistranslation. It could be as nefarious as deliberate suppression, obfuscation or lie of omission.\u201d<\/p>\n\n

    An anonymous respondent said, \u201cI don\u2019t think we understand intersectionality enough to engineer it in an algorithm. As someone who is LBGTQ, and a member of a small indigenous group who speaks a minority language, I have already encountered so many \u2018blind spots\u2019 online \u2013 but who do you tell? How do you approach the algorithm? How do you influence it without acquiescing?\u201d<\/p>\n\n

    Hume Winzar<\/strong>, an associate professor of business at Macquarie University in Sydney, Australia, wrote, \u201cBanks, governments, insurance companies, and other financial and service providers will use whatever tools they can to focus on who are risks. It\u2019s all about money and power.\u201d<\/p>\n\n

    [subtle]<\/p>\n\n\n

    A dictatorship like that in Orwell\u2019s 1984<\/em> would love to have control over the algorithms selecting information for the public or for subsectors of the public. If information is power, then information control is supreme power.\nM.E. Kabay<\/cite><\/p><\/blockquote>\n\n

    M.E. Kabay<\/strong>, a professor of computer information systems at Norwich University in Vermont, said, \u201cA dictatorship like that in Orwell\u2019s 1984<\/em> would love<\/em> to have control over the algorithms selecting information for the public or for subsectors of the public. If information is power, then information control is supreme power. Warning bells should sound when individualized or group information bubbles generated by the selective algorithms diverge from some definition of reality. Supervisory algorithms should monitor assertions or information flows that deviate from observable reality and documentary evidence; the question remains, however, of whose reality will dominate.\u201d<\/p>\n\n

    An anonymous professor at the University of California-Berkeley observed, \u201cAlgorithms are, by definition, impersonal and based on gross data and generalized assumptions. The people writing algorithms, even those grounded in data, are a non-representative subset of the population. The result is that algorithms will be biased toward what their designers believe to be \u2018normal.\u2019 One simple example is the security questions now used by many online services. E.g., what is your favorite novel? Where did your spouse go to college? What was your first car? What is your favorite vacation spot? What is the name of the street you grew up on?\u201d<\/p>\n\n

    An anonymous respondent commented, \u201cThere is a lot of potential for abuse here that we have already seen in examples such as sentencing for nonviolent offences. Less-well-off and minority offenders are more likely to serve sentences or longer sentences than others whose actions were the same. We also see that there is a lot of potential for malicious behaviour similar to the abuses corrected previously when nasty neighbours would spread lies and get their victims reclassified for auto or other insurance rates.\u201d<\/p>","protected":false},"excerpt":{"rendered":"

    There are two strands of thinking that tie together here. One is that the algorithm creators (code writers), even if they strive for inclusiveness, objectivity and neutrality, build into their creations their own perspectives and values. The other is that the datasets to which algorithms are applied have their own limits and deficiencies. Even datasets […]<\/p>\n","protected":false},"author":117,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"sub_headline":"","sub_title":"","_prc_public_revisions":[],"_ppp_expiration_hours":0,"_ppp_enabled":false,"ai_generated_summary":"","_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"relatedPosts":[],"reportMaterials":[],"multiSectionReport":[],"package_parts__enabled":false,"package_parts":[],"_prc_fork_parent":0,"_prc_fork_status":"","_prc_active_fork":0,"datacite_doi":"","datacite_doi_citation":"","_prc_seo_qr_attachment_id":0,"spoken_article_player_enabled":true,"displayBylines":true,"footnotes":"","prc_watchers":[],"jetpack_post_was_ever_published":false},"categories":[],"tags":[],"bylines":[840,913],"collection":[],"datasets":[],"level_of_effort":[],"primary_audience":[],"information_type":[],"_post_visibility":[],"formats":[458],"_fund_pool":[],"languages":[],"regions-countries":[],"research-teams":[526],"workflow-status":[],"class_list":["post-93590","post","type-post","status-publish","format-standard","hentry","bylines-janna-anderson","bylines-lee-rainie","formats-report","research-teams-internet"],"label":false,"post_parent":93728,"word_count":2369,"canonical_url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/theme-4-biases-exist-in-algorithmically-organized-systems\/","art_direction":{"A1":{"id":117040,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/PI_2017.02.08_Algorithms_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/PI_2017.02.08_Algorithms_featured.png?w=564&h=317&crop=1","width":564,"height":317,"chartArt":false},"A2":{"id":117040,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/PI_2017.02.08_Algorithms_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/PI_2017.02.08_Algorithms_featured.png?w=268&h=151&crop=1","width":268,"height":151,"chartArt":false},"A3":{"id":117040,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/PI_2017.02.08_Algorithms_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/PI_2017.02.08_Algorithms_featured.png?w=194&h=110&crop=1","width":194,"height":110,"chartArt":false},"A4":{"id":117040,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/PI_2017.02.08_Algorithms_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/PI_2017.02.08_Algorithms_featured.png?w=268&h=151&crop=1","width":268,"height":151,"chartArt":false},"XL":{"id":117040,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/PI_2017.02.08_Algorithms_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/PI_2017.02.08_Algorithms_featured.png?w=640&h=320&crop=1","width":640,"height":320,"chartArt":false},"social":{"id":117040,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/PI_2017.02.08_Algorithms_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/PI_2017.02.08_Algorithms_featured.png?w=640&h=320&crop=1","width":640,"height":320,"chartArt":false}},"_embeds":[],"watchers":[],"table_of_contents":[{"id":93728,"title":"Code-Dependent: Pros and Cons of the Algorithm Age","slug":"code-dependent-pros-and-cons-of-the-algorithm-age","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/code-dependent-pros-and-cons-of-the-algorithm-age\/","is_active":false},{"id":93744,"title":"About this canvassing of experts","slug":"algorithms-about-this-canvassing-of-experts","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/algorithms-about-this-canvassing-of-experts\/","is_active":false},{"id":93736,"title":"Theme 1: Algorithms will continue to spread everywhere","slug":"theme-1-algorithms-will-continue-to-spread-everywhere","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/theme-1-algorithms-will-continue-to-spread-everywhere\/","is_active":false},{"id":93566,"title":"Theme 2: Good things lie ahead","slug":"theme-2-good-things-lie-ahead","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/theme-2-good-things-lie-ahead\/","is_active":false},{"id":93578,"title":"Theme 3: Humanity and human judgment are lost when data and predictive modeling become paramount","slug":"theme-3-humanity-and-human-judgment-are-lost-when-data-and-predictive-modeling-become-paramount","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/theme-3-humanity-and-human-judgment-are-lost-when-data-and-predictive-modeling-become-paramount\/","is_active":false},{"id":93590,"title":"Theme 4: Biases exist in algorithmically-organized systems","slug":"theme-4-biases-exist-in-algorithmically-organized-systems","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/theme-4-biases-exist-in-algorithmically-organized-systems\/","is_active":true},{"id":93584,"title":"Theme 5: Algorithmic categorizations deepen divides","slug":"theme-5-algorithmic-categorizations-deepen-divides","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/theme-5-algorithmic-categorizations-deepen-divides\/","is_active":false},{"id":93609,"title":"Theme 6: Unemployment will rise","slug":"theme-6-unemployment-will-rise","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/theme-6-unemployment-will-rise\/","is_active":false},{"id":93602,"title":"Theme 7: The need grows for algorithmic literacy, transparency and oversight","slug":"theme-7-the-need-grows-for-algorithmic-literacy-transparency-and-oversight","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/theme-7-the-need-grows-for-algorithmic-literacy-transparency-and-oversight\/","is_active":false},{"id":93595,"title":"Acknowledgments","slug":"algorithms-acknowledgments","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/algorithms-acknowledgments\/","is_active":false}],"report_materials":[{"key":"720f5637-1072-409b-8599-a93aa1358389","type":"report","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/wp-content\/uploads\/sites\/9\/2017\/02\/PI_2017.02.08_Algorithms_FINAL.pdf","label":"","icon":"","attachmentId":""}],"report_pagination":{"current_post":{"id":93590,"title":"Theme 4: Biases exist in algorithmically-organized systems","slug":"theme-4-biases-exist-in-algorithmically-organized-systems","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/theme-4-biases-exist-in-algorithmically-organized-systems\/","is_active":true,"page_num":6},"next_post":{"id":93584,"title":"Theme 5: Algorithmic categorizations deepen divides","slug":"theme-5-algorithmic-categorizations-deepen-divides","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/theme-5-algorithmic-categorizations-deepen-divides\/","is_active":false,"page_num":7},"previous_post":{"id":93578,"title":"Theme 3: Humanity and human judgment are lost when data and predictive modeling become paramount","slug":"theme-3-humanity-and-human-judgment-are-lost-when-data-and-predictive-modeling-become-paramount","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/theme-3-humanity-and-human-judgment-are-lost-when-data-and-predictive-modeling-become-paramount\/","is_active":false,"page_num":5},"pagination_items":[{"id":93728,"title":"Code-Dependent: Pros and Cons of the Algorithm Age","slug":"code-dependent-pros-and-cons-of-the-algorithm-age","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/code-dependent-pros-and-cons-of-the-algorithm-age\/","is_active":false,"page_num":1},{"id":93744,"title":"About this canvassing of experts","slug":"algorithms-about-this-canvassing-of-experts","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/algorithms-about-this-canvassing-of-experts\/","is_active":false,"page_num":2},{"id":93736,"title":"Theme 1: Algorithms will continue to spread everywhere","slug":"theme-1-algorithms-will-continue-to-spread-everywhere","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/theme-1-algorithms-will-continue-to-spread-everywhere\/","is_active":false,"page_num":3},{"id":93566,"title":"Theme 2: Good things lie ahead","slug":"theme-2-good-things-lie-ahead","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/theme-2-good-things-lie-ahead\/","is_active":false,"page_num":4},{"id":93578,"title":"Theme 3: Humanity and human judgment are lost when data and predictive modeling become paramount","slug":"theme-3-humanity-and-human-judgment-are-lost-when-data-and-predictive-modeling-become-paramount","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/theme-3-humanity-and-human-judgment-are-lost-when-data-and-predictive-modeling-become-paramount\/","is_active":false,"page_num":5},{"id":93590,"title":"Theme 4: Biases exist in algorithmically-organized systems","slug":"theme-4-biases-exist-in-algorithmically-organized-systems","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/theme-4-biases-exist-in-algorithmically-organized-systems\/","is_active":true,"page_num":6},{"id":93584,"title":"Theme 5: Algorithmic categorizations deepen divides","slug":"theme-5-algorithmic-categorizations-deepen-divides","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/theme-5-algorithmic-categorizations-deepen-divides\/","is_active":false,"page_num":7},{"id":93609,"title":"Theme 6: Unemployment will rise","slug":"theme-6-unemployment-will-rise","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/theme-6-unemployment-will-rise\/","is_active":false,"page_num":8},{"id":93602,"title":"Theme 7: The need grows for algorithmic literacy, transparency and oversight","slug":"theme-7-the-need-grows-for-algorithmic-literacy-transparency-and-oversight","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/theme-7-the-need-grows-for-algorithmic-literacy-transparency-and-oversight\/","is_active":false,"page_num":9},{"id":93595,"title":"Acknowledgments","slug":"algorithms-acknowledgments","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2017\/02\/08\/algorithms-acknowledgments\/","is_active":false,"page_num":10}]},"parent_info":{"parent_title":"Code-Dependent: Pros and Cons of the Algorithm Age","parent_id":93728},"materialsOrdered":[],"chaptersOrdered":[],"partsOrdered":[],"partsEnabled":false,"datacite_doi":"","prc_seo_data":{"title":"Biases exist in algorithmically organized systems","description":"There are two strands of thinking that tie together here. One is that the algorithm creators (code writers), even if they strive for inclusiveness, objectivity and neutrality, build into their…","og_title":"Theme 4: Biases exist in algorithmically-organized systems","og_description":"","schema_type":"Article","noindex":false,"canonical_url":"","primary_terms":[],"custom_schema":[],"og_image":117040,"indexnow_submitted_at":null,"gsc_index_status":null},"prepublish_checks":{"prc-image-alt-text":{"status":"complete","message":"No image blocks in content.","data":null},"prc-about-this-research":{"status":"incomplete","message":"Add an \"About this research\" details block.","data":null},"prc-paragraph-count":{"status":"complete","message":"Found 27 paragraphs.","data":{"count":27}},"prc-internal-link":{"status":"incomplete","message":"Add at least one internal link.","data":{"count":0}}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"relatedPostsOrdered":[],"bylinesOrdered":[{"key":"02c5c8c0b9eddb1c766e4868108bc73f","termId":913},{"key":"af27afbcc83ed7ba71d44ceb535676a7","termId":840}],"acknowledgementsOrdered":[],"_links":{"self":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/93590","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/users\/117"}],"replies":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/comments?post=93590"}],"version-history":[{"count":2,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/93590\/revisions"}],"predecessor-version":[{"id":136110,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/93590\/revisions\/136110"}],"wp:attachment":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/media?parent=93590"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/categories?post=93590"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/tags?post=93590"},{"taxonomy":"bylines","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/bylines?post=93590"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/collection?post=93590"},{"taxonomy":"datasets","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/datasets?post=93590"},{"taxonomy":"level_of_effort","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/level_of_effort?post=93590"},{"taxonomy":"primary_audience","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/primary_audience?post=93590"},{"taxonomy":"information_type","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/information_type?post=93590"},{"taxonomy":"_post_visibility","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_post_visibility?post=93590"},{"taxonomy":"formats","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/formats?post=93590"},{"taxonomy":"_fund_pool","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_fund_pool?post=93590"},{"taxonomy":"languages","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/languages?post=93590"},{"taxonomy":"regions-countries","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/regions-countries?post=93590"},{"taxonomy":"research-teams","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/research-teams?post=93590"},{"taxonomy":"workflow-status","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/workflow-status?post=93590"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}