The following incisive and informative responses to our questions about the evolution of human agency by 2035 represent some of the big ideas shared by a small selection of the hundreds of thought leaders who participated in this canvassing.<\/p>\n\n\n\n
Mike Liebhold<\/strong>, retired distinguished fellow at the Institute for the Future, wrote, \u201cBy 2035 successful AI and robotic \u2018full\u2019 autonomous \u2018control\u2019 of \u2018important\u2019 decisions will be employed only in secure and well-managed and controlled applications of highly refined generations of applied machine intelligence, where any autonomous processes are managed and operated carefully, by highly skilled workforces, with high degrees of systems literacies.<\/p>\n\n\n\n \u201cWhile there will be gradually widespread adoption of AI augmentation (not necessarily replacement) of human decisions by applied AI and machine learning deeply embedded in hardware and digital services, in most cases [the use] of fully autonomous systems will only gradually be successfully applied. It will still be constrained by evolved versions of the same systemic vulnerabilities [of current systems], including pervasive digital security vulnerabilities and continued tensions of targeted personalization and privacy surveillance.<\/p>\n\n\n\n \u201cComplexity is a continuing challenge. Computing technology is enabling far more capabilities than humans can understand and use effectively. It\u2019s a form of cognitive dissonance like an impedance mismatch in electronic connections. Given the explosive availability of potentially useful data and structured knowledge resources and promising but immature data fusion, AI, and cloud computing capabilities, many years of work ahead will be needed to design systems that somehow systematise and simplify the complexity of AI machines to reliably summarise, explain and amplify capabilities to growing but still limited useful datasets for human cognitive capabilities and focused tasks.\u201d<\/p>\n\n\n\n David J. Krieger<\/strong>, director of the Institute for Communication and Leadership in Lucerne, Switzerland, predicted, \u201cIndividual agency is already a myth, and this will become increasingly obvious with time. The problem here is not technological, but ideological. Humanism attempts to preserve the myth of individual agency and enshrine it in law. Good design of socio-technical networks will need to be explicit about its post-humanist presuppositions in order to bring the issue into public debate. Humans will act in partnership \u2013 that is, distributed agency \u2013 with technologies of all kinds. Already this is so, and it will be more so in the future.<\/p>\n\n\n\n Individual agency is already a myth, and this will become increasingly obvious with time. The problem here is not technological, but ideological. <\/p>David J. Krieger, director of the Institute for Communication and Leadership in Lucerne, Switzerland<\/cite><\/blockquote><\/figure>\n\n\n\n \u201cIn a data-driven society, all decisions on all levels and in all areas, business, health care, education, etc., will need to be evidence-based and not based on position in a hierarchy, or intuition, gut feeling, experience, etc. The degree of automation is secondary to the principle of evidence-based decision-making. When sufficient evidence is available, the level of automation will increase. Also, constraints of time and space will condition the level of automation.<\/p>\n\n\n\n \u201cNo decisions will be left to individual agency since there is no such thing. Even decisions about who to marry, what to study, what job to take, what therapy is appropriate, etc., will be assisted by automated data evaluation. Society will no longer be \u2018human\u2019 but instead \u2018sociotechnical.\u2019 Already there is no such thing as human society, for without technology there would be no society as we know it. The problem is that our current political and social ideologies do not acknowledge this fact and continue to portray a mythical version of the social and the human.\u201d<\/p>\n\n\n\n Rakesh Khurana<\/strong>, professor of sociology and professor of leadership development at Harvard University, responded, \u201cIt is easier for many people to imagine the end of the world than it is for them to imagine the end of capitalism. People tend to be submissive to machines or any source of authority. Most people don\u2019t like to think for themselves but rather like the illusion that they are thinking for themselves.<\/p>\n\n\n\n \u201cConsider, for example, how often people follow GPS instructions even when instinct suggests they are going in the wrong direction. In politics or consumption, people often outsource their decision-making to what their friends \u2018like\u2019 on Facebook or the songs Pandora chooses, even if it is against their interests or might expose them to new ideas or music.<\/p>\n\n\n\n \u201cIn most instances, even without machines, there is a strong tendency among humans to rely on scripts and taken-for-granted unquestioned assumptions for their actions. Whether these scripts come from \u2018society\u2019 (a type of programmed machine) or an algorithm seems to be a difference of degree, not kind. For example, many people believe they have no agency in addressing problems linked to capitalism, human-caused climate change or any other \u2018system\u2019 that seems to exist outside of human control, even though these phenomena are designed and perpetuated by humans.\u201d<\/p>\n\n\n\n Leiska Evanson<\/strong>, a Caribbean-based futurist and consultant, observed, \u201cMachines allow \u2018guilt-free decision-making\u2019 along the lines of what the Nuremburg trials revealed about armies\u2019 chains of command. Many will revel in such \u2018freedom\u2019 from decision burden and happily blame \u2018the machine\u2019 instead of their choice to trust the machine \u2013 much as they have blamed television, social media and videogames for human failings. Programmers and computer scientists do not trust humans. Humans do not trust humans.<\/p>\n\n\n\n \u201cVery simply, human programming of AI currently relies on reducing specific human input points to reduce the fallacy of \u2018organic beings\u2019 \u2013 twitches, mistakes, miscalculations or bias. It has been known for at least a century how cameras, infrared and other visual\/light-based technology do not capture darker skin tones well, yet this technology is being used for oxygen sensors, security cameras, facial recognition yielding the same mistakes and leading to incorrect incarceration, poor medical monitoring and death.\u201d<\/p>\n\n\n\n Richard Watson<\/strong>, author of \u2018Digital vs. Human: How We\u2019ll Live, Love and Think in the Future<\/a>,\u2019 commented, \u201c2035 is a bit early for humans to fall into deeper dependence on machine \u2018intelligence\u2019 \u2013 for that, 2045 is more likely. In 2035 humans will simply cooperate and collaborate with machines, and we will still trust human judgment ahead of AIs in important cases. This isn\u2019t to say that the tech companies won\u2019t try to remove individuals\u2019 agency though, and the work of Shoshana Zuboff<\/a> is interesting in this context. How might automated decision-making change human society? As Zuboff asks: Who decides? Who is making the machines and to what ends? Who is responsible when they go wrong? What biases will they contain? I think it was Sherry Turkle<\/a> who asked whether machines that think could lead us to becoming humans who don\u2019t. That\u2019s a strong possibility, and we can see signs of it already.\u201d<\/p>\n\n\n\n Sean McGregor<\/strong>, technical lead for the IBM Watson AI XPRIZE and machine learning architect at Syntiant, said, \u201cThe people in control of automated decision-making will not necessarily be the people subject to those decisions. The world in 2022 already has autonomous systems supervised by people at credit-rating agencies, car companies, police, corporate HR departments and more. How might<\/em> the broadening and accelerating rollout of tech-abetted, often autonomous decision-making change human society? We will better appreciate the importance of random chance. Non-random computers mean you will not discover the unexpected, experience and learn from what you don\u2019t prefer, and grow beyond the bubble of algorithmically protected comfort. We will need to find new ways to look beyond ourselves and roll the dice of life.\u201d<\/p>\n\n\n\n Systems powered by AI will not<\/em> be designed to allow people to easily be in control over decision-making. The reigning paradigm for both basic research and industrial product design in AI is to strive to develop AI systems\/models that meet or exceed human-level performance.<\/p>Rob Reich, professor of political science and director of the Center for Ethics in Society at Stanford University<\/cite><\/blockquote><\/figure>\n\n\n\n Rob Reich<\/strong>, professor of political science and director of the Center for Ethics in Society at Stanford University, said, \u201cSystems powered by AI will not<\/em> be designed to allow people to easily be in control over decision-making. The reigning paradigm for both basic research and industrial product design in AI is to strive to develop AI systems\/models that meet or exceed human-level performance. This is the explicit and widely accepted goal of AGI, or artificial general intelligence. This approach sets AI on a course that leads inexorably to the diminishment or replacement of human agency.\u201d<\/p>\n\n\n\n Jean Seaton<\/strong>, director of the Orwell Foundation and professor of media history at the University of Westminster, said, \u201cAlready we can see the impact of new, apparently \u2018democratic\u2019 ways of communicating on political choices on political structures. The manipulability of apparently technical systems has already moved the world dramatically away from a wider human agency. The willingness \u2013 particularly of authoritarian states \u2013 to monitor but also \u2018please\u2019 people and manipulate understanding depends on these systems. The hostility toward expertise seen today, the politicization of every critical issue, and more \u2013 these are all manipulable. What political systems do well out of this?<\/p>\n\n\n\n \u201cIn the future, very few people may have agency. How will they use it? Fear and anxiety are proper responses to the challenges we face. For one, the existential threat of climate extinction is about to be fogged by the initial waves of refugees from soon-to-be uninhabitable places \u2013 Delhi? Central and South Africa? Afghanistan and Pakistan? Mis-, dis- and mal-information succeed as distractions, and human agency is wasted on small revenges rather than solving the long-term challenges that must be addressed now.\u201d<\/p>\n\n\n\n Devin Fidler<\/strong>, futurist and founder of Rethinkery Labs, commented, \u201cTurning over decisions to digital agents ultimately has the same downsides as turning over decisions to human agents and experts. In many ways, digital tools to support decision-making are upgrades of old-fashioned bureaucracies. For one thing, it can be easy to forget that, like digital systems, bureaucracies are built around tiered decision trees and step-by-step (algorithmic) processes. Indeed, the reason for both bureaucracy and digital agents is ultimately the same \u2013 humans have bounded attention, bounded time, bounded resources to support decision-making, and bounded information available. We turn over our agency to others to navigate these limitations. Importantly, however, we still need to establish the equivalent of a clear equivalent to the principle of \u2018fiduciary duty\u2019 that covers the majority of digital agents designed to act on our behalf.\u201d<\/p>\n\n\n\n Kunle Olorundare<\/strong>, Vice President, Internet Society, Nigeria Chapter, wrote, \u201cBy 2035, bots with high-level intelligence will take over most human decisions \u2013 key decisions in engineering design, finance, logistics tracking, the triggering of alerts about threats to public safety\/the environment, and more. However, at the same time, human decisions will still be relevant even if seemingly relegated to the background. For example, ethical issues in engineering will still be taken on by humans because they require making relative arguments for and against. Our society will be changed for good with integrated bots taking on most movement logistics decisions. There will be safer traffic practices on our roads, in the sky and on the ocean.<\/p>\n\n\n\n \u201cOther important places in which autonomous systems and the Internet of Things will play roles in resolving complex problems are in hospitals \u2013 for diagnosis and other tasks \u2013 and in agriculture, where data analytics and unmanned aerial vehicles will be useful in all aspects of farming and food distribution. These autonomous systems will operate on a secured internet that allows for secure dissemination of relevant data for informed decisions based on analytics.\u201d<\/p>\n\n\n\n Michael Wollowski<\/strong>, professor of computer science, Rose-Hulman Institute of Technology, and associate editor of AI Magazine, said, \u201cIn order to ensure wide acceptability of digital systems, the users need to be in charge of any decision made, whether having a seemingly large impact or an apparent small impact. Those systems need to be engineered to work as a pleasant assistant to the user, just as a personal assistant might be, and a user must be able to override any decision for any reason. The system, just like the driving directions given by a navigation system, will continuously replan.<\/p>\n\n\n\n In order to ensure wide acceptability of digital systems, the users need to be in charge of any decision made, whether having a seemingly large impact or an apparent small impact.<\/p>Michael Wollowski, professor of computer science, Rose-Hulman Institute of Technology, and associate editor of AI Magazine<\/cite><\/blockquote><\/figure>\n\n\n\n \u201cGiven that most humans are creatures of habit, all decisions that can be automated based on learning a human\u2019s habits will be automated. Such systems should take into consideration human input, and they should ask the user whether they are sure they really want to go through with a decision that the system deems to have a significant impact. That type of decision depends on the person; what I consider a high-impact decision, my next-door neighbor may not care about. The system has to learn each user\u2019s preferences. Digital systems will let those willing to adopt them live a life of \u2018luxury.\u2019 Just as people with means employ gardeners, nannies, housekeepers, pool boys, personal assistants, etc., these systems will assume many of those subservient roles and free users of many tedious chores.\u201d<\/p>\n\n\n\n Douglas Rushkoff<\/strong>, digital theorist and host of the NPR One podcast \u201cTeam Human<\/a>,\u201d wrote, \u201cThe incentives structure of Western civilization would have to be changed from profit to mutual flourishing in order for any technology development company to choose to design technologies that augment human control. I do believe we could easily shift the emphasis of technology development from control-over-others to augmentation of agency, but this would require a radical shift in our cultural value system. I don\u2019t believe that billions of dollars will be spent on a counter-narrative until such a shift were to occur. It\u2019s also hard to imagine scenarios years in the future without also taking into account mass migrations, the rise of authoritarianism, climate change and global health catastrophe. So, are we talking about the \u2018key decisions\u2019 of 6 billion climate refugees, or those of 200,000 corporate executives?\u201d<\/p>\n\n\n\n Bill Woodcock<\/strong>, executive director of Packet Clearing House, commented, \u201cThe unholy trinity of the surveillance economy, pragmatic psychology and machine learning have dug us into a hole. They are convincing us to dig ever faster, and they are making us believe that it\u2019s our own bright idea. I don\u2019t see us getting out of this hole as long as the automated exploitation of human psychological weaknesses continues to be permitted. I\u2019m very pessimistic about the balance of beneficial outcomes between humans and autonomous systems based on our track record thus far.<\/p>\n\n\n\n \u201cFor the first time in human history, we\u2019ve created a stand-alone system which predates people and has its own self-contained positive feedback loops driving it toward increased scale. What\u2019s particularly problematic is that the last 40 years of investigation of human psychology have revealed how easily people can be externally directed and how much work their brains will do to rationalize their actions as having been self-determined. Everyone wants<\/em> to believe that they always have free will \u2013 that they always make their own choices based on rational processes \u2013 so they\u2019ll do all of the work necessary to convince themselves of that while simultaneously opening their wallets to pay for more GPUs that further direct their own, and others\u2019 behavior.\u201d<\/p>\n\n\n\n Steven Sloman<\/strong>, a cognitive scientist at Brown University whose research focus is how people think, reason, make decisions and form attitudes and beliefs, commented, \u201cThe main changes I expect in human society are the standardization of routine decisions as AI takes them over and the uses of AI advice that make even unique decisions much more informed.<\/p>\n\n\n\n \u201cHanding routine decisions over to AI will make many life decisions that are made repeatedly more reliable, easy to justify and more consistent across people. This approach could be applied everywhere in society, e.g., automating rulings in sports contests and other aspects of life. Should we interpret this type of radiology image as a tumor? Does a mechanic need to look at my car? Is it time for a new roof? Will student essays be graded automatically?<\/p>\n\n\n\n \u201cMy guess would be a bifurcation in class within society: Public schools with large demands will rely on automatic grading; private schools that demand a lot of tuition will not. Efficiency will trade off with cost, with the result that richer students will learn to express themselves with more freedom, less constrained by the less flexible, less insightful criteria of AI.<\/p>\n\n\n\n \u201cMany difficult, unique decisions, though, involve large amounts of uncertainty and disagreement about objectives. Such decisions will never be handed over to AI. Doing so would reduce the justifiability of the decisions and put the responsible individuals in jeopardy. They will certainly be aided<\/em> by AI, but I don\u2019t see handing decision-making over to them entirely. Should my country go to war? Who should I vote for? Even, is it time to buy a new dishwasher? Or what TV show should I watch tonight? All of these questions involve either enormous uncertainty about outcomes or large disagreements about values, and people will always want to make the final decision.\u201d<\/p>\n\n\n\n Laurie L. Putnam<\/strong>, educator and communications consultant, commented, \u201cIf you look at where we are now and plot the trajectory of digital \u2018tools,\u2019 it looks like we\u2019re going to land in a pretty dark place. Yes, digital technologies can do a lot of good in the world, but when they are created to improve a bottom line at any cost, or to control people through surveillance, then that is what they will do.<\/p>\n\n\n\n \u201cIf we want to alter our course and land in a better place, we will need to reinvent the concept of consumer protection for the information age. That will require thoughtful, well-informed human decision-making \u2013 now, not years from now \u2013 in legislative policies, legal standards and business practices. These are the checks and balances that can help move us in the right direction. Already we would be hard-pressed to live our lives without using digital technologies, and already we cannot use those phones and apps and cars and credit cards without having every bit of data we generate \u2013 every action we take, every purchase we make, every place we go \u2013 hoovered up and monetized. There is no way to opt out. Already we are losing rather than gaining control over our personal data, our privacy, our lives.\u201d<\/p>\n\n\n\n Gary A. Bolles<\/strong>, chair for the future of work at Singularity University and author of \u201cThe Next Rules of Work<\/a>,\u201d predicted, \u201cInnovators will continue to create usable, flexible tools that will allow individuals to more easily make decisions about key aspects of their lives and about the technologies they use. There\u2019s also a high probability that 1) many important decisions will be made for<\/em> people, by technology, without their knowledge, and 2) the creators of media and information platforms will lead the arms race, creating tools that are increasingly better at hacking human attention and intention, making implicit decisions for people and reaping the data and revenue that comes from those activities.<\/p>\n\n\n\n \u201cFirst, every human needs education in what tech-fueled decision-making is and what decisions tech can and does make on its own. Second, tech innovators need a stringent code of ethics that requires them to notify humans when decisions are made on their behalf, tells them the uses of related data and tells how the innovator benefits from the use of their tools. Finally, industry needs open protocols that allow users to manage dashboards of aggregated decisions and data to provide transparent information that allows users (and their tools) to know what decisions technology is making on their behalf, empowering them to make better decisions.\u201d<\/p>\n\n\n\n Richard Ashcroft<\/strong>, deputy dean and professor of bioethics at City University of London Law School, an expert on AI and ethics in health care, commented, \u201cI am not optimistic because designing in human agency to AI\/ML [machine learning] based systems is not easy from an engineering point of view, plus the industry and most of academia is mainly focused on \u2018quick wins,\u2019 \u2018low-hanging fruit\u2019 and gaining competitive advantage in so doing.<\/p>\n\n\n\n \u201cThere\u2019s also a strong tendency in the field to look for the advantages that \u2018cutting out\u2019 human agency, cognitive biases and other \u2018failures of rationality\u2019 bring, so I don\u2019t think there is much appetite for designing human agency into these systems, outside the rather narrow field of \u2018AI ethics,\u2019 and the general debate in that area is more about assuring us that AI is safe, rather than looking for ways to make it so. A third point: Only some of these problems are specific to AI\/ML systems; many of the issues were already<\/em> built into complex socio-technical systems, such as state bureaucracy, precisely to eliminate individual discretion because of issues around efficiency, avoidance of corruption and personal bias and so on. Also, any sufficiently complex system has \u2018control problems\u2019 that become problems of causal efficacy and epistemology. Humans have influence over such systems, but the effects of such influence are not always predictable or even desirable, from the point of view of the purposes built into such systems.\u201d<\/p>\n\n\n\n Leah Lievrouw<\/strong>, professor of information studies at UCLA, wrote, \u201cWho exactly has \u2018agency\u2019? According to the June 11, 2022, cover feature on AI in The Economist<\/a>, the only \u2018designers\u2019 \u2013 organizations? individuals? \u2013 with the cash and brute-force computing capabilities to create the newest \u2018foundational AI\u2019 are huge, private for-profits, with one or two nonprofits like OpenAI being supported by the private firms; there are also a few new startups attempting \u2018responsible\u2019 or \u2018accountable\u2019 algorithms. So, there\u2019s the agency of designers (will they design for user control?) and the agency of users (decision-making based on what AI presents them?).<\/p>\n\n\n\n \u201cDecision-making may not be the only aspect of agency involved. The \u2018machine-human\u2019 relationship binary has been around in popular culture for ages, but I think the current thinking among AI designers goes way beyond the one-to-one picture. Rather, AI will be integrated into many different digital activities for lots of reasons, with ripple effects and crossovers likely. Thus, there\u2019s unlikely to be a bright-line division between machine decisions and human decisions, both for technical reasons and because who, exactly, is going to declare where the line is? Employers? Insurers\/finance? State agencies? Legislatures? Any entity deploying AI will want to use it to the greatest extent possible unless specifically enjoined from doing so, but right now (except maybe in the EU\u2026?) it seems to me that few regulators or organizations are there yet. We already see some very worrisome outcomes, for example, algorithmic systems used in legal sentencing.\u201d<\/p>\n\n\n\n Jonathan Grudin<\/strong>, a principal researcher at Microsoft and affiliate professor at the University of Washington Information School, observed, \u201cPeople won\u2019t control a lot of important decision-making in the year 2035. We\u2019re already losing control. A few current examples:<\/p>\n\n\n\n \u201cOur sense of control is increasingly illusory. Algorithms that support management and marketing decisions in some organizations operate on a scale too extensive for humans to validate specific decisions. Unless the machine stops, this will spread by 2035, and not just a little.\u201d<\/p>\n\n\n\n Michael G. Dyer<\/strong>, professor emeritus of computer science at UCLA, wrote, \u201cThe smartest humans create the products of convenience that the rest of us use on a daily basis. A major goal of those smartest humans is to a product easily usable without the user having to understand how the product works or how it was constructed. I turn on a flat-screen TV and use its controls to navigate the internet without having to understand its internal structure or manufacture. I get into a car and drive it in similar fashion. Many extremely important decisions are being made without input from a majority of humans. Heads of major tech companies make key decisions about how their products will affect the public (examples: in terms of surveillance and info gathering on their consumers) without supplying much if anything in the way of human agency. While we will remain in control of products of convenience in 2035 (that\u2019s what makes them convenient), we will continue to lose control in terms of major command-and-control systems of big tech and government. In fact, major tech-driven decisions affecting the rest of us are being made by smaller and smaller groups of humans.\u201d<\/p>\n\n\n\n Kenneth A. Grady<\/strong>, futurist and consultant on law and technology and editor of The Algorithmic Society newsletter, observed, \u201cAs we turn over more decisions to computers, we have seen choice diminish. Variety no longer is the spice of life. We have already reached a point where humans have relinquished important aspects of decision-making to computers. By broadening and accelerating the rollout of decision-making through computers rather than humans, we risk accelerating society\u2019s movement toward the mean on a range of matters. We will drive out the unique, the outlier, the eccentric in favor of pattern behavior. The irony of this approach lies in its contradiction of nature and what got us to this point. Nature relies on mutations to drive adaptation and progress. We will retard our ability to adapt and progress. We have seen already the early indications of this problem.\u201d<\/p>\n\n\n\n Ginger Paque<\/strong>, an expert in and teacher of internet governance with the Diplo Foundation, commented, \u201cWe are facing serious challenges today: pandemics, war, discrimination, polarizations, for example. It\u2019s impossible to predict what kind of or level of civilization will prevail 13 years from now. AI will continue to be designed, coded and controlled by profit-seeking companies who have a vested interest in shaping and controlling our decision-making processes. So, it is not AI that controls our decisions, it is other humans who use the powerful resources of AI. Autonomous decision-making is directed by some agency, most often a profit-making entity that logically has its profit as a priority. Whoever writes the code controls the decision-making and its effects on society. It\u2019s not autonomous, and we should have clear and transparent options to ensure we do not continue to cede control to known or unknown entities without proper awareness and transparency. It\u2019s not AI that\u2019s going to take humans\u2019 decision-making faculties away any more than phones and GPS ruin our memories. Humans choose \u2013 quite often without the proper awareness, information and training \u2013 to do so.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":" The following incisive and informative responses to our questions about the evolution of human agency by 2035 represent some of the big ideas shared by a small selection of the hundreds of thought leaders who participated in this canvassing. Success of AI systems will remain constrained due to their inherent complexity, security vulnerabilities and the […]<\/p>\n","protected":false},"author":377,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"sub_headline":"","sub_title":"","_crdt_document":"","_prc_public_revisions":[],"_ppp_expiration_hours":0,"_ppp_enabled":false,"ai_generated_summary":"","relatedPosts":[],"reportMaterials":[],"multiSectionReport":[],"package_parts__enabled":false,"package_parts":[],"_prc_fork_parent":0,"_prc_fork_status":"","_prc_active_fork":0,"datacite_doi":"","datacite_doi_citation":"","_prc_seo_qr_attachment_id":0,"spoken_article_player_enabled":true,"bylines":[],"acknowledgements":[],"displayBylines":true,"footnotes":"","prc_watchers":[]},"categories":[],"tags":[],"bylines":[],"collection":[],"datasets":[],"level_of_effort":[],"primary_audience":[],"information_type":[],"_post_visibility":[2643],"formats":[458],"_fund_pool":[],"languages":[],"regions-countries":[],"research-teams":[526],"workflow-status":[],"class_list":["post-92647","post","type-post","status-publish","format-standard","hentry","_post_visibility-hidden-on-index","formats-report","research-teams-internet"],"label":false,"post_parent":92651,"word_count":4978,"canonical_url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/a-sampling-of-overarching-views-on-human-agency\/","art_direction":{"A1":{"id":114459,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2023\/02\/PI_23.02.23_AIHumanAgency_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2023\/02\/PI_23.02.23_AIHumanAgency_featured.png?w=564&h=317&crop=1","width":564,"height":317,"caption":"(Chainarong Prasertthai\/Getty Images)","chartArt":false},"A2":{"id":114459,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2023\/02\/PI_23.02.23_AIHumanAgency_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2023\/02\/PI_23.02.23_AIHumanAgency_featured.png?w=268&h=151&crop=1","width":268,"height":151,"caption":"(Chainarong Prasertthai\/Getty Images)","chartArt":false},"A3":{"id":114459,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2023\/02\/PI_23.02.23_AIHumanAgency_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2023\/02\/PI_23.02.23_AIHumanAgency_featured.png?w=194&h=110&crop=1","width":194,"height":110,"caption":"(Chainarong Prasertthai\/Getty Images)","chartArt":false},"A4":{"id":114459,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2023\/02\/PI_23.02.23_AIHumanAgency_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2023\/02\/PI_23.02.23_AIHumanAgency_featured.png?w=268&h=151&crop=1","width":268,"height":151,"caption":"(Chainarong Prasertthai\/Getty Images)","chartArt":false},"XL":{"id":114459,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2023\/02\/PI_23.02.23_AIHumanAgency_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2023\/02\/PI_23.02.23_AIHumanAgency_featured.png?w=720&h=405&crop=1","width":720,"height":405,"caption":"(Chainarong Prasertthai\/Getty Images)","chartArt":false},"social":{"id":114459,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2023\/02\/PI_23.02.23_AIHumanAgency_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2023\/02\/PI_23.02.23_AIHumanAgency_featured.png?w=1200&h=628&crop=1","width":1200,"height":628,"caption":"(Chainarong Prasertthai\/Getty Images)","chartArt":false}},"_embeds":[],"watchers":[],"table_of_contents":[{"id":92651,"title":"The Future of Human Agency","slug":"the-future-of-human-agency","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/the-future-of-human-agency\/","is_active":false},{"id":92647,"title":"1. A sampling of overarching views on human agency","slug":"a-sampling-of-overarching-views-on-human-agency","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/a-sampling-of-overarching-views-on-human-agency\/","is_active":true},{"id":92631,"title":"2. Expert essays on human agency and digital life","slug":"expert-essays-on-human-agency-and-digital-life","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/expert-essays-on-human-agency-and-digital-life\/","is_active":false},{"id":92634,"title":"2. Expert essays on human agency and digital life (continued)","slug":"expert-essays-on-human-agency-and-digital-life-continued","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/expert-essays-on-human-agency-and-digital-life-continued\/","is_active":false},{"id":92663,"title":"3. Themes from those who expect tech will not be designed to allow humans to control key decision-making","slug":"themes-from-those-who-expect-tech-will-not-be-designed-to-allow-humans-to-control-key-decision-making","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/themes-from-those-who-expect-tech-will-not-be-designed-to-allow-humans-to-control-key-decision-making\/","is_active":false},{"id":92637,"title":"4. Themes from those who expect tech will be designed to allow humans to control key decision-making","slug":"themes-from-those-who-expect-tech-will-be-designed-to-allow-humans-to-control-key-decision-making","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/themes-from-those-who-expect-tech-will-be-designed-to-allow-humans-to-control-key-decision-making\/","is_active":false},{"id":92657,"title":"5. Closing thoughts on human agency","slug":"closing-thoughts-on-human-agency","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/closing-thoughts-on-human-agency\/","is_active":false},{"id":92643,"title":"About this canvassing of experts","slug":"future-of-human-agency-about-this-canvassing-of-experts","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/future-of-human-agency-about-this-canvassing-of-experts\/","is_active":false},{"id":92660,"title":"Acknowledgments","slug":"human-agency-acknowledgments","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/human-agency-acknowledgments\/","is_active":false}],"report_materials":[{"key":"_c0ro76vww","type":"report","attachmentId":114464,"url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2023\/02\/PI_2023.02.24_The-Future-of-Human-Agency_FINAL.pdf","label":"","icon":""}],"report_pagination":{"current_post":{"id":92647,"title":"1. A sampling of overarching views on human agency","slug":"a-sampling-of-overarching-views-on-human-agency","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/a-sampling-of-overarching-views-on-human-agency\/","is_active":true,"page_num":2},"next_post":{"id":92631,"title":"2. Expert essays on human agency and digital life","slug":"expert-essays-on-human-agency-and-digital-life","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/expert-essays-on-human-agency-and-digital-life\/","is_active":false,"page_num":3},"previous_post":{"id":92651,"title":"The Future of Human Agency","slug":"the-future-of-human-agency","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/the-future-of-human-agency\/","is_active":false,"page_num":1},"pagination_items":[{"id":92651,"title":"The Future of Human Agency","slug":"the-future-of-human-agency","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/the-future-of-human-agency\/","is_active":false,"page_num":1},{"id":92647,"title":"1. A sampling of overarching views on human agency","slug":"a-sampling-of-overarching-views-on-human-agency","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/a-sampling-of-overarching-views-on-human-agency\/","is_active":true,"page_num":2},{"id":92631,"title":"2. Expert essays on human agency and digital life","slug":"expert-essays-on-human-agency-and-digital-life","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/expert-essays-on-human-agency-and-digital-life\/","is_active":false,"page_num":3},{"id":92634,"title":"2. Expert essays on human agency and digital life (continued)","slug":"expert-essays-on-human-agency-and-digital-life-continued","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/expert-essays-on-human-agency-and-digital-life-continued\/","is_active":false,"page_num":4},{"id":92663,"title":"3. Themes from those who expect tech will not be designed to allow humans to control key decision-making","slug":"themes-from-those-who-expect-tech-will-not-be-designed-to-allow-humans-to-control-key-decision-making","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/themes-from-those-who-expect-tech-will-not-be-designed-to-allow-humans-to-control-key-decision-making\/","is_active":false,"page_num":5},{"id":92637,"title":"4. Themes from those who expect tech will be designed to allow humans to control key decision-making","slug":"themes-from-those-who-expect-tech-will-be-designed-to-allow-humans-to-control-key-decision-making","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/themes-from-those-who-expect-tech-will-be-designed-to-allow-humans-to-control-key-decision-making\/","is_active":false,"page_num":6},{"id":92657,"title":"5. Closing thoughts on human agency","slug":"closing-thoughts-on-human-agency","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/closing-thoughts-on-human-agency\/","is_active":false,"page_num":7},{"id":92643,"title":"About this canvassing of experts","slug":"future-of-human-agency-about-this-canvassing-of-experts","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/future-of-human-agency-about-this-canvassing-of-experts\/","is_active":false,"page_num":8},{"id":92660,"title":"Acknowledgments","slug":"human-agency-acknowledgments","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2023\/02\/24\/human-agency-acknowledgments\/","is_active":false,"page_num":9}]},"parent_info":{"parent_title":"The Future of Human Agency","parent_id":92651},"materialsOrdered":[],"chaptersOrdered":[],"partsOrdered":[],"partsEnabled":false,"datacite_doi":"","prc_seo_data":{"title":"A sampling of overarching views on human agency","description":"The following incisive and informative responses to our questions about the evolution of human agency by 2035 represent some of the big ideas shared by a small selection of the…","og_title":"1. A sampling of overarching views on human agency","og_description":"","schema_type":"Article","noindex":false,"canonical_url":"","primary_terms":{"research-teams":10814757},"custom_schema":[],"og_image":114459,"indexnow_submitted_at":null,"gsc_index_status":null},"prepublish_checks":{"prc-image-alt-text":{"status":"complete","message":"No image blocks in content.","data":null},"prc-about-this-research":{"status":"incomplete","message":"Add an \"About this research\" details block.","data":null},"prc-paragraph-count":{"status":"complete","message":"Found 42 paragraphs.","data":{"count":42}},"prc-internal-link":{"status":"incomplete","message":"Add at least one internal link.","data":{"count":0}}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"relatedPostsOrdered":[],"bylinesOrdered":[],"acknowledgementsOrdered":[],"_links":{"self":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/92647","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/users\/377"}],"replies":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/comments?post=92647"}],"version-history":[{"count":1,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/92647\/revisions"}],"predecessor-version":[{"id":126623,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/92647\/revisions\/126623"}],"wp:attachment":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/media?parent=92647"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/categories?post=92647"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/tags?post=92647"},{"taxonomy":"bylines","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/bylines?post=92647"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/collection?post=92647"},{"taxonomy":"datasets","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/datasets?post=92647"},{"taxonomy":"level_of_effort","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/level_of_effort?post=92647"},{"taxonomy":"primary_audience","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/primary_audience?post=92647"},{"taxonomy":"information_type","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/information_type?post=92647"},{"taxonomy":"_post_visibility","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_post_visibility?post=92647"},{"taxonomy":"formats","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/formats?post=92647"},{"taxonomy":"_fund_pool","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_fund_pool?post=92647"},{"taxonomy":"languages","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/languages?post=92647"},{"taxonomy":"regions-countries","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/regions-countries?post=92647"},{"taxonomy":"research-teams","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/research-teams?post=92647"},{"taxonomy":"workflow-status","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/workflow-status?post=92647"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}Society will no longer be human but instead socio-technical: \u2018Without technology there would be no \u201csociety\u201d as we know it\u2019<\/h4>\n\n\n\n
\u2018People tend to be submissive to machines or any source of authority. Most people don\u2019t like to think for themselves but rather like the illusion that they are thinking for themselves\u2019<\/h4>\n\n\n\n
\u2018Machines allow \u201cguilt-free decision-making\u201d along the lines of what the Nuremberg Trials revealed about armies\u2019 chains of command\u2019<\/h4>\n\n\n\n
Machines that think could lead us to become humans who don\u2019t think<\/h4>\n\n\n\n
\u2018The bubble of algorithmically protected comfort will force us to have to find new ways to look beyond ourselves and roll the dice of life\u2019<\/h4>\n\n\n\n
The goal for AI design is to \u2018meet or exceed human-level performance \u2026 and this leads inexorably to the diminishment or replacement of human agency\u2019<\/h4>\n\n\n\n
The manipulability of these systems has moved the world away from a wider human agency toward hostility toward expertise. \u2018In the future, very few people may have agency\u2019<\/h4>\n\n\n\n
\u2018Digital tools to support decision-making are upgrades of old-fashioned bureaucracies; we turn over our agency to others to navigate our limitations\u2019<\/h4>\n\n\n\n
Humans will be augmented by autonomous systems that resolve complex problems and provide relevant data for informed decisions<\/h4>\n\n\n\n
\u2018Digital systems will let those willing to adopt them live a life of \u201cluxury,\u201d assuming subservient roles and freeing users of many tedious chores\u2019<\/h4>\n\n\n\n
In order for Big Tech to choose to design technologies that augment human control, \u2018the incentives structure would have to be changed from profit to mutual flourishing\u2019<\/h4>\n\n\n\n
\u2018Everyone wants to believe they always have free will, and they will convince themselves of that while opening their wallets to pay for more GPUs that further direct human behavior\u2019<\/h4>\n\n\n\n
The standardization of routine decisions as AI takes them over will make many of them more reliable, easy to justify and more consistent across people<\/h4>\n\n\n\n
\u2018We need to reinvent the concept of consumer protection for the information age\u2019 and create checks and balances that move us in the right direction<\/h4>\n\n\n\n
\u2018Industry needs open protocols that allow users to manage decisions and data to provide transparent information that empowers them to know what the tech is doing\u2019<\/h4>\n\n\n\n
There\u2019s a strong tendency in tech to look for the advantages that cutting out human agency, cognitive biases and other \u2018failures of rationality\u2019 bring to complex systems<\/h4>\n\n\n\n
AI will be built into so many systems that it will be hard to draw a line between machine decisions and human decisions<\/h4>\n\n\n\n
\u2018Our sense of control is increasingly illusory; unless the machine stops, this will spread by 2035, and not just a little\u2019<\/a><\/h4>\n\n\n\n
\n
\u2018Major tech-driven decisions affecting the rest of us are being made by smaller and smaller groups of humans\u2019<\/h4>\n\n\n\n
When choice is diminished, we impede our ability to adapt and progress<\/h4>\n\n\n\n
\u2018Whoever writes the code controls the decision-making and its effects on society\u2019<\/h4>\n\n\n\n