An extended collection hundreds of written answers to this question can be found at: http:\/\/www.elon.edu\/e-web\/predictions\/expertsurveys\/2006survey\/autonomoustechnolgy.xhtml<\/a><\/p>\n\n Those who disagreed with this scenario generally said the humans who design technology will have no difficulty controlling it \u2013 but some noted a fear of the people who could control new technology. Those who agreed with the scenario often cited the increasing complexity of human-made systems and decreasing oversight of technology. They urged \u201chuman intervention.\u201d<\/strong> <\/p>\n\n Of course the responses to this scenario, as with all on the survey, were shaped by the experiences participants have had. Many respondents \u2013 those who disagreed and<\/i> those who agreed \u2013 were moved to react by comparing this proposed future to a science-fiction plot (\u201cThe Matrix,\u201d \u201cThe Terminator,\u201d \u201cFrankenstein\u201d). The answers were also shaped by how closely people read every word of the scenario. The group disagreeing included many engineers and computer scientists \u2013 many of them taking issue with the phrase \u201cimpossible to reverse\u201d \u2013 while many sociologists, government workers and network policy makers found some of this scenario’s points to be quite worthy of serious discussion. Again, the scenario was written to engender engaged discussion, not to propose what we see as the likeliest future.<\/p>\n\n Technology architects generally answered by saying that humans will retain control of any system they design. \u201cAgents, automated control and embedded computing will be pervasive, but I think society will be able to balance the use,\u201d wrote David Clark <\/b>of MIT.[11.numoffset=”11″ A section with more complete biographical data on most respondents who took credit for their remarks can be found at the end of this report.] \u201cWe will find these things helpful and a nuisance, but we will not lose control of our ability to regulate them.\u201d <\/p>\n\n Internet Society board chairman Fred Baker<\/b> wrote, \u201cWe will certainly have some interesting technologies. Until someone finds a way for a computer to prevent anyone from pulling its power plug, however, it will never be completely out of control.\u201d Pekka Nikander<\/b> of Ericcson Research and the Internet Architecture Board responded: \u201cAs long as the everyday weapon-backed power systems (e.g. police force) are kept in human hands, no technical change is irreversible. Such reversion may take place as a socioeconomic collapse, though.\u201d <\/p>\n\n \u201cCompletely automating these activities will continue to prove difficult to achieve in practice. I do believe that there will be new dangers and dependencies, but that comes from any new technology, especially one so far-reaching,\u201d argued Thomas Narten,<\/b> Internet Engineering Task Force liaison to ICANN, and chief of IBM\u2019s open-internet standards development. <\/p>\n\n Robert Kraut<\/b> of the Human-Computer Interaction Institute at Carnegie Mellon University, sees the development of automated systems running smoothly. \u201cCertainly intelligent agents and distributed control will automate some tasks,\u201d he wrote. \u201cBut heavy automation of tasks and jobs in the past (e.g., telephone operators) hasn’t led to ‘dangers and dependencies.’\u201c<\/p>\n\n The most dismissive reactions to the scenario came mostly from those who are involved in writing code and implementing the network. Anthony Rutkowski <\/b>of VeriSign, over the past decade a leader with the Internet Society and International Telecommunication Union, wrote: \u201cAutonomous technology is widespread today and indispensable. Characterizing it as a ‘problem’ is fairly clueless.\u201d Programmer and anti-censorship activist Seth Finkelstein <\/b>responded, \u201cThis is the AI bogeyman. It’s always around 20 years away, whatever the year.\u201d And Alejandro Pisanty, of ICANN and the Internet Society, wrote, tongue-in-cheek: \u201cThis dysfunctional universe may come true for several types of applications, on and off the network. We better start designing some hydraulic steering mechanisms back into airplanes, and simple overrides of automatic systems in cars. Not to speak about pencil-and-paper calculations to get back your life’s savings from a bank!\u201d Hal Varian<\/b> of UC-Berkeley and Google wrote, \u201cIt’s a great science fiction plot, but I don’t see it happening. I am skeptical about intelligent agents taking over anytime soon.\u201d<\/p>\n\n Leigh Estabrook, <\/b>a professor at the University of Illinois, stated: \u201cHuman beings always have control, but they often choose to give it up. For example, when the airline agent tells me I cannot do something because ‘the computer won’t allow it.’ Human beings have made choices to program that computer that way, to limit human abilities to override functions. I could also say I agree since we do seem willing to give up control to systems, and increasingly legislators and the judiciary have allowed surveillance, security, and tracking systems that would seem to me \u2013 and to many others \u2013 to be dangerous.\u201d<\/p>\n\n Marc Rotenberg, <\/b>executive director of the Electronic Privacy Information Center (EPIC), sees extreme danger in the autonomous technology scenario. \u201cThis is the single greatest challenge facing us in the early years of the 21st century,\u201d he responded. \u201cWe are constructing architectures of surveillance over which we will lose control. It’s time to think carefully about ‘Frankenstein,’ The Three Laws of Robotics, ‘Animatrix’ and ‘Gattaca.’\u201d<\/p>\n\n Amos Davidowitz<\/b> of the Institute of World Affairs, responded this way: \u201cThe major problem will be from providers and mining software that have malignant intent.\u201d His concerns about surveillance were echoed by many respondents, including Michael Dahan<\/b>, a professor at Sapir Academic College in Israel, who wrote, \u201cThings may be much worse with the increasing prevalence of RFID chips and similar technologies. Before 2020, every newborn child in industrialized countries will be implanted with an RFID or similar chip. Ostensibly providing important personal and medical data, these may also be used for tracking and surveillance.\u201d<\/p>\n\n Elle Tracy<\/b>, president and e-strategies consultant for The Results Group, suggested overconfident humans may allow this scenario to unfold. \u201cThe only reason I can agree with this is because of my first-hand experience within the technology industry,\u201d she wrote. \u201cThe people who write this code are so proud of their work \u2013 and they should be \u2013 that the rational, real-world checks and balances that should be implemented on their results fall into a second-class-citizenry level of import. Until testing, bug fixing, user interfaces, usefulness and basic application by subject matter experts is given a higher priority than pure programmer skill, we are totally in danger of evolving into an out-of-control situation with autonomous technology.\u201d<\/p>\n\n Robert Shaw,<\/b> internet strategy and policy adviser for the International Telecommunication Union, had other concerns: \u201cEven in today’s primitive networks, there is little understanding of the complexity of systems and possible force-multiplier effects of network failures,\u201d he wrote. \u201cThe science of understanding such dependencies is not growing as fast as the desire to implement the technologies.\u201d<\/p>\n\n Some respondents pointed to the fact that certain technological systems are already suffering due to a lack of well-intentioned human input throughout the processes they are built to accomplish. \u201cSystems like the power grid are already so complex that they are impossible to predictably control at all times \u2013 hence the periodic catastrophic failures of sections of grid,\u201d wrote author and social observer Howard Rheingold.<\/b> \u201cBut the complexity and interconnectedness of computer-monitored or controlled processes is only a fraction of what it will be in 15 years. Data mining of personal traces is in its infancy. Automatic facial recognition of video images is in its infancy. Surveillance cameras are not all digital, nor are they all interconnected \u2013 yet.\u201d<\/p>\n\n Douglas Rushkoff, <\/b>teacher and author of many books on net culture sees a need to take action. \u201cIf you look at the way products are currently developed and marketed,\u201d he explained, \u201cyou’d have to say we’re already there: human beings have been taken out of the equation. Human intervention will soon be recognized as a necessary part of developing and maintaining a society.\u201d <\/p>\n\n Paul Craven,<\/b> director of enterprise communications, U.S. Department of Labor, wrote: \u201cHistory has shown that as technology advances the abuse of that technology advances. History has also demonstrated that we do not control technology as much as we think we do.\u201d<\/p>\n\n Another government official, Gwynne Kostin<\/b>, director of Web communications for U.S. Homeland Security, pointed out the inadequacies of an automated system during a recent natural disaster in responding to this scenario. \u201cThis is an extension of the current status,\u201d she wrote. \u201cA suggestion for an XML standard for emergency deployments during Hurricane Katrina ignored the fact that there was no electricity, no internet access, decreasing batteries and no access to equipment that was swamped. Non-technical backups will become increasingly important \u2013 even as we keep forgetting about them. We will need to listen carefully to people on the ground to assess \u2013 and plan for \u2013 events in which we have no (or non-trustworthy) technology.\u201d<\/p>\n\n There also were concerns about inequities created by computer networks. Arent Greve<\/b>, a professor at the Norwegian School of Economics and Business Administration, wrote, \u201cThere will be a trend in this direction, not as extreme as displayed in the above scenario, but bad enough that we will experience injustice, I think that some of those systems may be reversible, others may not. I would guess a probability of about 30% that such systems develop.\u201d And David Weinberger<\/b> of Harvard’s Berkman Center wrote: \u201cDRM and ‘trusted computing’ initiatives already are replacing human judgment with algorithms that inevitably favor restricted access to the content on our own computers.\u201d <\/p>\n\n Alik Khanna<\/b> of Smart Analyst Inc. in India responded that advances in nanotechnology and robotics will build an increasing reliance on machines. \u201cWhether the development of AI will lead to self-awareness in machines, time will tell,\u201d he wrote. <\/p>\n\n \u201cI agree, but this is not a doomsday scenario,\u201d wrote Mark Gaved <\/b>of the Open University in the UK. \u201cThe development of these technologies will echo previous technologies with similar curves, unexpected developments and unauthorised appropriations by grassroots groups.\u201d <\/p>\n\n [into this scenario already]<\/p>\n\n\n Charlie Breindahl <\/b>of the IT University of Copenhagen wrote, \u201cI agree that it is a very real danger. However, I think that our present thinking about how automation and distributed computing works is na\u00efve. In the year 2020, the general public will be much more aware of how to utilize their agents and control schemes. We should see a much more ‘AI-literate’ population, if not in 2020, then in 2040.\u201d<\/p>\n\n Michael Reilly<\/b> of Globalwriters, Baronet Media, wrote, \u201cWhile a few activities could spin off course, most really problematic issues will be spotted early and repaired. Also, monitoring which alerts humans to problems will become a high-order business on its own, incorporating ‘self-healing’ networks equipped with alarms when boundaries are exceeded.\u201d<\/p>\n\n Robin Lane<\/b>, an educator and philosopher from the Universidade Federal do Rio Grande do Sul in Brazil, wrote, \u201cThe desire for convenience, for ease of use, for the removal of tedious, laborious tasks is \u2013 in my opinion \u2013 inherent in us as beings. As such we will continue to use and abuse technology to make our lives easier. The price for this is increased dependency on the technology.\u201d<\/p>\n\n Some respondents specified that humans must plan in advance to build the best outcome for an automated future. \u201cI truly do agree that there will be nearly complete automation of such boring-to-humans activity as surveillance, security and tracking systems,\u201d wrote Glenn Ricart<\/b>, a member of the Internet Society Board of Trustees and the executive director for Price Waterhouse Coopers Research. \u201cThere will clearly be unintended consequences, some of which may endanger or take human life. However, I don’t believe it will be impossible to reverse such things; indeed, we will continue to perfect them while undergirding them with something like Asimov’s Three Laws of Robotics.\u201d <\/p>\n\n \u201cThe fact that this question is being asked\/asserted suggests that it will NOT happen.,\u201d wrote Kerry Kelley<\/b> of Snapnames.com. \u201cEnough healthy paranoia exists among the people on the inside \u2013 those creating the standards \u2013 that others who might purposefully, or accidentally, unleash these kinds of problems will be effectively neutralized.\u201d<\/p>\n\n Henry Potts, <\/b>a professor at University College in London, expressed concern over potential economic impact. \u201cThe use of standard decision-making software by stock market traders has already led to effects outside of what we planned or wanted,\u201d he wrote. \u201cI don’t fear robots looking like Arnold Schwarzenegger taking over the world, but unexpected and unwanted effects of distributed control are feasible.\u201d<\/p>\n\n Jim Archuleta, <\/b>senior manager for government solutions for Ciena Corporation wrote, \u201cIn some cases, reversal of the processes will be difficult and nearly impossible. There are scenarios where processes based on automation and intelligence based on rules and identities will miss ‘outliers’ and ‘exceptions’ thereby resulting in mistakes, some of which will be life-threatening.\u201d <\/p>\n\n Lilia Efimova<\/b>, a researcher with Telematica Instituut in the Netherlands, wrote, \u201cThis is a possible scenario, so I believe there is a responsibility for internet researchers in that respect to recognize those dependencies in advance and to act on preventing dangers.\u201d<\/p>\n\n Sabino Rodriguez<\/b> of MC&S Services responded that the European Commission is already assigning \u201cstudies, proposals and investments\u201d into avoiding negative consequences of new technologies. And Sean Mead<\/b>, an internet consultant, wrote, \u201cScience fiction has warned of nearly any threat that autonomous technology can raise. There will be problems caused by autonomous tech, but, like germs provoking an immune-system response, the eventual effect of the initial damage will be to install safeguards that protect us from long-lasting damage.\u201d<\/p>\n\n Several survey participants said this scenario also presents some positive aspects. Ted Coopman,<\/b> a social science researcher and instructor at the University of Washington, sees the formation of a \u201cnew bottom-up, global, civil society\u201d thanks to autonomous technology \u201cin the form of ultra-structure capabilities that allow almost anyone to project power with little or no cost.\u201d <\/p>\n\n He continued: \u201cThe repertoires of individuals and groups will be readily available and successful or attractive ones will spread and scale rapidly. The aggregate adoption will cause huge and likely unpredictable shifts in social, political, economic arenas. People will no longer favor incumbent systems, but will move to systems that make sense to them and serve their needs. This will force incumbent systems to adapt quickly or fail. Governmental protection of incumbent corporate and social power will lose much of its effectiveness as a force of social control. These parallel systems to serve people’s needs will arise via digital networks.\u201d<\/p>\n\n Mary Ann Allison,<\/b> a futurist and chairman and chief cybernetics officer for The Allison Group, responded: \u201cWhile this scenario is clearly a danger, we don’t yet understand how powerful fully-connected human beings can be.\u201d<\/p>\n\n And Rob Atkinson,<\/b> president of the Information Technology and Innovation Foundation, and formerly director at the U.S. Congressional Office of Technology Assessment, responded, \u201cThe more autonomous agents the better. The steeper the ‘J curve’ the better. Automation, including through autonomous agents, will help boost standards of living, freeing us from drudgery.\u201d<\/p>\n\n Mark Poster,<\/b> an authority on the ways social communications have changed through the introduction of new technologies, wrote, \u201cThe issue will be how humans and information machines will form new assemblages, not how one will displace the other.\u201d <\/p>\n\n \u201cAutonomous systems will not become a serious problem until they are sophisticated enough to be conscious \u2026 As it stands now, they are simply tools \u2013 advanced tools, but tools nonetheless. True AI is still 50-100 years away,\u201d argued Simon Woodside<\/b>, CEO, Semacode Corp, Ontario, Canada.<\/p>\n\n Distributed control systems \u2013 those with remote human intervention \u2013 have long been used across the world to handle various tasks, including the operation of electrical power grids and electricity-generation plants, environmental control systems, traffic signals, chemical and refining facilities, water-management systems and many types of manufacturing. Systems are becoming more automated daily, as pervasive information networks are being invisibly woven into everything everywhere, helping us manage a world that becomes exponentially more complex each year. <\/p>\n\n Many operations are being handled by small microelectromechanical systems \u2013 better known as MEMS. Billions of these devices are already woven into our buildings, highways, and even our forests and other ecosystems; they are found in personal devices, from our automobiles to printers and cell phones. The market for MEMS hit $8 billion in 2005, with a forecast for growth to more than $200 billion by 2025, according to Joe Mallon<\/b> of Stanford University.[12.numoffset=”12″ Mallon, J. Abstract for presentation Industry and Market Overview for 4th<\/sup> annual Microelectric Engineering Packaging and Test Engineering Council Conference, May 18, 2006, http:\/\/www.meptec.org\/06_MEMS_Symposium.html<\/a>]<\/p>\n\n Some programmable, remote information devices now in use are called \u201cagents\u201d or \u201cbots.\u201d Agents automatically carry out tasks for a user: sorting email according to preference, filling out Web page forms with stored information, reporting on company inventory levels, observing changes in competitors’ prices and relaying statistics, mining data to detect specific conditions. Bots are programmed to help people who play online games perform various tasks; they are also used online to aid consumers in finding products and services \u2013 these shopping bots use collaborative filtering. <\/p>\n\n MEMS, agents and bots are self-contained tools designed and distributed by people who monitor them and replace or remove them from a network when necessary. They are autonomous to some extent in that they are capable of functioning independently to meet established human-set goals. Most of them do not possess any artificial intelligence. Intelligent agents have the ability to sense an environment and adapt to changes in it if necessary, and they have the ability to learn through trial and error or through example and generalization. MEMS, agents and bots are the reality today. In the near future, as computing and data storage become more advanced and nanotechnology and artificial intelligence systems are more nearly perfected, it is expected there will be far less direct human input in the day-to-day oversight of human-built systems.<\/p>\n\n Many of the sophisticated operational systems developed in the next few decades will be invisible or nearly so. Nanoelectromechanical systems \u2013 10,000 times smaller than the width of a hair \u2013 are being developed, and thousands of nano-related patents have already been issued. Most who predict a future that sounds a great deal like a science-fiction plot are those who see the continued development and convergence of networked nanotechnology, robotics and even genetics.<\/p>\n\n Among the seemingly \u201cextreme\u201d predictions made by various respected tech experts in various reports issued over the past few years are:<\/p>\n\n In order to prepare in advance for a future that is likely to be filled with accelerating developments related to autonomous technologies, select leaders have founded watchdog organizations, held conferences and created research projects. Among them are the Center for Responsible Nanotechnology \u2013 www.crnano.org<\/a> \u2013 and the Acceleration Studies Foundation \u2013 www.accelerating.org<\/a>. In addition, Battelle \u2013 www.battelle.org<\/a> \u2013 and the Foresight Institute – www.foresight.org<\/a> \u2013 are two major non-profit organizations conducting ongoing technology roadmap projects investigating the implications of autonomous technologies. <\/p>\n\n Respected professor and author Vernor Vinge and inventor Ray Kurzweil \u2013 author of The Singularity is Near<\/i> and a winner of the U.S. National Medal of Technology and the Lemelson-MIT Prize \u2013 have been the most vocal proponents of the idea that a \u201ctechnological singularity\u201d will occur during this century. This \u201csingularity\u201d is defined as the point at which strong artificial intelligence or the amplification of human intelligence will change our environment to an extent beyond our ability to comprehend or predict.[15.numoffset=”15″ The Singularity<\/em> – reference page on KurzweilAI.net, accessed June 5., 2006, http:\/\/www.kurzweilai.net\/meme\/frame.html?main=\/meme\/memelist.html?m%3D1<\/a>] Kurzweil has written that paradigm shifts will lead to \u201ctechnological change so rapid and profound it represents a rupture in the fabric of human history,\u201d and he says this will happen by 2045.[16. Kurzweil, R., The Singularity is Near<\/em>, New York: Viking, 2005.] <\/p>\n\n Other top thinkers see this sort of future: Robotics researcher Hans Moravec has projected that nano-scale machines equipped with AI could displace humans in the next century. Oxford philosopher Nick Bostrom wrote a 2002 essay titled \u201cExistential Risks\u201d about the likely threats presented by the Singularity. AI researcher Hugo de Garis wrote a 2005 book titled \u201cThe Artilect War: Cosmists vs. Terrans \u2013 A Bitter Controversy Concerning Whether Humanity Should Build Godlike, Massively Intelligent Machines.\u201d<\/p>\n\n The Singularity Institute for Artificial Intelligence (www.singinst.org<\/a>) was founded to further discussion of potential futures based on this idea. A great many other respected experts dispute the idea of the Singularity, including physicists Theodore Modis[17. Modis, T., The Singularity Myth<\/em>, online at http:\/\/ourworld.compuserve.com\/homepages\/tmodis\/Kurzweil.htm<\/a>] and Jonathan Huebner,[18. Adler, R., Entering a Dark Age of Innovation<\/em>, New Scientist.com, July 2, 2005, http:\/\/www.newscientist.com\/article.ns?id=dn7616<\/a>] who have argued the exact opposite \u2013 that innovation is now actually in decline.<\/p>\n\n While few respondents to the \u201cautonomous technology\u201d scenario in this survey included the \u201csingularity\u201d idea in their remarks, most said such an event will arrive long after 2020, if ever. Barry Chudakov,<\/b> principal partner in the Chudakov Company, wrote, \u201cWe will cut direct human input in a variety of human activities and this will cause problems. This is already causing problems and we’re not yet near the ‘singularity’ where we’re likely headed. However, the notion of ‘technology beyond our control’ is an alarmist construct \u2026 we are learning as we are making mistakes. So while we are hell-bent on acceleration of change, I believe we will also rethink and respond to those systems that seem to be running away from us. We have the time to understand our relationship with technology and I think we will not get lost on a dead-end J-curve.\u201d<\/p>\n\n Educational consultant Jeffrey Branzburg<\/b> wrote, \u201cAlthough I agree with the concept of a ‘J-curve’ of continued acceleration of change, as discussed in Ray Kurzweil’s The Singularity is Near<\/i>, I believe it is not a problem. The ingrained human system of checks and balances will continue to keep the potential dangers under control. (By ingrained human system of checks and balances I mean the propensity of people to resist when they believe an entity has attained a higher than desired degree of control and influence.)\u201d<\/i><\/p>\n\n Daniel Wang,<\/b> principal partner of Roadmap Associates, wrote: \u201cThis is one of the scariest consequences of our light-speed technological advancement. Hollywood fiction will become reality.\u201d<\/p>\n\n \u201cThe question has an overly dramatic spin to it, but the trend is correct,\u201d argues Paul Saffo, <\/b>director of the Institute for the Future. \u201cNow, fear of enslavement by our creations is an old fear, and a literary tritism. But I fear something worse and much more likely \u2013 that sometime after 2020 our machines will become intelligent, evolve rapidly, and end up treating us as pets. We can at least take comfort that there is one worse fate \u2013 becoming food \u2013 that mercifully is highly unlikely.\u201d<\/p>","protected":false},"excerpt":{"rendered":" Prediction and Reactions Prediction: By 2020, intelligent agents and distributed control will cut direct human input so completely out of some key activities such as surveillance, security and tracking systems that technology beyond our control will generate dangers and dependencies that will not be recognized until it is impossible to reverse them. We will be […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"sub_headline":"","sub_title":"","_prc_public_revisions":[],"_ppp_expiration_hours":0,"_ppp_enabled":false,"ai_generated_summary":"","relatedPosts":[],"reportMaterials":[],"multiSectionReport":[],"package_parts__enabled":false,"package_parts":[],"datacite_doi":"","datacite_doi_citation":"","_prc_seo_qr_attachment_id":0,"spoken_article_player_enabled":true,"displayBylines":true,"footnotes":"","prc_watchers":[],"_prc_fork_parent":0,"_prc_fork_status":"","_prc_active_fork":0},"categories":[],"tags":[],"bylines":[],"collection":[],"datasets":[],"level_of_effort":[],"primary_audience":[],"information_type":[],"_post_visibility":[],"formats":[458],"_fund_pool":[],"languages":[],"regions-countries":[],"research-teams":[526],"workflow-status":[],"class_list":["post-96620","post","type-post","status-publish","format-standard","hentry","formats-report","research-teams-internet"],"label":false,"post_parent":96590,"word_count":4057,"canonical_url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/scenario-three-autonomous-technology-is-a-problem\/","art_direction":false,"_embeds":[],"watchers":[],"table_of_contents":[{"id":96590,"title":"The Future of the Internet II","slug":"the-future-of-the-internet-ii","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/the-future-of-the-internet-ii\/","is_active":false},{"id":96598,"title":"Acknowledgments","slug":"acknowledgments-14-5","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/acknowledgments-14-5\/","is_active":false},{"id":96603,"title":"Introduction","slug":"introduction-11","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/introduction-11\/","is_active":false},{"id":96609,"title":"Scenario One: A global, low-cost network thrives","slug":"scenario-one-a-global-low-cost-network-thrives","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/scenario-one-a-global-low-cost-network-thrives\/","is_active":false},{"id":96614,"title":"Scenario Two: English displaces other languages","slug":"scenario-two-english-displaces-other-languages","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/scenario-two-english-displaces-other-languages\/","is_active":false},{"id":96620,"title":"Scenario Three: Autonomous technology is a problem\u2026","slug":"scenario-three-autonomous-technology-is-a-problem","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/scenario-three-autonomous-technology-is-a-problem\/","is_active":true},{"id":96626,"title":"Scenario Four: Transparency builds a better world, even at the expense of privacy\u2026","slug":"scenario-four-transparency-builds-a-better-world-even-at-the-expense-of-privacy","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/scenario-four-transparency-builds-a-better-world-even-at-the-expense-of-privacy\/","is_active":false},{"id":96506,"title":"Scenario Five: Virtual reality is a drain for some\u2026","slug":"scenario-five-virtual-reality-is-a-drain-for-some","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/scenario-five-virtual-reality-is-a-drain-for-some\/","is_active":false},{"id":96511,"title":"Scenario Six: The internet opens worldwide access to success\u2026","slug":"scenario-six-the-internet-opens-worldwide-access-to-success","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/scenario-six-the-internet-opens-worldwide-access-to-success\/","is_active":false},{"id":96516,"title":"Scenario 7: Some Luddites\/refuseniks will commit terror acts\u2026","slug":"scenario-7-some-ludditesrefuseniks-will-commit-terror-acts","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/scenario-7-some-ludditesrefuseniks-will-commit-terror-acts\/","is_active":false},{"id":96521,"title":"Funding Priorities: Respondents rank four suggested priorities for building the networked future","slug":"funding-priorities-respondents-rank-four-suggested-priorities-for-building-the-networked-future","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/funding-priorities-respondents-rank-four-suggested-priorities-for-building-the-networked-future\/","is_active":false},{"id":96525,"title":"Reflections","slug":"reflections","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/reflections\/","is_active":false},{"id":96529,"title":"Methodology","slug":"methodology-112-2","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/methodology-112-2\/","is_active":false},{"id":96534,"title":"Brief Biographies","slug":"brief-biographies","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/brief-biographies\/","is_active":false}],"report_materials":"","report_pagination":{"current_post":{"id":96620,"title":"Scenario Three: Autonomous technology is a problem\u2026","slug":"scenario-three-autonomous-technology-is-a-problem","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/scenario-three-autonomous-technology-is-a-problem\/","is_active":true,"page_num":6},"next_post":{"id":96626,"title":"Scenario Four: Transparency builds a better world, even at the expense of privacy\u2026","slug":"scenario-four-transparency-builds-a-better-world-even-at-the-expense-of-privacy","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/scenario-four-transparency-builds-a-better-world-even-at-the-expense-of-privacy\/","is_active":false,"page_num":7},"previous_post":{"id":96614,"title":"Scenario Two: English displaces other languages","slug":"scenario-two-english-displaces-other-languages","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/scenario-two-english-displaces-other-languages\/","is_active":false,"page_num":5},"pagination_items":[{"id":96590,"title":"The Future of the Internet II","slug":"the-future-of-the-internet-ii","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/the-future-of-the-internet-ii\/","is_active":false,"page_num":1},{"id":96598,"title":"Acknowledgments","slug":"acknowledgments-14-5","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/acknowledgments-14-5\/","is_active":false,"page_num":2},{"id":96603,"title":"Introduction","slug":"introduction-11","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/introduction-11\/","is_active":false,"page_num":3},{"id":96609,"title":"Scenario One: A global, low-cost network thrives","slug":"scenario-one-a-global-low-cost-network-thrives","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/scenario-one-a-global-low-cost-network-thrives\/","is_active":false,"page_num":4},{"id":96614,"title":"Scenario Two: English displaces other languages","slug":"scenario-two-english-displaces-other-languages","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/scenario-two-english-displaces-other-languages\/","is_active":false,"page_num":5},{"id":96620,"title":"Scenario Three: Autonomous technology is a problem\u2026","slug":"scenario-three-autonomous-technology-is-a-problem","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/scenario-three-autonomous-technology-is-a-problem\/","is_active":true,"page_num":6},{"id":96626,"title":"Scenario Four: Transparency builds a better world, even at the expense of privacy\u2026","slug":"scenario-four-transparency-builds-a-better-world-even-at-the-expense-of-privacy","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/scenario-four-transparency-builds-a-better-world-even-at-the-expense-of-privacy\/","is_active":false,"page_num":7},{"id":96506,"title":"Scenario Five: Virtual reality is a drain for some\u2026","slug":"scenario-five-virtual-reality-is-a-drain-for-some","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/scenario-five-virtual-reality-is-a-drain-for-some\/","is_active":false,"page_num":8},{"id":96511,"title":"Scenario Six: The internet opens worldwide access to success\u2026","slug":"scenario-six-the-internet-opens-worldwide-access-to-success","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/scenario-six-the-internet-opens-worldwide-access-to-success\/","is_active":false,"page_num":9},{"id":96516,"title":"Scenario 7: Some Luddites\/refuseniks will commit terror acts\u2026","slug":"scenario-7-some-ludditesrefuseniks-will-commit-terror-acts","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/scenario-7-some-ludditesrefuseniks-will-commit-terror-acts\/","is_active":false,"page_num":10},{"id":96521,"title":"Funding Priorities: Respondents rank four suggested priorities for building the networked future","slug":"funding-priorities-respondents-rank-four-suggested-priorities-for-building-the-networked-future","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/funding-priorities-respondents-rank-four-suggested-priorities-for-building-the-networked-future\/","is_active":false,"page_num":11},{"id":96525,"title":"Reflections","slug":"reflections","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/reflections\/","is_active":false,"page_num":12},{"id":96529,"title":"Methodology","slug":"methodology-112-2","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/methodology-112-2\/","is_active":false,"page_num":13},{"id":96534,"title":"Brief Biographies","slug":"brief-biographies","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2006\/09\/24\/brief-biographies\/","is_active":false,"page_num":14}]},"parent_info":{"parent_title":"The Future of the Internet II","parent_id":96590},"materialsOrdered":[],"chaptersOrdered":[],"partsOrdered":[],"partsEnabled":false,"datacite_doi":"","prc_seo_data":{"title":"Scenario Three: Autonomous technology is a problem\u2026","description":"Prediction and Reactions Prediction: By 2020, intelligent agents and distributed control will cut direct human input so completely out of some key activities such as surveillance, security and tracking systems…","og_title":"Scenario Three: Autonomous technology is a problem\u2026","og_description":"","schema_type":"Article","noindex":false,"canonical_url":"","primary_terms":[],"custom_schema":[],"og_image":0,"indexnow_submitted_at":null,"gsc_index_status":null},"prepublish_checks":{"prc-image-alt-text":{"status":"complete","message":"No image blocks in content.","data":null},"prc-about-this-research":{"status":"incomplete","message":"Add an \"About this research\" details block.","data":null},"prc-paragraph-count":{"status":"complete","message":"Found 50 paragraphs.","data":{"count":50}},"prc-internal-link":{"status":"incomplete","message":"Add at least one internal link.","data":{"count":0}}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"relatedPostsOrdered":[],"bylinesOrdered":[],"acknowledgementsOrdered":[],"_links":{"self":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/96620","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/comments?post=96620"}],"version-history":[{"count":2,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/96620\/revisions"}],"predecessor-version":[{"id":133768,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/96620\/revisions\/133768"}],"wp:attachment":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/media?parent=96620"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/categories?post=96620"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/tags?post=96620"},{"taxonomy":"bylines","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/bylines?post=96620"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/collection?post=96620"},{"taxonomy":"datasets","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/datasets?post=96620"},{"taxonomy":"level_of_effort","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/level_of_effort?post=96620"},{"taxonomy":"primary_audience","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/primary_audience?post=96620"},{"taxonomy":"information_type","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/information_type?post=96620"},{"taxonomy":"_post_visibility","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_post_visibility?post=96620"},{"taxonomy":"formats","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/formats?post=96620"},{"taxonomy":"_fund_pool","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_fund_pool?post=96620"},{"taxonomy":"languages","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/languages?post=96620"},{"taxonomy":"regions-countries","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/regions-countries?post=96620"},{"taxonomy":"research-teams","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/research-teams?post=96620"},{"taxonomy":"workflow-status","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/workflow-status?post=96620"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}![\"Scenario](\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/wp-content\/uploads\/sites\/9\/media\/5DD9B74D130F450DB68FC66F485207CA.jpg\")
<\/figure>\n<\/p>\n\nOverview of Respondents’ Reactions<\/h3>\n\n
Many who see dangers or predict negative impacts discuss unforeseen consequences of surveillance.<\/h3>\n\n
Some say elements of this scenario will take place, but predict humans will not lose all control.<\/h3>\n\n
Several suggest working to avoid \u201cunintended consequences.\u201d<\/h3>\n\n
Social power will grow along with technological power \u2013 perhaps thwarting runaway technology.<\/h3>\n\n
Where does ‘autonomous technology’ stand now?<\/h3>\n\n
Where might this technology take us in the future?<\/h3>\n\n
\n
Acceleration to a \u201csingularity\u201d is predicted by some.<\/h3>\n\n