Open in TheBrain

AI Artificial Intelligence

<h4>Artificial intelligence</h4>

<div role="note" class="hatnote relarticle mainarticle">Main articles: <a href="https://en.wikipedia.org/wiki/Existential_risk_from_advanced_artificial_intelligence" title="Existential risk from advanced artificial intelligence" class="mw-redirect">Existential risk from advanced artificial intelligence</a> and <a href="https://en.wikipedia.org/wiki/Friendly_artificial_intelligence" title="Friendly artificial intelligence">Friendly artificial intelligence</a></div>

<p>It has been suggested that <a href="https://en.wikipedia.org/wiki/Ethics_of_artificial_intelligence#Unintended_consequences" title="Ethics of artificial intelligence">learning computers</a> that rapidly become <a href="https://en.wikipedia.org/wiki/Superintelligence" title="Superintelligence">superintelligent</a> may take unforeseen actions or that <a href="https://en.wikipedia.org/wiki/Robot#Social_impact" title="Robot">robots</a> would out-compete humanity (one <a href="https://en.wikipedia.org/wiki/Technological_singularity" title="Technological singularity">technological singularity</a> scenario).<sup id="cite_ref-billjoy_27-0" class="reference"><a href="https://en.wikipedia.org/wiki/Global_catastrophic_risk#cite_note-billjoy-27">[27]</a></sup> Because of its exceptional scheduling and organizational capability and the range of novel technologies it could develop, it is possible that the first Earth superintelligence to emerge could rapidly become matchless and unrivaled: conceivably it would be able to bring about almost any possible outcome, and be able to foil virtually any attempt that threatened to prevent it achieving its objectives.<sup id="cite_ref-Bostrom_28-0" class="reference"><a href="https://en.wikipedia.org/wiki/Global_catastrophic_risk#cite_note-Bostrom-28">[28]</a></sup> It could eliminate, wiping out if it chose, any other challenging rival intellects; alternatively it might manipulate or persuade them to change their behavior towards its own interests, or it may merely obstruct their attempts at interference.<sup id="cite_ref-Bostrom_28-1" class="reference"><a href="https://en.wikipedia.org/wiki/Global_catastrophic_risk#cite_note-Bostrom-28">[28]</a></sup> In Bostrom's book, <i><a href="https://en.wikipedia.org/wiki/Superintelligence:Paths,Dangers,_Strategies" title="Superintelligence: Paths, Dangers, Strategies">Superintelligence: Paths, Dangers, Strategies</a></i>, he defines this as the control problem.<sup id="cite_ref-Bostrom2_29-0" class="reference"><a href="https://en.wikipedia.org/wiki/Global_catastrophic_risk#cite_note-Bostrom2-29">[29]</a></sup>

<a href="https://en.wikipedia.org/wiki/Vernor_Vinge" title="Vernor Vinge">Vernor Vinge</a> has suggested that a moment may come when computers and robots are smarter than humans. He calls this "<a href="https://en.wikipedia.org/wiki/Technological_singularity" title="Technological singularity">the Singularity</a>."<sup id="cite_ref-nytimes_july09_30-0" class="reference"><a href="https://en.wikipedia.org/wiki/Global_catastrophic_risk#cite_note-nytimes_july09-30">[30]</a></sup> He suggests that it may be somewhat or possibly very dangerous for humans.<sup id="cite_ref-31" class="reference"><a href="https://en.wikipedia.org/wiki/Global_catastrophic_risk#cite_note-31">[31]</a></sup> This is discussed by a philosophy called <a href="https://en.wikipedia.org/wiki/Singularitarianism" title="Singularitarianism">Singularitarianism</a>.

Physicist <a href="https://en.wikipedia.org/wiki/Stephen_Hawking" title="Stephen Hawking">Stephen Hawking</a>, <a href="https://en.wikipedia.org/wiki/Microsoft" title="Microsoft">Microsoft</a> founder <a href="https://en.wikipedia.org/wiki/Bill_Gates" title="Bill Gates">Bill Gates</a> and <a href="https://en.wikipedia.org/wiki/SpaceX" title="SpaceX">SpaceX</a> founder <a href="https://en.wikipedia.org/wiki/Elon_Musk" title="Elon Musk">Elon Musk</a> have expressed concerns about the possibility that AI could evolve to the point that humans could not control it, with Hawking theorizing that this could "spell the end of the human race".<sup id="cite_ref-32" class="reference"><a href="https://en.wikipedia.org/wiki/Global_catastrophic_risk#cite_note-32">[32]</a></sup> In 2009, experts attended a conference hosted by the <a href="https://en.wikipedia.org/wiki/Association_for_the_Advancement_of_Artificial_Intelligence" title="Association for the Advancement of Artificial Intelligence">Association for the Advancement of Artificial Intelligence</a> (AAAI) to discuss whether computers and robots might be able to acquire any sort of <a href="https://en.wikipedia.org/wiki/Autonomy" title="Autonomy">autonomy</a>, and how much these abilities might pose a threat or hazard. They noted that some robots have acquired various forms of semi-autonomy, including being able to find power sources on their own and being able to independently choose targets to attack with weapons. They also noted that some computer viruses can evade elimination and have achieved "cockroach intelligence." They noted that self-awareness as depicted in science-fiction is probably unlikely, but that there were other potential hazards and pitfalls.<sup id="cite_ref-nytimes_july09_30-1" class="reference"><a href="https://en.wikipedia.org/wiki/Global_catastrophic_risk#cite_note-nytimes_july09-30">[30]</a></sup> Various media sources and scientific groups have noted separate trends in differing areas which might together result in greater robotic functionalities and autonomy, and which pose some inherent concerns.<sup id="cite_ref-33" class="reference"><a href="https://en.wikipedia.org/wiki/Global_catastrophic_risk#cite_note-33">[33]</a></sup><sup id="cite_ref-34" class="reference"><a href="https://en.wikipedia.org/wiki/Global_catastrophic_risk#cite_note-34">[34]</a></sup><sup id="cite_ref-35" class="reference"><a href="https://en.wikipedia.org/wiki/Global_catastrophic_risk#cite_note-35">[35]</a></sup> <a href="https://en.wikipedia.org/wiki/Eliezer_Yudkowsky" title="Eliezer Yudkowsky">Eliezer Yudkowsky</a> believes that risks from artificial intelligence are harder to predict than any other known risks. He also argues that research into artificial intelligence is biased by <a href="https://en.wikipedia.org/wiki/Anthropomorphism" title="Anthropomorphism">anthropomorphism</a>. Since people base their judgments of artificial intelligence on their own experience, he claims that they underestimate the potential power of AI. He distinguishes between risks due to technical failure of AI, which means that flawed algorithms prevent the AI from carrying out its intended goals, and philosophical failure, which means that the AI is programmed to realize a flawed ideology.<sup id="cite_ref-Yudkowsky_36-0" class="reference"><a href="https://en.wikipedia.org/wiki/Global_catastrophic_risk#cite_note-Yudkowsky-36">[36]</a></sup></p>

Attachments