{"id":369,"date":"2005-03-25T07:33:00","date_gmt":"2005-03-25T07:33:00","guid":{"rendered":"http:\/\/www.dresan.com\/blog\/?p=369"},"modified":"2005-03-25T07:33:00","modified_gmt":"2005-03-25T07:33:00","slug":"da-stand","status":"publish","type":"post","link":"https:\/\/dresan.com\/blog\/2005\/03\/25\/da-stand\/","title":{"rendered":"Da Stand"},"content":{"rendered":"<p>Ya know, as one of <a href=\"http:\/\/www.dresan.com\/articles\/article-0006.html\">the head-freezing set<\/a> I&#8217;m normally not one to critique bleeding-edge science.  For example, I&#8217;m all in favor of the atom smashing going on at the Brookhaven Relativistic Heavy Ion Collider (RHIC), <a href=\"http:\/\/www.bnl.gov\/bnlweb\/pubaf\/pr\/2003\/bnlpr061103.htm\">where they&#8217;re smashing gold nuclei together at greater than 99.99999% the speed of light<\/a>, in an attempt to create &#8220;quark gluon plasmas&#8221; &#8230; that *just* *might* have less than an 0.00001% chance of <a href=\"http:\/\/www.phys.utk.edu\/rhip\/Articles\/RHICNews\/Essay%20Will%20Brookhaven%20Destroy%20the%20Universe%20Probably%20Not.htm\">creating a new big bang and destroying the universe<\/a>.  <\/p>\n<p>Why am I not afraid? Becuase of <a href=\"http:\/\/www.npl.washington.edu\/av\/altvw76.html\">ultra-high-energy cosmic rays<\/a>, which regularly bombard the Earth&#8217;s atmosphere with far, far more energy than we can make in our measly human particle accelerators.  <\/p>\n<p>So if the universe could end over something like this, it&#8217;d be ending all the time.<\/p>\n<p>I don&#8217;t have such a cavalier attitude towards <a href=\"http:\/\/www.nlm.nih.gov\/medlineplus\/news\/fullstory_23689.html\">the attempt to mix bird flu and human flu<\/a>, in which &#8220;what health officials fear most about bird flu &#8230;  acquiring genes from a human flu virus &#8230; is getting under way in a high level biosecurity laboratory.&#8221;  <\/p>\n<p>Why does this worry me, when news that the Brookhaven collider <a href=\"http:\/\/news.nationalgeographic.com\/news\/2005\/03\/0318_050318_pin_blackhole.html\">might have been spawning black holes<\/a> does not?  It&#8217;s simple.  The mixing of genes between pathogens, while it does happen in nature, is rare and hasn&#8217;t yet happened between avian and human influenza.  So while I don&#8217;t worry about something dangerous that MIGHT happen relating to a phenomena that DOES happen all the time, as at Brookhaven, I do get worried about trying to create something that COULD but DOESN&#8217;T happen precisely because you are worried that something bad MIGHT happen.  If you&#8217;re really that worried that avian flu and human flu might combine into a world-ravaging pandemic &#8230; why are you trying to make it happen?!?<\/p>\n<p>Now, in reality, I&#8217;m not saying stop work.  By all means &#8212; if they can figure out how avian and human influenza tick and develop a proactive vaccine, more power to you.   But &#8230; haven&#8217;t these guys seen or read <a href=\"http:\/\/www.amazon.com\/exec\/obidos\/ASIN\/0451169530\/qid=1111763181\/sr=2-1\/ref=pd_ka_b_2_1\/002-3168569-6299235\">The Stand<\/a>?<\/p>\n<p>I&#8217;m not joking around here.  Tom Clancy&#8217;s <a href=\"http:\/\/www.findarticles.com\/p\/articles\/mi_m0MKY\/is_16_26\/ai_94043426\/print\">Debt of Honor<\/a> included (spoiler alert) terrorists crashing an airliner into the Capitol building in Washington, long before 9\/11.  Ignore the <a href=\"http:\/\/www.public-action.com\/911\/clancy.html\">crazy conspiracy theories<\/a> &#8212; the point is that what happened at 9\/11 should not have come as a great surprise to anyone.  We should have been prepared for this from the getgo, because a known failure mode had been examined and exposed.  Or maybe the larger point is that speculative fiction enables us to wargame possible scenarios and prepare ourselves to deal with them &#8212; or avoid them.  <\/p>\n<p>True, you can&#8217;t live your life based on what you read in novels.  For example, David Brin&#8217;s <a href=\"http:\/\/blog.ianhamet.com\/index.php\/archive\/2005\/03\/18\/822\/\">Earth<\/a> presages the kind of work going on at Brookhaven &#8230; illustrating graphically the disasters that might happen if a man-made black hole fell into the Earth&#8217;s core.  I&#8217;m not worried about this, because I know that at <a href=\"http:\/\/math.ucr.edu\/home\/baez\/planck\/node2.html\">the size range<\/a> of the black holes we might create, quantum effects will dominate over gravitational effects and the black holes would <a href=\"http:\/\/perimeterinstitute.ca\/people\/researchers\/dgottesman\/infoloss.html\">evaporate<\/a> before it had a chance to eat anything.  This mental model of physics is helps me understand what&#8217;s going on at Brookhaven and gives me the confidence to give them a walk on what they&#8217;re trying to do.  SO while fiction can spark our imaginations, it can&#8217;t replace thought &#8212; we need to develop mental models of the situations at hand and apply them rationally. <\/p>\n<p>This is precisely the same kind of mental model that I use for my work in artificial intelligence &#8212; knowing what artificial intelligence is and how it works enables me to realistically gauge the risks &#8212; creating a superintelligent machine, for example (a very low probability event!) &#8212; and to take steps to mitigate that risk appropriately &#8212; namely, don&#8217;t put any machinery that can take human life in the hands of your intelligent machines (much less Mankind&#8217;s entire collection of nuclear weapons, as people seem to want to do in the movies)!  <\/p>\n<p>This is not because artificial intelligence researchers fear a superintelligent machine taking over a la <a href=\"http:\/\/www.imdb.com\/title\/tt0064177\/\">Colossus the Forbin Project<\/a> or the <a href=\"http:\/\/www.imdb.com\/title\/tt0088247\/\">Terminator<\/a>.  Quite frankly, we&#8217;d be tickled pink if a superintelligent machine showed up, but we&#8217;re not holding our breath waiting.  No, the reason you don&#8217;t put dangerous machinery in the hands of intelligent machines is because of the far more realistic &#8212; and realized &#8212; fear that so-called &#8220;intelligent&#8221; machine <a href=\"http:\/\/www.baselinemag.com\/print_article2\/0,2533,a=120926,00.asp\">will make a stupid mistake because of bad programming<\/a> and hurt somebody because, in reality, the machines we can make are just not smart enough to take over the world &#8212; they&#8217;re not even smart enough to even realize what they are doing.<\/p>\n<p>So. Perhaps the workers at the CDC combining the avian and human influenza strains have a similar mental model of epidemiology which enables them assess the risks realistically and structure their work appropriately.  Let&#8217;s hope so.<\/p>\n<p>Otherwise&#8230;<\/p>\n<p><a href=\"http:\/\/www.lemonysnicket.com\/index.cfm\">We&#8217;re very concerned.<\/a><\/p>\n<p>-the Centaur<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Ya know, as one of the head-freezing set I&#8217;m normally not one to critique bleeding-edge science. For example, I&#8217;m all in favor of the atom smashing going on at the&#8230;<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-369","post","type-post","status-publish","format-standard","hentry","category-uncategorized","ratio-2-1","entry"],"_links":{"self":[{"href":"https:\/\/dresan.com\/blog\/wp-json\/wp\/v2\/posts\/369","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dresan.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dresan.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dresan.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/dresan.com\/blog\/wp-json\/wp\/v2\/comments?post=369"}],"version-history":[{"count":0,"href":"https:\/\/dresan.com\/blog\/wp-json\/wp\/v2\/posts\/369\/revisions"}],"wp:attachment":[{"href":"https:\/\/dresan.com\/blog\/wp-json\/wp\/v2\/media?parent=369"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dresan.com\/blog\/wp-json\/wp\/v2\/categories?post=369"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dresan.com\/blog\/wp-json\/wp\/v2\/tags?post=369"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}