{"id":315,"date":"2008-01-28T18:49:12","date_gmt":"2008-01-29T00:49:12","guid":{"rendered":"http:\/\/hunch.net\/?p=315"},"modified":"2008-01-28T18:49:12","modified_gmt":"2008-01-29T00:49:12","slug":"sufficient-computation","status":"publish","type":"post","link":"https:\/\/hunch.net\/?p=315","title":{"rendered":"Sufficient Computation"},"content":{"rendered":"<p>Do we have computer hardware sufficient for AI?  This question is difficult to answer, but here&#8217;s a try:<\/p>\n<p>One way to achieve AI is by simulating a human brain.  A human brain has about 10<sup>15<\/sup> synapses which operate at about 10<sup>2<\/sup> per second implying about 10<sup>17<\/sup> bit ops per second.<\/p>\n<p>A modern computer runs at 10<sup>9<\/sup> cycles\/second and operates on 10<sup>2<\/sup> bits per cycle implying 10<sup>11<\/sup> bits processed per second.  <\/p>\n<p>The gap here is only 6 orders of magnitude, which can be plausibly surpassed via cluster machines.  For example, the <a href=\"http:\/\/www.top500.org\/system\/details\/8968\">BlueGene\/L<\/a> operates 10<sup>5<\/sup> nodes (one order of magnitude short).  It&#8217;s peak recorded performance is about 0.5*10<sup>15<\/sup> FLOPS which translates to about 10<sup>16<\/sup> bit ops per second, which is nearly 10<sup>17<\/sup>.<\/p>\n<p>There are many criticisms (both positive and negative) for this argument.<\/p>\n<ol>\n<li>Simulation of a human brain might require substantially more detail.  Perhaps an additional 10<sup>2<\/sup> is required per neuron.<\/li>\n<li>We may not need to simulate a human brain to achieve AI.  There are certainly many examples where we have been able to design systems that work much better than evolved systems.<\/li>\n<li>The internet can be viewed as a supercluster with 10<sup>9<\/sup> or so CPUs, easily satisfying the computational requirements.<\/li>\n<li>Satisfying the computational requirement is not enough&#8212;bandwidth and latency requirements must also be satisfied.<\/li>\n<\/ol>\n<p>These sorts of order-of-magnitude calculations appear sloppy, but they work out a remarkable number of times <a href=\"http:\/\/www.its.caltech.edu\/~oom\/\">when tested elsewhere<\/a>.  I wouldn&#8217;t be surprised to see it work out here.<\/p>\n<p>Even with sufficient harrdware, we are missing a vital ingredient: knowing how to do things.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Do we have computer hardware sufficient for AI? This question is difficult to answer, but here&#8217;s a try: One way to achieve AI is by simulating a human brain. A human brain has about 1015 synapses which operate at about 102 per second implying about 1017 bit ops per second. A modern computer runs at &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/hunch.net\/?p=315\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Sufficient Computation&#8221;<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[30,37,29],"tags":[],"class_list":["post-315","post","type-post","status-publish","format-standard","hentry","category-ai","category-computation","category-machine-learning"],"_links":{"self":[{"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/posts\/315","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/hunch.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=315"}],"version-history":[{"count":0,"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/posts\/315\/revisions"}],"wp:attachment":[{"href":"https:\/\/hunch.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=315"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hunch.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=315"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hunch.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=315"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}