{"id":947,"date":"2021-09-14T15:54:51","date_gmt":"2021-09-14T19:54:51","guid":{"rendered":"https:\/\/www.macloo.com\/ai\/?p=947"},"modified":"2021-09-14T16:04:40","modified_gmt":"2021-09-14T20:04:40","slug":"nvidia-rules-the-gpu-roost-for-now","status":"publish","type":"post","link":"https:\/\/www.macloo.com\/ai\/2021\/09\/14\/nvidia-rules-the-gpu-roost-for-now\/","title":{"rendered":"Nvidia rules the GPU roost\u2014for now"},"content":{"rendered":"\n<p>In an August 2021 article, <em>The Economist<\/em> examined the role of <strong>Nvidia<\/strong> in the current AI Spring. The writers signaled their central idea in the title: <a href=\"https:\/\/www.economist.com\/business\/2021\/08\/01\/will-nvidias-huge-bet-on-artificial-intelligence-chips-pay-off\" target=\"_blank\" rel=\"noreferrer noopener\">Will Nvidia\u2019s huge bet on artificial-intelligence chips pay off?<\/a><\/p>\n\n\n\n<p>A fair number of people don&#8217;t know much about the role of graphics-processing hardware in the success of neural networks. A neural network is a collection of algorithms, but to crunch through the massive quantities of training data required by many AI systems \u2014 and get it done in a reasonable timeframe, instead of, say, <em>years<\/em> \u2014 you need both speed and parallelism. The term for this kind of computer-chip technology is <em>accelerated computing,<\/em> and Nvidia is the market leader.<\/p>\n\n\n\n<p>Nvidia has ridden this wave to a current market value of $505 billion, according to the article. Five years ago, it was $31 billion. Nvidia both designs and manufactures the semiconductors for which it is famous. The original purpose of these chips was to run the graphics in modern computer games \u2014 the ones where characters race through immense, detailed 3D worlds. About half of Nvidia&#8217;s revenue still comes from chips designed for running game software.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\"><p>&#8220;Huge, real-time models like those used for speech recognition or content recommendation increasingly need specialized GPUs to perform well, says Ian Buck, head of Nvidia\u2019s accelerated-computing business.&#8221;<\/p><cite>\u2014 Will Nvidia\u2019s huge bet on artificial-intelligence chips pay off?<\/cite><\/blockquote>\n\n\n\n<p>So what&#8217;s the &#8220;huge bet&#8221;? Nvidia is in the midst of acquiring Arm, a designer of other kinds of fast chips, which also have the appeal of being energy efficient. The deal may or may not go through \u2014 there are European and U.K. hurdles to leap (Arm is based in the U.K.). Essentially Nvidia seeks to expand its microprocessor repertoire. The article discusses the competition among chip firms such as Intel and Advanced Micro Devices (AMD) \u2014 and increasingly, the biggest tech firms (e.g. Google and Amazon\/AWS) are getting into the chip-design business as well.<\/p>\n\n\n\n<p><em>The Economist<\/em> also produced a podcast episode about Nvidia and GPUs around the same time it published the article summarized above: <a rel=\"noreferrer noopener\" href=\"https:\/\/www.economist.com\/podcasts\/2021\/08\/16\/shall-we-play-a-game-how-video-games-transformed-ai\" target=\"_blank\">Shall we play a game? How video games transformed AI<\/a> (38 min.). It provides a friendly, low-stress introduction to neural networks and deep learning, going back to <a rel=\"noreferrer noopener\" href=\"https:\/\/www.macloo.com\/ai\/2020\/10\/29\/a-blast-from-the-ai-past-perceptrons\/\" target=\"_blank\">the perceptron<\/a>, and covering the dominance in AI research of symbolic systems until the late 1980s. That&#8217;s the first 10 minutes. Then video games come into focus, and how so much technology innovation has come from computer game developments. Difference between CPUs and GPUs: around 13:00. Details about Nvidia&#8217;s programmable GPUs. Initial resistance (from research scientists) to using GPUs for serious AI work: around 20:00. Skepticism toward neural networks in the early 2000s. Andrew Ng&#8217;s group at Stanford demonstrates amazing speed increases in training time, using Nvidia GPUs. ImageNet challenge, AlexNet, the new rise of neural networks. In the final minutes, Nvidia&#8217;s future, chip technologies, and stock prices are discussed.<\/p>\n\n\n\n<p>.<\/p>\n\n\n\n<p><a rel=\"license\" href=\"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/\"><img decoding=\"async\" alt=\"Creative Commons License\" style=\"border-width:0\" src=\"https:\/\/i.creativecommons.org\/l\/by-nc-nd\/4.0\/88x31.png\"><\/a><br>\n<small><span xmlns:dct=\"http:\/\/purl.org\/dc\/terms\/\" property=\"dct:title\"><strong>AI in Media and Society<\/strong><\/span> by <span xmlns:cc=\"http:\/\/creativecommons.org\/ns#\" property=\"cc:attributionName\">Mindy McAdams<\/span> is licensed under a <a rel=\"license\" href=\"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/\">Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License<\/a>.<br>\nInclude the author&#8217;s name (Mindy McAdams) and a link to the original post in any reuse of this content.<\/small><\/p>\n\n\n\n<p>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In an August 2021 article, The Economist examined the role of Nvidia in the current AI Spring. The writers signaled their central idea in the title: Will Nvidia\u2019s huge bet on artificial-intelligence chips pay off? A fair number of people don&#8217;t know much about the role of graphics-processing hardware in the success of neural networks.&hellip; <a class=\"more-link\" href=\"https:\/\/www.macloo.com\/ai\/2021\/09\/14\/nvidia-rules-the-gpu-roost-for-now\/\">Continue reading <span class=\"screen-reader-text\">Nvidia rules the GPU roost\u2014for now<\/span> <span class=\"meta-nav\" aria-hidden=\"true\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[5],"tags":[],"class_list":["post-947","post","type-post","status-publish","format-standard","hentry","category-machine-learning"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/posts\/947","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/comments?post=947"}],"version-history":[{"count":10,"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/posts\/947\/revisions"}],"predecessor-version":[{"id":960,"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/posts\/947\/revisions\/960"}],"wp:attachment":[{"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/media?parent=947"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/categories?post=947"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/tags?post=947"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}