{"id":219,"date":"2020-08-26T11:46:27","date_gmt":"2020-08-26T15:46:27","guid":{"rendered":"https:\/\/www.macloo.com\/ai\/?p=219"},"modified":"2020-08-26T13:23:23","modified_gmt":"2020-08-26T17:23:23","slug":"interrogating-the-size-of-ai-algorithms","status":"publish","type":"post","link":"https:\/\/www.macloo.com\/ai\/2020\/08\/26\/interrogating-the-size-of-ai-algorithms\/","title":{"rendered":"Interrogating the size of AI algorithms"},"content":{"rendered":"\n<p>I have watched <em>so many videos<\/em> in my journey to understand how artificial intelligence and machine learning work, and one of my favorite YouTube channels belongs to <a rel=\"noreferrer noopener\" href=\"https:\/\/www.jordanharrod.com\/home\" target=\"_blank\">Jordan Harrod<\/a>. She&#8217;s a Ph.D. student working on neuroengineering, brain-machine interfaces, and machine learning.<\/p>\n\n\n\n<p>I began learning about convolutional neural networks in my reading about AI. Like most people (?), I had a vague idea of a neural network being modeled after a human brain, with parallel processors wired together like human synapses. When you read about neural nets in AI, though, you are <em>not<\/em> reading about processors, computer chips, or hardware. Instead, you read about <em>layers<\/em> and <em>weights<\/em>. (Among other things.)<\/p>\n\n\n\n<p>A <em>deep<\/em> neural network has multiple layers. That&#8217;s what makes it &#8220;deep.&#8221; You&#8217;ll see these layers in a simple <strong>diagram<\/strong> in the 4-minute video below. A convolutional neural network has <em>hidden<\/em> layers. These are not hidden as in &#8220;secret&#8221;; they are called hidden because they are sandwiched in between the input layer and and output layer. <\/p>\n\n\n\n<figure class=\"wp-block-embed-youtube aligncenter wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<div class=\"jetpack-video-wrapper\"><iframe loading=\"lazy\" title=\"How Big Is an AI Algorithm?\" width=\"739\" height=\"416\" src=\"https:\/\/www.youtube.com\/embed\/3PZokb0NWKM?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/div>\n<\/div><\/figure>\n\n\n\n<p>The <em>weights<\/em> are \u2014 as with all computer data \u2014 numeric. What happens in machine learning is that the weights associated with each node in a layer are <em>adjusted, <\/em>again and again, during the process of training the AI \u2014 with an end result that the neural network&#8217;s output is more accurate, or even <em>highly<\/em> accurate.<\/p>\n\n\n\n<p>As Harrod points out, not all AI systems include a neural network. She says that &#8220;training a model will almost always produce a set of values that correspond or are analogous to weights in a neural network.&#8221; I need to think more about that. <\/p>\n\n\n\n<p>Now, does Harrod definitively answer the question &#8220;How big is an AI algorithm?&#8221; Not really. But she provides a nice set of concepts to help us understand <em>why<\/em> there isn&#8217;t just one simple answer to this question. She offers a glimpse at the way AI works under the hood that might make you hungry to learn more.<\/p>\n\n\n\n<p><a rel=\"license\" href=\"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/\"><img decoding=\"async\" alt=\"Creative Commons License\" style=\"border-width:0\" src=\"https:\/\/i.creativecommons.org\/l\/by-nc-nd\/4.0\/88x31.png\"><\/a><br>\n<small><span xmlns:dct=\"http:\/\/purl.org\/dc\/terms\/\" property=\"dct:title\"><strong>AI in Media and Society<\/strong><\/span> by <span xmlns:cc=\"http:\/\/creativecommons.org\/ns#\" property=\"cc:attributionName\">Mindy McAdams<\/span> is licensed under a <a rel=\"license\" href=\"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/\">Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License<\/a>.<br>\nInclude the author&#8217;s name (Mindy McAdams) and a link to the original post in any reuse of this content.<\/small><\/p>\n\n\n\n<p>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I have watched so many videos in my journey to understand how artificial intelligence and machine learning work, and one of my favorite YouTube channels belongs to Jordan Harrod. She&#8217;s a Ph.D. student working on neuroengineering, brain-machine interfaces, and machine learning. I began learning about convolutional neural networks in my reading about AI. Like most&hellip; <a class=\"more-link\" href=\"https:\/\/www.macloo.com\/ai\/2020\/08\/26\/interrogating-the-size-of-ai-algorithms\/\">Continue reading <span class=\"screen-reader-text\">Interrogating the size of AI algorithms<\/span> <span class=\"meta-nav\" aria-hidden=\"true\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[43],"tags":[46,15,45],"class_list":["post-219","post","type-post","status-publish","format-standard","hentry","category-algorithms","tag-layers","tag-neural_network","tag-weights"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/posts\/219","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/comments?post=219"}],"version-history":[{"count":7,"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/posts\/219\/revisions"}],"predecessor-version":[{"id":226,"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/posts\/219\/revisions\/226"}],"wp:attachment":[{"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/media?parent=219"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/categories?post=219"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/tags?post=219"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}