{"id":149,"date":"2020-08-21T19:39:01","date_gmt":"2020-08-21T23:39:01","guid":{"rendered":"https:\/\/www.macloo.com\/ai\/?p=149"},"modified":"2020-09-18T12:03:44","modified_gmt":"2020-09-18T16:03:44","slug":"visual-chatbot-what-can-ai-tell-you","status":"publish","type":"post","link":"https:\/\/www.macloo.com\/ai\/2020\/08\/21\/visual-chatbot-what-can-ai-tell-you\/","title":{"rendered":"Visual Chatbot: What can AI tell you?"},"content":{"rendered":"\n<p>To see for yourself the product, or end results, of an AI system, check out the <a rel=\"noreferrer noopener\" href=\"http:\/\/demo-visualdialog.cloudcv.org\/\" target=\"_blank\">Visual Chatbot<\/a> online. It&#8217;s free. It&#8217;s fun.<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot01-1-471x1024.png\" alt=\"Screenshot of dialog with Visual Chatbot\" class=\"wp-image-151\" height=\"800\" srcset=\"https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot01-1-471x1024.png 471w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot01-1-138x300.png 138w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot01-1-707x1536.png 707w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot01-1.png 736w\" sizes=\"(max-width: 471px) 100vw, 471px\" \/><\/figure><\/div>\n\n\n\n<p>This app invites you to upload <em>any image<\/em> of your choice. It then generates a <em>caption<\/em> for that image. As you see above, the caption is not always 100 percent accurate. Yes, there is a dog in the photo, but there is no statue. There is a live person, who happens to be a soldier and a woman.<\/p>\n\n\n\n<p>You can then have a <em>conversation<\/em> about the photo with the chatbot. The chatbot&#8217;s answer to my first question, &#8220;What color is the dog?&#8221;, was spot-on. Further questions, however, reveal limits that persist in most of today&#8217;s image-recognition systems.<\/p>\n\n\n\n<p>The chat is still pretty awesome, though.<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"682\" src=\"https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/photo_soldier_and_dog-1024x682.jpg\" alt=\"Public domain photo of a soldier and a dog indoors, probably in an airport, with a &quot;Welcome Home&quot; balloon. U.S. Department of Defense photo.\" class=\"wp-image-154\" srcset=\"https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/photo_soldier_and_dog-1024x682.jpg 1024w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/photo_soldier_and_dog-300x200.jpg 300w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/photo_soldier_and_dog-768x511.jpg 768w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/photo_soldier_and_dog-1536x1022.jpg 1536w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/photo_soldier_and_dog-2048x1363.jpg 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption><em>U.S. Department of Defense photo, 2015 (public domain)<\/em><\/figcaption><\/figure><\/div>\n\n\n\n<p>The image appears in chapter 4 of in <a rel=\"noreferrer noopener\" href=\"https:\/\/us.macmillan.com\/books\/9780374715236\" target=\"_blank\">Artificial Intelligence: A Guide for Thinking Humans<\/a>, where author Melanie Mitchell uses it to discuss the complexity that we humans can perceive instantly in an image, but which machines are still incapable of &#8220;seeing.&#8221;<\/p>\n\n\n\n<p>In spite of the mistakes the chatbot makes in its answers to questions about this image, it serves as a nice demonstration of how today&#8217;s chatbots do not need to follow a set script. Earlier chatbots were programmed with rules that stepped through a tree or flowchart of choices \u2014 if the human&#8217;s question contains <em>x, <\/em>then reply with <em>y<\/em>.<\/p>\n\n\n\n<p>You can see <a rel=\"noreferrer noopener\" href=\"https:\/\/visualdialog.org\/\" target=\"_blank\">more info about Visual Dialog<\/a> if you&#8217;re curious about what the Visual Chatbot entails in terms of data, model, and\/or code.<\/p>\n\n\n\n<p>Below you can see some more questions I asked, with the answers from Visual Chatbot.<\/p>\n\n\n\n<div class=\"wp-block-jetpack-slideshow aligncenter\" data-effect=\"slide\"><div class=\"wp-block-jetpack-slideshow_container swiper-container\"><ul class=\"wp-block-jetpack-slideshow_swiper-wrapper swiper-wrapper\"><li class=\"wp-block-jetpack-slideshow_slide swiper-slide\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"471\" height=\"1024\" alt=\"Screenshot of dialog with Visual Chatbot\" class=\"wp-block-jetpack-slideshow_image wp-image-151\" data-id=\"151\" src=\"https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot01-1-471x1024.png\" srcset=\"https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot01-1-471x1024.png 471w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot01-1-138x300.png 138w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot01-1-707x1536.png 707w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot01-1.png 736w\" sizes=\"(max-width: 471px) 100vw, 471px\" \/><\/figure><\/li><li class=\"wp-block-jetpack-slideshow_slide swiper-slide\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"471\" height=\"1024\" alt=\"Screenshot of dialog with Visual Chatbot\" class=\"wp-block-jetpack-slideshow_image wp-image-158\" data-id=\"158\" src=\"https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot02-471x1024.png\" srcset=\"https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot02-471x1024.png 471w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot02-138x300.png 138w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot02-707x1536.png 707w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot02.png 736w\" sizes=\"(max-width: 471px) 100vw, 471px\" \/><\/figure><\/li><li class=\"wp-block-jetpack-slideshow_slide swiper-slide\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"471\" height=\"1024\" alt=\"Screenshot of dialog with Visual Chatbot\" class=\"wp-block-jetpack-slideshow_image wp-image-159\" data-id=\"159\" src=\"https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot03-471x1024.png\" srcset=\"https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot03-471x1024.png 471w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot03-138x300.png 138w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot03-707x1536.png 707w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot03.png 736w\" sizes=\"(max-width: 471px) 100vw, 471px\" \/><\/figure><\/li><li class=\"wp-block-jetpack-slideshow_slide swiper-slide\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"471\" height=\"1024\" alt=\"Screenshot of dialog with Visual Chatbot\" class=\"wp-block-jetpack-slideshow_image wp-image-160\" data-id=\"160\" src=\"https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot04-471x1024.png\" srcset=\"https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot04-471x1024.png 471w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot04-138x300.png 138w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot04-707x1536.png 707w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot04.png 736w\" sizes=\"(max-width: 471px) 100vw, 471px\" \/><\/figure><\/li><li class=\"wp-block-jetpack-slideshow_slide swiper-slide\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"471\" height=\"1024\" alt=\"Screenshot of dialog with Visual Chatbot\" class=\"wp-block-jetpack-slideshow_image wp-image-161\" data-id=\"161\" src=\"https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot05-471x1024.png\" srcset=\"https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot05-471x1024.png 471w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot05-138x300.png 138w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot05-707x1536.png 707w, https:\/\/www.macloo.com\/ai\/wp-content\/uploads\/2020\/08\/visual_chatbot05.png 736w\" sizes=\"(max-width: 471px) 100vw, 471px\" \/><\/figure><\/li><\/ul><a class=\"wp-block-jetpack-slideshow_button-prev swiper-button-prev swiper-button-white\" role=\"button\"><\/a><a class=\"wp-block-jetpack-slideshow_button-next swiper-button-next swiper-button-white\" role=\"button\"><\/a><a aria-label=\"Pause Slideshow\" class=\"wp-block-jetpack-slideshow_button-pause\" role=\"button\"><\/a><div class=\"wp-block-jetpack-slideshow_pagination swiper-pagination swiper-pagination-white\"><\/div><\/div><\/div>\n\n\n\n<p>Some of my favorite <em>wrong answers<\/em> are on the last two screens. Note, you can ask questions that are not answered with only yes or no.<\/p>\n\n\n\n<p><a rel=\"license\" href=\"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/\"><img decoding=\"async\" alt=\"Creative Commons License\" style=\"border-width:0\" src=\"https:\/\/i.creativecommons.org\/l\/by-nc-nd\/4.0\/88x31.png\"><\/a><br>\n<small><span xmlns:dct=\"http:\/\/purl.org\/dc\/terms\/\" property=\"dct:title\"><strong>AI in Media and Society<\/strong><\/span> by <span xmlns:cc=\"http:\/\/creativecommons.org\/ns#\" property=\"cc:attributionName\">Mindy McAdams<\/span> is licensed under a <a rel=\"license\" href=\"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/\">Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License<\/a>.<br>\nInclude the author&#8217;s name (Mindy McAdams) and a link to the original post in any reuse of this content.<\/small><\/p>\n\n\n\n<p>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>To see for yourself the product, or end results, of an AI system, check out the Visual Chatbot online. It&#8217;s free. It&#8217;s fun. This app invites you to upload any image of your choice. It then generates a caption for that image. As you see above, the caption is not always 100 percent accurate. Yes,&hellip; <a class=\"more-link\" href=\"https:\/\/www.macloo.com\/ai\/2020\/08\/21\/visual-chatbot-what-can-ai-tell-you\/\">Continue reading <span class=\"screen-reader-text\">Visual Chatbot: What can AI tell you?<\/span> <span class=\"meta-nav\" aria-hidden=\"true\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[3,2],"tags":[39,40,79],"class_list":["post-149","post","type-post","status-publish","format-standard","hentry","category-image-recognition","category-nlp","tag-chatbots","tag-errors","tag-faf"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/posts\/149","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/comments?post=149"}],"version-history":[{"count":8,"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/posts\/149\/revisions"}],"predecessor-version":[{"id":187,"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/posts\/149\/revisions\/187"}],"wp:attachment":[{"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/media?parent=149"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/categories?post=149"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.macloo.com\/ai\/wp-json\/wp\/v2\/tags?post=149"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}