{"id":23,"date":"2005-02-15T08:21:34","date_gmt":"2005-02-15T14:21:34","guid":{"rendered":"\/?p=23"},"modified":"2005-02-15T08:22:09","modified_gmt":"2005-02-15T14:22:09","slug":"espgame-and-image-labeling","status":"publish","type":"post","link":"https:\/\/hunch.net\/?p=23","title":{"rendered":"ESPgame and image labeling"},"content":{"rendered":"<p><a href=\"http:\/\/www-2.cs.cmu.edu\/~biglou\/\">Luis von Ahn<\/a> has been running the <a href=\"http:\/\/www.espgame.org\/\">espgame<\/a> for awhile now.  The espgame provides a picture to two randomly paired people across the web, and asks them to agree on a label.  It hasn&#8217;t managed to label the web yet, but it has produced a <a href=\"https:\/\/hunch.net\/~learning\/ESP-ImageSet.tar.gz\">large dataset<\/a> of (image, label) pairs.  I organized the dataset so you could <a href=\"https:\/\/hunch.net\/~jl\/ESP-ImageSet\/search.shtml\">explore the implied bipartite graph<\/a> (requires much bandwidth).<\/p>\n<p>Relative to other image datasets, this one is quite large&#8212;67000 images, 358,000 labels (average of 5\/image with variation from 1 to 19), and 22,000 unique labels (one every 3 images).  The dataset is also very &#8216;natural&#8217;, consisting of images spidered from the internet.  The multiple label characteristic is intriguing because &#8216;learning to learn&#8217; and metalearning techniques may be applicable.  The &#8216;natural&#8217; quality means that this dataset varies greatly in difficulty from easy (predicting &#8220;red&#8221;) to hard (predicting &#8220;funny&#8221;) and potentially more rewarding to tackle.<\/p>\n<p>The open problem here is, of course, to make an internet image labeling program.  At a minimum this might be useful for blind people and image search.  Solving this problem well seems likely to require new learning methods.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Luis von Ahn has been running the espgame for awhile now. The espgame provides a picture to two randomly paired people across the web, and asks them to agree on a label. It hasn&#8217;t managed to label the web yet, but it has produced a large dataset of (image, label) pairs. I organized the dataset &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/hunch.net\/?p=23\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;ESPgame and image labeling&#8221;<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[16,17],"tags":[],"class_list":["post-23","post","type-post","status-publish","format-standard","hentry","category-problems","category-vision"],"_links":{"self":[{"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/posts\/23","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/hunch.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=23"}],"version-history":[{"count":0,"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/posts\/23\/revisions"}],"wp:attachment":[{"href":"https:\/\/hunch.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=23"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hunch.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=23"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hunch.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=23"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}