{"id":340,"date":"2008-07-10T02:10:45","date_gmt":"2008-07-10T08:10:45","guid":{"rendered":"http:\/\/hunch.net\/?p=340"},"modified":"2008-07-11T21:48:17","modified_gmt":"2008-07-12T03:48:17","slug":"interesting-papers-icml-2008","status":"publish","type":"post","link":"https:\/\/hunch.net\/?p=340","title":{"rendered":"Interesting papers, ICML 2008"},"content":{"rendered":"<p>Here are some papers from <a href=\"http:\/\/icml2008.cs.helsinki.fi\/\">ICML 2008<\/a> that I found interesting.  <\/p>\n<ol>\n<li><a href=\"http:\/\/www.gatsby.ucl.ac.uk\/~risi\/\">Risi Kondor<\/a> and <a href=\"http:\/\/mlg.eng.cam.ac.uk\/~karsten\/\">Karsten Borgwardt<\/a>, <a href=\"http:\/\/www.conflate.net\/icml\/paper\/2008\/396\">The Skew Spectrum of Graphs<\/a>. This paper is about a new family of functions on graphs which is invariant under node label permutation.  They show that these quantities appear to yield good features for learning.<\/li>\n<li><a href=\"http:\/\/www.cse.ucsd.edu\/~dasgupta\/\">Sanjoy Dasgupta<\/a> and <a href=\"http:\/\/www.cse.ucsd.edu\/~djhsu\/\">Daniel Hsu<\/a>.  <a href=\"http:\/\/www.conflate.net\/icml\/paper\/2008\/324\">Hierarchical sampling for active learning.<\/a>  This is the first published practical consistent active learning algorithm.  The abstract is also pretty impressive.<\/li>\n<li><a href=\"http:\/\/www.research.rutgers.edu\/~lihong\/\">Lihong Li<\/a>, <a href=\"http:\/\/www.cs.rutgers.edu\/~mlittman\/\">Michael Littman<\/a>, and <a href=\"http:\/\/paul.rutgers.edu\/~thomaswa\/\">Thomas Walsh<\/a> <a href=\"http:\/\/www.conflate.net\/icml\/paper\/2008\/627\">Knows What It Knows: A Framework For Self-Aware Learning.<\/a>  This is an attempt to create learning algorithms that know when they err, (other work includes <a href=\"http:\/\/www.vovk.net\/publications.html\">Vovk<\/a>).  It&#8217;s not yet clear to me what the right model for <a href=\"https:\/\/hunch.net\/?p=317\">feature-dependent confidence intervals<\/a> is.<\/li>\n<li><a href=\"http:\/\/people.cecs.anu.edu.au\/user\/1037\">Novi Quadrianto<\/a>, <a href=\"http:\/\/alex.smola.org\/\">Alex Smola<\/a>, <a href=\"http:\/\/www.tiberiocaetano.com\/\">TIberio Caetano<\/a>, and <a href=\"http:\/\/ai.stanford.edu\/~quocle\/\">Quoc Viet Le<\/a> <a href=\"http:\/\/www.conflate.net\/icml\/paper\/2008\/337\">Estimating Labels from Label Proportions<\/a>.  This is an example of learning in a specialization of the offline contextual bandit setting.<\/li>\n<li><a href=\"http:\/\/radlinski.org\/\">Filip Radlinski<\/a>, <a href=\"http:\/\/www.cs.cornell.edu\/~rdk\/\">Robert Kleinberg<\/a> and <a href=\"http:\/\/www.cs.cornell.edu\/People\/tj\/\">Thorsten Joachims<\/a><br \/>\n<a href=\"http:\/\/www.conflate.net\/icml\/paper\/2008\/264\">Learning Diverse Rankings with Multi-Armed Bandits.<\/a> Learning should be used to solve the diversity problem, and doing it in an online bandit-like setting is quite natural.  I believe the setting can be generalized to a setting with features without too much work.<\/li>\n<li><a href=\"http:\/\/www.cs.cornell.edu\/~caruana\/\">Rich Caruana<\/a>, <a href=\"http:\/\/www.cs.cornell.edu\/~nk\/\">Nikos Karampatziakis<\/a>, <a href=\"http:\/\/www.linkedin.com\/pub\/1\/990\/237\">Ainur Yessenalina<\/a> <a href=\"http:\/\/www.conflate.net\/icml\/paper\/2008\/632\">An Empirical Evaluation of Supervised Learning in High Dimensions<\/a>.  This paper doesn&#8217;t need an abstract given the title :).  I hadn&#8217;t previously appreciated how well a random forest works in high dimensions.<\/li>\n<li><a href=\"http:\/\/ttic.uchicago.edu\/~sham\/\">Sham M. Kakade<\/a>, <a href=\"http:\/\/ttic.uchicago.edu\/~shai\/\">Shai Shalev-Shwartz<\/a>, and <a href=\"http:\/\/www.tti-c.org\/tewari.php\">Ambuj Tewari<\/a>. <a href=\"http:\/\/www.conflate.net\/icml\/paper\/2008\/511\">Efficient Bandit Algorithms for Online Multiclass Prediction<\/a>.    A paper about an online contextual bandit setting specialized to a multiclass realizable yet otherwise adversarial setting that yields a practical algorithm.<\/li>\n<\/ol>\n<p>I&#8217;d like to add that I thought the conference organization (and the colocation with <a href=\"http:\/\/colt2008.cs.helsinki.fi\/\">COLT<\/a> and <a href=\"http:\/\/uai2008.cs.helsinki.fi\/\">UAI<\/a>) are particularly well done, the best I&#8217;ve seen.  The key seems to be tight integration of the colocating conference programs and hordes of local volunteers making sure everything is working.  I was also happy to see a <a href=\"https:\/\/hunch.net\/?p=293\">10 years award<\/a> for best paper 10 years ago.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Here are some papers from ICML 2008 that I found interesting. Risi Kondor and Karsten Borgwardt, The Skew Spectrum of Graphs. This paper is about a new family of functions on graphs which is invariant under node label permutation. They show that these quantities appear to yield good features for learning. Sanjoy Dasgupta and Daniel &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/hunch.net\/?p=340\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Interesting papers, ICML 2008&#8221;<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4,33,29],"tags":[],"class_list":["post-340","post","type-post","status-publish","format-standard","hentry","category-announcements","category-conferences","category-machine-learning"],"_links":{"self":[{"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/posts\/340","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/hunch.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=340"}],"version-history":[{"count":0,"href":"https:\/\/hunch.net\/index.php?rest_route=\/wp\/v2\/posts\/340\/revisions"}],"wp:attachment":[{"href":"https:\/\/hunch.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=340"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hunch.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=340"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hunch.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=340"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}