<?xml version="1.0" encoding="utf-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: The Machine Learning Department</title>
	<atom:link href="http://hunch.net/?feed=rss2&#038;p=248" rel="self" type="application/rss+xml" />
	<link>http://hunch.net/?p=248</link>
	<description>Machine learning and learning theory research</description>
	<lastBuildDate>Wed, 08 Sep 2010 11:14:02 -0500</lastBuildDate>
	<generator>http://wordpress.org/?v=2.8.4</generator>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
		<item>
		<title>By: &#8220;The Machine Learning Department&#8221; &#171; go6o portal</title>
		<link>http://hunch.net/?p=248&#038;cpage=1#comment-250556</link>
		<dc:creator>&#8220;The Machine Learning Department&#8221; &#171; go6o portal</dc:creator>
		<pubDate>Sun, 28 Dec 2008 12:45:49 +0000</pubDate>
		<guid isPermaLink="false">http://hunch.net/?p=248#comment-250556</guid>
		<description>[...] leo en el blog de John Langford que Carnegie Mellon ha creado el primer departamento acadÃ©mico de &#8220;Aprendizaje AutomÃ¡tico&#8221;. MÃ¡s allÃ¡ de las apreciaciones personales (anda que no estarÃ­a bien trabajar en un departamento [...]</description>
		<content:encoded><![CDATA[<p>[...] leo en el blog de John Langford que Carnegie Mellon ha creado el primer departamento acadÃ©mico de &#8220;Aprendizaje AutomÃ¡tico&#8221;. MÃ¡s allÃ¡ de las apreciaciones personales (anda que no estarÃ­a bien trabajar en un departamento [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Aaron Clauset</title>
		<link>http://hunch.net/?p=248&#038;cpage=1#comment-50305</link>
		<dc:creator>Aaron Clauset</dc:creator>
		<pubDate>Mon, 29 Jan 2007 04:28:54 +0000</pubDate>
		<guid isPermaLink="false">http://hunch.net/?p=248#comment-50305</guid>
		<description>I sympathize with the idea of an ML department because I suspect that computing (and really I mean statistics- and machine learning-style computing) will continue to, as it has aggressively in the past 50 years, move to the center of all scientific disciplines. I&#039;m sure that simulations and numerical models will become increasingly relevant to theorists in testing their ideas and to empiricists in understanding the significance of their data. (On that point, John at &lt;a href=&quot;http://cosmicvariance.com/&quot; rel=&quot;nofollow&quot;&gt;CosmicVariance&lt;/a&gt; has a great post on the importance of statistical modeling to understanding recent particle physics data.)

So, in this respect, I think Colleges of Computing are a good thing, since computing seems vaguely equally significant as say, the arts. On the other hand, I&#039;m a little wary about the disciplinary barriers that get erected when things like Colleges or Departments are created, and specialties spun off into their own institutions. Are we sure that ML won&#039;t benefit from having its practitioners also trained (to some degree) in programming languages, systems engineering, and theoretical computer science? I&#039;m willing to believe that important innovations in ML won&#039;t necessarily come from within the core ML way of approaching problems, but may come from connections to other kinds of computing (I guess I&#039;m primarily thinking about theory, but certainly systems and languages has something to say, as evidenced by the recent post on parallel ML algorithms).

I suppose a part of me is also reluctant to great further specializations because I&#039;m not sure what field I rightly &quot;belong to.&quot; That&#039;s a comment for another day, though, I think.</description>
		<content:encoded><![CDATA[<p>I sympathize with the idea of an ML department because I suspect that computing (and really I mean statistics- and machine learning-style computing) will continue to, as it has aggressively in the past 50 years, move to the center of all scientific disciplines. I&#8217;m sure that simulations and numerical models will become increasingly relevant to theorists in testing their ideas and to empiricists in understanding the significance of their data. (On that point, John at <a href="http://cosmicvariance.com/" rel="nofollow">CosmicVariance</a> has a great post on the importance of statistical modeling to understanding recent particle physics data.)</p>
<p>So, in this respect, I think Colleges of Computing are a good thing, since computing seems vaguely equally significant as say, the arts. On the other hand, I&#8217;m a little wary about the disciplinary barriers that get erected when things like Colleges or Departments are created, and specialties spun off into their own institutions. Are we sure that ML won&#8217;t benefit from having its practitioners also trained (to some degree) in programming languages, systems engineering, and theoretical computer science? I&#8217;m willing to believe that important innovations in ML won&#8217;t necessarily come from within the core ML way of approaching problems, but may come from connections to other kinds of computing (I guess I&#8217;m primarily thinking about theory, but certainly systems and languages has something to say, as evidenced by the recent post on parallel ML algorithms).</p>
<p>I suppose a part of me is also reluctant to great further specializations because I&#8217;m not sure what field I rightly &#8220;belong to.&#8221; That&#8217;s a comment for another day, though, I think.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Dragomir Radev</title>
		<link>http://hunch.net/?p=248&#038;cpage=1#comment-47566</link>
		<dc:creator>Dragomir Radev</dc:creator>
		<pubDate>Tue, 23 Jan 2007 14:40:00 +0000</pubDate>
		<guid isPermaLink="false">http://hunch.net/?p=248#comment-47566</guid>
		<description>Some points:

1. CMU is one of 5-6 places with *schools* of Computing (others include Utah, UC Irvine, and Georgia Tech). Being a school, CMU can choose to  have departments in any sizeable area of CS. They already have units in Robotics, Software Engineering, Language Technologies, etc.

2. UC Irvine is another such place with a school of Information and Computer Science with three units - Information Science, Computer Science, and Statistics.

3. At Michigan, we have a department of Electrical Engineering and Computer Science under Engineering and separate units in Statistics (in the Literature, Sciences, and the Arts college) and Information Science (separate school).

I personally like Irvine&#039;s model best as it brings all related units into one place.</description>
		<content:encoded><![CDATA[<p>Some points:</p>
<p>1. CMU is one of 5-6 places with *schools* of Computing (others include Utah, UC Irvine, and Georgia Tech). Being a school, CMU can choose to  have departments in any sizeable area of CS. They already have units in Robotics, Software Engineering, Language Technologies, etc.</p>
<p>2. UC Irvine is another such place with a school of Information and Computer Science with three units &#8211; Information Science, Computer Science, and Statistics.</p>
<p>3. At Michigan, we have a department of Electrical Engineering and Computer Science under Engineering and separate units in Statistics (in the Literature, Sciences, and the Arts college) and Information Science (separate school).</p>
<p>I personally like Irvine&#8217;s model best as it brings all related units into one place.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Dave Bacon</title>
		<link>http://hunch.net/?p=248&#038;cpage=1#comment-46183</link>
		<dc:creator>Dave Bacon</dc:creator>
		<pubDate>Tue, 16 Jan 2007 17:43:39 +0000</pubDate>
		<guid isPermaLink="false">http://hunch.net/?p=248#comment-46183</guid>
		<description>&quot;Statistics tends to function with a greater emphasis on journals and a lesser emphasis on conferences which often implies a much longer publishing cycle.&quot;

Interesting...it would be fun to compare publishing cycles for different fields!  In physics, and in particular in high energy theory and quantum computing, publication is two-fold, first on the arxiv, and then in a journal.  I think the later increases the speed of the science, perhaps even beyond the CS model whose publication deadline is set by &quot;elite&quot; conference dates.  I wonder how one would get this data...</description>
		<content:encoded><![CDATA[<p>&#8220;Statistics tends to function with a greater emphasis on journals and a lesser emphasis on conferences which often implies a much longer publishing cycle.&#8221;</p>
<p>Interesting&#8230;it would be fun to compare publishing cycles for different fields!  In physics, and in particular in high energy theory and quantum computing, publication is two-fold, first on the arxiv, and then in a journal.  I think the later increases the speed of the science, perhaps even beyond the CS model whose publication deadline is set by &#8220;elite&#8221; conference dates.  I wonder how one would get this data&#8230;</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: ingo</title>
		<link>http://hunch.net/?p=248&#038;cpage=1#comment-46172</link>
		<dc:creator>ingo</dc:creator>
		<pubDate>Tue, 16 Jan 2007 17:01:13 +0000</pubDate>
		<guid isPermaLink="false">http://hunch.net/?p=248#comment-46172</guid>
		<description>Well, I looked at their homepage and found they offer Masters and PhD level study.  This is exactly what I would have expected: Get breadth during your bachelors (probably in either CS or math) and focus during Masters/PhD time.  IMHO, very natural and not at all risky.  

Now, ML-only study at the undergrad level, that&#039;s something I would have serious doubts about. At the end of the day, we still need to turn our knowledge into working software systems and I believe the engineering content of a standard CS course to be the very minimum of what is required for that.</description>
		<content:encoded><![CDATA[<p>Well, I looked at their homepage and found they offer Masters and PhD level study.  This is exactly what I would have expected: Get breadth during your bachelors (probably in either CS or math) and focus during Masters/PhD time.  IMHO, very natural and not at all risky.  </p>
<p>Now, ML-only study at the undergrad level, that&#8217;s something I would have serious doubts about. At the end of the day, we still need to turn our knowledge into working software systems and I believe the engineering content of a standard CS course to be the very minimum of what is required for that.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Vicente Malave</title>
		<link>http://hunch.net/?p=248&#038;cpage=1#comment-46164</link>
		<dc:creator>Vicente Malave</dc:creator>
		<pubDate>Tue, 16 Jan 2007 15:29:49 +0000</pubDate>
		<guid isPermaLink="false">http://hunch.net/?p=248#comment-46164</guid>
		<description>I think the question should be: is there a &quot;machine learning&quot; way of thinking that is distinct from the practice of statistics (and perhaps computer science). I feel this is true, and Breiman summarizes it nicely in &quot;Statistical Modeling: The Two Cultures&quot;. 

With regards to the narrow focus of the department, the most attractive part of the PhD program to me is the lack of all the messy computer science things (i.e. Systems programming) needed for a CS degree in favor of a focus on more interesting things (like upper level courses in Statistical Learning Theory).

I dont think collaboration will suffer if ML becomes its own discipline, after all we are in the business of finding interesting things in other people&#039;s data, and there seem to be no shortage of interesting problems (my own interests have driven me into Cognitive Neuroscience).</description>
		<content:encoded><![CDATA[<p>I think the question should be: is there a &#8220;machine learning&#8221; way of thinking that is distinct from the practice of statistics (and perhaps computer science). I feel this is true, and Breiman summarizes it nicely in &#8220;Statistical Modeling: The Two Cultures&#8221;. </p>
<p>With regards to the narrow focus of the department, the most attractive part of the PhD program to me is the lack of all the messy computer science things (i.e. Systems programming) needed for a CS degree in favor of a focus on more interesting things (like upper level courses in Statistical Learning Theory).</p>
<p>I dont think collaboration will suffer if ML becomes its own discipline, after all we are in the business of finding interesting things in other people&#8217;s data, and there seem to be no shortage of interesting problems (my own interests have driven me into Cognitive Neuroscience).</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: jl</title>
		<link>http://hunch.net/?p=248&#038;cpage=1#comment-46162</link>
		<dc:creator>jl</dc:creator>
		<pubDate>Tue, 16 Jan 2007 15:16:50 +0000</pubDate>
		<guid isPermaLink="false">http://hunch.net/?p=248#comment-46162</guid>
		<description>I&#039;d say &quot;yes&quot;, ML is more deserving than some other subfields.

&quot;No&quot;, an algorithms department doesn&#039;t make sense, because it is too core to the purpose of computer science.  It&#039;s difficult for me to imagine CS department without algorithms, while a CS department without machine learning is plausible.

&quot;Yes&quot;, a systems departments may make sense.  They are often called ECE.

I don&#039;t know about graphics and vision.</description>
		<content:encoded><![CDATA[<p>I&#8217;d say &#8220;yes&#8221;, ML is more deserving than some other subfields.</p>
<p>&#8220;No&#8221;, an algorithms department doesn&#8217;t make sense, because it is too core to the purpose of computer science.  It&#8217;s difficult for me to imagine CS department without algorithms, while a CS department without machine learning is plausible.</p>
<p>&#8220;Yes&#8221;, a systems departments may make sense.  They are often called ECE.</p>
<p>I don&#8217;t know about graphics and vision.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: jl</title>
		<link>http://hunch.net/?p=248&#038;cpage=1#comment-46161</link>
		<dc:creator>jl</dc:creator>
		<pubDate>Tue, 16 Jan 2007 15:11:05 +0000</pubDate>
		<guid isPermaLink="false">http://hunch.net/?p=248#comment-46161</guid>
		<description>When something new comes up, it&#039;s easy to look for disadvantages.  Relative to either computer science or statistics, the focus of this department does look narrow.  We could isntead look at the advantages.

Looking at statistics relative to machine learning, statisticians don&#039;t have the algorithms and programming experience.  Can a person be broadly educated without having that experience?  Maybe statistics is a narrow field.  Looking at computer science, which doesn&#039;t include any statistics, can a person be considered broadly educuated and yet still not understand how to carefully describe or think about the unknown?  This isn&#039;t idle &#039;cup-is-half-fulling&#039;.   I regard &#039;rogramming as the missing member of reading, &#039;riting, and &#039;rithmetic, and I&#039;ve found a statistical understanding of the world genuinely valuable.

Another reason why the department might be regarded as narrow is that an ML education is not as obviously useful as a CS or statistics education.   This is partly a question for the future: will an ML education become increasingly useful?  I believe the answer is yes.</description>
		<content:encoded><![CDATA[<p>When something new comes up, it&#8217;s easy to look for disadvantages.  Relative to either computer science or statistics, the focus of this department does look narrow.  We could isntead look at the advantages.</p>
<p>Looking at statistics relative to machine learning, statisticians don&#8217;t have the algorithms and programming experience.  Can a person be broadly educated without having that experience?  Maybe statistics is a narrow field.  Looking at computer science, which doesn&#8217;t include any statistics, can a person be considered broadly educuated and yet still not understand how to carefully describe or think about the unknown?  This isn&#8217;t idle &#8216;cup-is-half-fulling&#8217;.   I regard &#8216;rogramming as the missing member of reading, &#8216;riting, and &#8216;rithmetic, and I&#8217;ve found a statistical understanding of the world genuinely valuable.</p>
<p>Another reason why the department might be regarded as narrow is that an ML education is not as obviously useful as a CS or statistics education.   This is partly a question for the future: will an ML education become increasingly useful?  I believe the answer is yes.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Aaron Hertzmann</title>
		<link>http://hunch.net/?p=248&#038;cpage=1#comment-46080</link>
		<dc:creator>Aaron Hertzmann</dc:creator>
		<pubDate>Tue, 16 Jan 2007 07:26:51 +0000</pubDate>
		<guid isPermaLink="false">http://hunch.net/?p=248#comment-46080</guid>
		<description>I think that the divisions by which we group academics are somewhat arbitrary.  Should computer science be in the Engineering Schools or in Arts and Sciences?  There&#039;s no right answer: some computer scientists are closer to electrical engineering, and some are closer to math; some CS is like math and some is like engineering.  I think it&#039;s good that some universities do it one way and some do it the other.  If you study Greek religion, should be in the history, classics, or religion department, or should you have your own department?  Who we choose to be our next-door colleagues is largely a matter of interest, not of an objective best division of research areas.

&lt;i&gt;DonÃ¢â‚¬â„¢t you think machine learning should get involved more with other fields of AI, such as planning, logic and cognitive science?&lt;/i&gt;

You could also argue: shouldn&#039;t ML be more involved with computational neuroscience?  Or maybe robotics?  Or maybe the medicine school?  Operations research?  All of these connections make a lot of sense, and it would be a shame if every university forced one sort of connection and neglected the rest.

Each researcher has a finite bandwith in the number of colleagues they can work with, chat with in the halls, go to lunch with, and so on.  If you spend some of that bandwidth on external collaborations, then you lose some bandwidth with other kinds of ML researchers.  And so on.

I personally, would not want to be in a department with such a narrow focus (in some sense), but I can certainly understand why someone would.</description>
		<content:encoded><![CDATA[<p>I think that the divisions by which we group academics are somewhat arbitrary.  Should computer science be in the Engineering Schools or in Arts and Sciences?  There&#8217;s no right answer: some computer scientists are closer to electrical engineering, and some are closer to math; some CS is like math and some is like engineering.  I think it&#8217;s good that some universities do it one way and some do it the other.  If you study Greek religion, should be in the history, classics, or religion department, or should you have your own department?  Who we choose to be our next-door colleagues is largely a matter of interest, not of an objective best division of research areas.</p>
<p><i>DonÃ¢â‚¬â„¢t you think machine learning should get involved more with other fields of AI, such as planning, logic and cognitive science?</i></p>
<p>You could also argue: shouldn&#8217;t ML be more involved with computational neuroscience?  Or maybe robotics?  Or maybe the medicine school?  Operations research?  All of these connections make a lot of sense, and it would be a shame if every university forced one sort of connection and neglected the rest.</p>
<p>Each researcher has a finite bandwith in the number of colleagues they can work with, chat with in the halls, go to lunch with, and so on.  If you spend some of that bandwidth on external collaborations, then you lose some bandwidth with other kinds of ML researchers.  And so on.</p>
<p>I personally, would not want to be in a department with such a narrow focus (in some sense), but I can certainly understand why someone would.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Anonymous</title>
		<link>http://hunch.net/?p=248&#038;cpage=1#comment-46071</link>
		<dc:creator>Anonymous</dc:creator>
		<pubDate>Tue, 16 Jan 2007 06:01:27 +0000</pubDate>
		<guid isPermaLink="false">http://hunch.net/?p=248#comment-46071</guid>
		<description>I am skeptical of the narrow-education approach. To me, one of the greatest appeals of machine learning techniques is their applicability to a large set of problems in very disparate areas, and their potential in areas they haven&#039;t been used yet. Wouldn&#039;t you be slowing down these applications if students don&#039;t quite understand these areas of potential application?</description>
		<content:encoded><![CDATA[<p>I am skeptical of the narrow-education approach. To me, one of the greatest appeals of machine learning techniques is their applicability to a large set of problems in very disparate areas, and their potential in areas they haven&#8217;t been used yet. Wouldn&#8217;t you be slowing down these applications if students don&#8217;t quite understand these areas of potential application?</p>
]]></content:encoded>
	</item>
</channel>
</rss>
