Machine Learning (Theory)



Tags: Conferences,Machine Learning jl@ 10:27 pm

The ICML paper deadline has passed. Joelle and I were surprised to see the number of submissions jump from last year by about 50% to around 900 submissions. A tiny portion of these are immediate rejects(*), so this is a much larger set of papers than expected. The number of workshop submissions also doubled compared to last year, so ICML may grow significantly this year, if we can manage to handle the load well. The prospect of making 900 good decisions is fundamentally daunting, and success will rely heavily on the program committee and area chairs at this point.

For those who want to rubberneck a bit more, here’s a breakdown of submissions by primary topic of submitted papers:

66 Reinforcement Learning
52 Supervised Learning
51 Clustering
46 Kernel Methods
40 Optimization Algorithms
39 Feature Selection and Dimensionality Reduction
33 Learning Theory
33 Graphical Models
33 Applications
29 Probabilistic Models
29 NN & Deep Learning
26 Transfer and Multi-Task Learning
25 Online Learning
25 Active Learning
22 Semi-Supervised Learning
20 Statistical Methods
20 Sparsity and Compressed Sensing
19 Ensemble Methods
18 Structured Output Prediction
18 Recommendation and Matrix Factorization
18 Latent-Variable Models and Topic Models
17 Graph-Based Learning Methods
16 Nonparametric Bayesian Inference
15 Unsupervised Learning and Outlier Detection
12 Gaussian Processes
11 Ranking and Preference Learning
11 Large-Scale Learning
9 Vision
9 Social Network Analysis
9 Multi-agent & Cooperative Learning
9 Manifold Learning
8 Time-Series Analysis
8 Large-Margin Methods
8 Cost Sensitive Learning
7 Recommender Systems
7 Privacy, Anonymity, and Security
7 Neural Networks
7 Empirical Insights into ML
7 Bioinformatics
6 Information Retrieval
6 Evaluation Methodology
<5 each Text Mining, Rule and Decision Tree Learning, Graph Mining, 
    Planning & Control, Monte Carlo Methods, Inductive Logic Programming & Relational Learning, 
    Causal Inference, Statistical and Relational Learning, NLP, Hidden Markov Models, 
    Game Theory, Robotics, POMDPs, Geometric Approaches, Game Playing, Data Streams, 
    Pattern Mining & Inductive Querying, Meta-Learning, Evolutionary Computation

(*) Deadlines are magical, because they galvanize groups of people to concentrated action. But, they have to be real deadlines to achieve this, which leads us to reject late submissions & format failures to keep the deadline real for future ICMLs. This is uncomfortably rough at times.

12 Comments to “ICML+50%”
  1. Opt says:

    Surprised to see that many Reinforcement Learning papers. Didn’t know the area was *that* active!

  2. gnosis says:

    Do you have any stats on how many genetic algorithm, genetic programming, ant optimization and swarm optimization submissions there were? I’m assuming those all got bunched up under “optimization algorithms”.

    Also, it seems you have a section for “Neural Networks” and one for “NN & Deep Learning”. If the “NN” there stands for “Neural Networks”, shouldn’t those stats be merged (or further divided)?

  3. Anonymous says:

    So it looks like your blog advertisement for ICML was successful. :-)

  4. Very interesting, this and Researchers aim to chart intellectual trends in Arxiv by Eric Hand, Nature News 24 February 2012 make we wonder if other conferences keep track of submissions and if this could be an interesting dataset for scientometrics.

  5. Lev Reyzin says:

    Back of the envelope calculations tell me that the PC is large enough so that the load will be near the usual 7-8 papers per PC member. Does it mean you were expecting the increased number of submissions?

  6. jl says:

    For gnosis, areas are very fluid, with different names year to year, and the names having different meanings. The kind of optimization you mention probably has only a few submissions at ICML.

    For Lev, we assumed submissions <= 700 when planning.

  7. mazar says:

    Ready to take some of the load if you are planning to recruit new reviewers.

  8. Suresh says:

    Would we be informed if our submission was one of the instant rejects ? I’m now paranoid after you made that point :)

  9. Anon says:

    With 900 submissions, will the size of the conference increase or will the acceptance rate drop significantly?

    • jl says:

      I’d rather have the conference grow, as necessary. It’s not good to have a situation where there are two papers that everyone concurs is worth publishing, but one must be rejected, as decisions become political.

  10. [...] ??????????????????????????????????ICML?????????900?????66??????????????????????????????? [...]

Leave a Reply

Powered by WordPress