At many points in research, you face a choice: should I keep on improving some old piece of technology or should I do something new? For example:
- Should I refine bounds to make them tighter?
- Should I take some learning theory and turn it into a learning algorithm?
- Should I implement the learning algorithm?
- Should I test the learning algorithm widely?
- Should I release the algorithm as source code?
- Should I go see what problems people actually need to solve?
The universal temptation of people attracted to research is doing something new. That is sometimes the right decision, but is also often not. I’d like to discuss some reasons why not.
- Expertise Once expertise are developed on some subject, you are the right person to refine them.
- What is the real problem? Continually improving a piece of technology is a mechanism forcing you to confront this question. In many cases, this confrontation is uncomfortable because you discover that your method has fundamental flaws with respect to solving the real problem. Not going all the way means you never discover this, except the hard way—people lose interest in your work.
- Virtues of breadth When you go all the way, you gain breadth, with a deeper understanding about which problems are important and why. This can be invaluable in focusing your future research.
- More Tangible Accomplishment Going all the way means that you can point to your peers and say “I solved it”.
Going all the way is sometimes problematic in research. For example, a paper with a theory, an algorithm, and experimental results invites defeat-in-detail: a reviewer can disagree with any one of these components and eliminate it from consideration. Another issue is that academia doesn’t directly reward implementing and releasing algorithms. A third issue is that you will almost certainly discover topics of interest which don’t fit your home conference(s). It is also very difficult to publish a paper with the title “an incremental improvement on X (which makes it work great in practice)”.
Along with this advice, it is important to remember to fail fast, where appropriate. When you discover that an idea is not workable, quickly quitting it and moving on is a real virtue.