The Courage to Abandon a Beautiful Idea

One of the most difficult skills in research is not learning how to develop an idea, but knowing when to abandon one. Scientific training naturally emphasizes persistence. Researchers are taught not to give up when experiments fail, reviewers disagree, or evidence appears inconsistent with an initial hypothesis. This persistence is essential. Most important discoveries would never have been made without it.

Yet persistence has a less discussed counterpart. What happens when the idea itself is wrong? The problem becomes particularly difficult when a research program has developed over many years. A theory or methodology gradually accumulates papers, data, techniques, grants, students, collaborations, and professional recognition. What began as a hypothesis becomes an intellectual ecosystem.

At that point, abandoning the idea is no longer a simple scientific decision. There are also powerful intellectual mechanisms that favor continuation. When observations conflict with a theory, it is often reasonable to refine an assumption, introduce another parameter, examine a subgroup, or improve the experimental design. Science progresses through exactly such refinements. But this creates a subtle danger. Each individual modification may be scientifically defensible while the research program as a whole gradually becomes insulated from the possibility of failure. Instead of asking whether the underlying direction is wrong, increasingly sophisticated explanations can be constructed for why disappointing evidence does not yet invalidate it.

Research intended to test an idea can quietly become research designed to protect it. This need not involve dishonesty or poor science. It can emerge naturally from the structure of modern research. Publications encourage continuity. Expertise rewards specialization. Grants are easier to justify when investigators can demonstrate a long record in the field. Students inherit methodologies from their supervisors, and scientific communities develop specialized conferences, terminology, journals, and standards of evidence.

Eventually, an idea acquires its own institutional momentum. This is essentially a scientific version of the sunk-cost problem. The cost of changing direction grows with every year invested in the existing one. Paradoxically, greater intellectual sophistication does not necessarily solve the problem. It may sometimes make it worse. The more powerful our analytical tools become, the easier it is to construct plausible explanations for unexpected results.

For this reason, one of the most important qualities in science may be intellectual courage—the courage to destroy a beautiful idea that has become difficult to abandon.

Persistence, Courage, and Judgment. 

I would adapt a familiar idea into a principle for research: (i) the persistence to achieve what can be achieved, (ii) the courage to abandon what cannot—or should not—be achieved, and (iii) the judgment to know the difference. The last may be the most difficult. And that judgment must include economic value.

A scientific objective should not be evaluated only by asking, "Can it eventually be done?" Given enough time, money, and technological progress, many extraordinary things may eventually become possible. The more important question for society is often: Is this objective worth the resources required to achieve it?  A technically achievable goal can still be a poor research objective if its expected social value is small relative to its cost, or if a simpler technology can produce most of the benefit at a fraction of the resources. This is why even the grandest scientific ambitions must remain open to abandonment.

AGI, large-scale quantum computing, commercial fusion power, human exploration of Mars, and humanoid robots designed to replicate human intelligence may one day prove transformative. But the grandeur of these ambitions should not shield them from scrutiny. We must ask whether another decade, another hundred billion dollars, or another generation of researchers is justified by the likely return. When the benefits no longer justify the costs, we need the courage to abandon these ambitions as major research priorities, even if modest exploratory work continues. AGI illustrates the problem: public debate too often turns speculative warnings by prominent researchers into confident predictions. Before making AGI a research priority, we should ask what can actually be built, at what cost, and what more achievable goals we would have to forgo.

This scrutiny is especially important when a technology depends on overcoming several fundamental barriers at once. Progress in one component may be scientifically impressive without making the complete system economically viable. Quantum computing, for example, may yield important advances in quantum science even if large-scale, economically useful quantum computers remain out of reach. Scientific progress and technological viability are different measures of success. Continued major investment may sometimes be justified, but we must be willing to conclude that it is not.

Meanwhile, less spectacular technologies may deserve far greater commitment. I am more optimistic about agentic AI, advanced nuclear power, reusable commercial space systems such as SpaceX’s, and robots designed to assist humans rather than replicate them. These technologies pursue more bounded objectives and can deliver useful results even before their longer-term ambitions are realized.

The distinction is not between ambitious and unambitious science. It is between aspiration without an economic test and disciplined ambition. A sound research program should demonstrate not only scientific progress but growing value relative to the resources it consumes. Otherwise, persistence can become an excuse for avoiding a difficult decision.

Learning to let an idea fail.  This principle also has consequences for scientific education. In research training, I have found it valuable to create situations in which ideas—not the people proposing them—are placed under sustained pressure. Extended discussions, intensive workshops, and critical presentations can serve this purpose well. The objective is not simply to produce polished presentations or manuscripts, but to expose weaknesses in an argument before they become deeply entrenched. 

A difficult question may return later in a discussion. An assumption challenged at one stage may eventually have to be defended, modified, or abandoned. Unlike a conventional seminar, sustained discussion allows enough time for an argument to collapse and then be reconstructed. The purpose is never humiliation. It is to make intellectual failure ordinary.

Researchers need to learn that when an argument fails, defending it indefinitely is not necessarily persistence. Sometimes the correct response is simply: This part is wrong. Let us throw it away and begin again. Creating an environment in which this can happen requires time and effort, but I have come to regard it as an important part of scientific education. The objective is not merely to produce another paper. It is to develop researchers who can survive the destruction of their own ideas.

The problem becomes harder with AI. 

This ability may become even more important in the age of artificial intelligence. AI is rapidly making technical sophistication less scarce. It can search enormous literatures, write code, perform statistical analyses, construct models, and generate elegant scientific arguments. It can also produce increasingly plausible explanations for why inconvenient observations might still be compatible with an existing theory. The danger, therefore, is not that future researchers will lack sophisticated tools. They may have too many of them. The more powerful our tools for explaining results become, the more important it becomes to know when we should stop explaining and start questioning the premise itself.

A scientist should therefore periodically ask two deliberately uncomfortable questions: What evidence would convince me that I am wrong? And: Even if I am right, is solving this problem worth the resources it will consume? The first question protects science from intellectual self-deception. The second protects society from technological self-indulgence. Scientific progress therefore requires two apparently contradictory virtues.

The first is persistence. Important problems rarely yield easily. Researchers must tolerate repeated failure, uncertainty, criticism, and long periods without visible progress.

The second is abandonment. When the fundamental direction is wrong—or when the expected benefit no longer justifies the cost—persistence becomes a liability. The difficult part is knowing which situation we are in. Persistence in the right direction can produce a breakthrough.

Persistence in the wrong direction can sustain a research program for decades. Perhaps one of the most important things we can teach the next generation of researchers is not simply how to solve difficult problems, but how to decide which difficult problems remain worth solving.