We often talk about science as if its defining feature were novelty.
A scientist discovers something nobody has seen before. A new species is found. A new gene function is reported. A new mechanism is proposed. A new theory explains an old observation.
And because scientific papers are expected to make a "novel contribution," it is tempting to equate science with discovering something new.
But that raises a deceptively simple question:
If an experiment tells us nothing new, is it still science?
And an even more interesting one:
If an experiment is perfectly reproducible, but the interpretation of its results is wrong, is it still science?
The answer to both questions is essentially yes—but with important distinctions.
Science is not the same thing as novelty. Novelty describes a contribution to knowledge. Science describes a way of generating, testing, communicating, and correcting knowledge about the world.
That distinction changes how we think about scientific research.
Science is more than discovery
Imagine that a researcher performs an experiment and obtains a result that has already been reported ten times.
At first glance, it might seem that nothing scientific has happened. There is no discovery. No new phenomenon. No new fact.
But suppose the researcher carefully repeats the experiment with a different population, laboratory, instrument, organism, or environmental condition.
The result is again obtained.
The experiment has not necessarily produced a novel fact. But it has done something scientifically valuable: it has provided confirmation.
Science does not consist only of asking:
"What has nobody seen before?"
It also asks:
"Is what we think we know actually reliable?"
That is why replication matters.
A replicated result may be completely unsurprising, yet still contribute to the reliability of scientific knowledge.
Discovery is science—but science is not only discovery
The U.S. National Academies describe scientific knowledge as developing through discovery, confirmation, and correction.
That three-part description is useful because it immediately takes us beyond the popular image of the lone scientist making a spectacular discovery.
Consider three researchers.
Researcher 1: Discovery
They investigate a poorly studied organism and discover that a particular gene is completely absent from its genome.
Nobody had previously reported this.
If the observation is supported by appropriate genomic evidence, this is a scientific discovery.
It adds something previously unknown to our knowledge of nature.
Researcher 2: Confirmation
Another scientist investigates the same gene in independently generated genomes and finds the same absence.
They haven't discovered a new fact.
But they have strengthened the evidence that the original observation was genuine.
That is also science.
Researcher 3: Correction
A third scientist discovers that both studies overlooked a highly divergent copy of the gene.
The apparent "gene loss" was actually an annotation problem.
Again, science has happened.
The third study has not merely failed to discover something new. It has corrected an existing scientific claim.
And correction is not an embarrassment that sits outside science.
It is one of the ways science works.
What about a wrong interpretation?
This is where things become particularly interesting.
Suppose an experiment is beautifully designed.
The measurements are reliable.
The experiment is independently replicated.
Everyone agrees on the observed result.
But the researchers interpret the result incorrectly.
Does that make the experiment non-science?
No.
We need to separate the observation from the interpretation.
Consider this simplified chain:
Experiment → Data → Observation → Interpretation → Conclusion
Each step makes a different claim.
Suppose an experiment shows that treatment X causes gene Y to become more highly expressed.
That observation may be completely reproducible.
The researchers then conclude:
"Therefore, gene Y causes cell proliferation."
But their experiment never manipulated gene Y. It only measured its expression.
The causal interpretation may therefore be wrong.
The experiment can still be scientifically sound.
The data can still be scientifically useful.
The conclusion can still be wrong.
And, importantly, discovering that the conclusion was wrong can itself become part of science.
Reproducibility does not make an interpretation true
This distinction is easy to miss.
We sometimes talk about reproducibility as though it were a guarantee of truth.
It isn't.
Imagine that ten laboratories independently reproduce an experimental observation.
That gives us increasing confidence that the observation is real.
But it does not necessarily establish that we understand what the observation means.
You can therefore have:
Highly reproducible data + highly reproducible analysis + an incorrect interpretation.
Consider a diagnostic assay that consistently produces a particular molecular signal.
The reproducibility tells us that the signal is reliably generated.
But we still have to establish what the signal represents.
Is it:
- the presence of a particular protein?
- a cross-reacting molecule?
- a degradation product?
- a related paralog?
- an artifact of the assay?
- or genuinely the biological entity being claimed?
Reproducibility answers one question:
"Does this observation reliably occur?"
It does not necessarily answer:
"Why does it occur?"
And certainly not:
"Does our preferred explanation for it have to be true?"
An experiment can be scientific even when its conclusion is wrong
This is an uncomfortable but fundamental feature of science.
Science is not a magical procedure that converts experiments into truth.
Scientists can make mistakes.
They can misunderstand mechanisms.
They can overinterpret correlations.
They can mistake artifacts for biological signals.
They can construct explanations that later turn out to be wrong.
What distinguishes science is not that scientists are always correct.
It is that scientific claims are supposed to remain open to empirical challenge and correction.
A wrong scientific hypothesis can therefore be perfectly legitimate science.
The problem arises when the evidence is presented as establishing something it does not establish, particularly when alternative explanations are ignored or contradictory evidence is suppressed.
The experiment may remain scientific.
The claim about what the experiment demonstrates may not.
Does science require novelty?
This is where scientific research and scientific publishing sometimes get confused.
There are at least two different questions:
Question 1
Is this science?
Question 2
Is this a sufficiently novel contribution to publish in this particular journal?
They are not the same question.
A replication study can be science even if a journal decides that it lacks sufficient novelty.
A careful reanalysis of existing data can be science.
A correction of an existing result can be science.
A negative result can be science.
A methodological validation can be science.
A failure to reproduce an influential result can be science.
A careful measurement that confirms something we already strongly suspected can be science.
None necessarily requires discovering a previously unknown fact.
Novelty is therefore a property of the contribution, not the defining property of science itself.
What kinds of science can lack novelty?
Consider several possibilities.
1. Replication
"We performed the experiment again and obtained the same result."
No new phenomenon may have been discovered.
But the reliability of the existing observation has been tested.
Science? Yes.
2. Confirmation
"Using an independent method, we obtain evidence consistent with the existing conclusion."
Again, there may be little or no novelty in the phenomenon itself.
But independent evidence can strengthen scientific knowledge.
Science? Yes.
3. Falsification or refutation
"We tested a previously accepted prediction and found that it does not hold."
This may not discover a new phenomenon.
Instead, it removes support from an existing explanation.
Science? Absolutely.
4. Correction
"The earlier observation was real, but the proposed explanation was incorrect."
The new study may not discover anything fundamentally new.
It may simply establish that our interpretation of existing evidence needs revision.
Science? Yes.
5. Methodological validation
"We tested whether this experimental technique actually measures what researchers think it measures."
The study may produce no new biological discovery whatsoever.
But it can establish whether a tool is reliable.
Science? Yes.
6. Negative results
"We predicted that X would happen, but under these conditions it does not."
The absence of an expected effect can be scientifically informative.
Indeed, a scientific framework in which only positive results count would systematically distort our understanding of nature.
Science? Yes.
7. Reanalysis of existing data
Suppose all the data already exist.
A researcher develops a new statistical analysis and asks whether the original conclusion follows from the data.
No new experiment is performed.
No new organism is collected.
No new molecule is discovered.
Yet the analysis may reveal that the original conclusion was unsupported—or that an overlooked pattern exists in the existing data.
Science? It can be.
Science is not defined by whether new data were personally generated. It is defined by what is being done with evidence and how claims about the world are evaluated.
But then what is novelty for?
If novelty isn't what makes something science, why do scientists care so much about it?
Because science is not only about producing reliable knowledge.
It is also about extending the frontier of knowledge.
A research paper generally needs to answer:
"What does this work add?"
That addition might be a new observation.
Or a new explanation.
Or a new method.
Or stronger evidence.
Or a correction.
Or a previously unrecognized limitation.
Or a demonstration that a supposedly general phenomenon does not generalize.
Thus, novelty is enormously important for scientific progress and publication, even though it is not the defining characteristic of scientific activity.
A useful distinction is:
Science asks whether a claim is empirically justified.
Scientific novelty asks whether the resulting knowledge adds something not already known.
Those are different axes.
And what about an incorrect scientific paper?
This brings us to perhaps the most uncomfortable conclusion.
A paper can be:
- scientifically conducted,
- carefully executed,
- reproducible,
- transparently reported,
and nevertheless contain a wrong interpretation.
That does not necessarily mean the work was "not science."
Instead, we should ask which component is wrong.
Perhaps the measurement was wrong.
Perhaps the experiment was incapable of distinguishing competing hypotheses.
Perhaps the statistical inference was inappropriate.
Perhaps the causal interpretation went beyond the evidence.
Perhaps the biological mechanism was misunderstood.
Perhaps a later study revealed an overlooked alternative explanation.
These distinctions matter because otherwise we fall into a binary way of thinking:
Correct = science
Incorrect = not science
But science doesn't work that way.
If it did, there would be no need for scientific correction.
The deeper idea: science is a process, not a truth machine
Perhaps the most useful way to think about science is not:
Science = discovering new facts.
Nor:
Science = producing correct answers.
Rather:
Science is a systematic, evidence-based process through which claims about the natural world are generated, tested, challenged, communicated, confirmed, refined, and corrected.
Within that process, discovery is one activity.
Replication is another.
Confirmation is another.
Refutation is another.
Correction is another.
And explanation is another.
Some produce novelty.
Some don't.
Some ultimately produce correct conclusions.
Some don't.
Yet all can participate in science.
The paradox
There is therefore a fascinating paradox at the heart of science:
A study can be scientifically valuable without discovering anything new.
And:
A study can discover something genuinely new while getting its interpretation wrong.
The first tells us that novelty is not necessary for something to be science.
The second tells us that being new is not sufficient for something to be scientifically established.
What matters is the relationship between evidence and claims.
A new observation requires evidence.
An old observation can be tested again.
An interpretation must be justified.
A conclusion must not exceed what the evidence supports.
And when we get something wrong, science has a mechanism—at least in principle—for finding out that we were wrong.
Perhaps that is a more useful definition of science than the popular image of scientists constantly discovering spectacular new things.
Science is not simply the business of finding what nobody knew before.
It is the collective process of figuring out what we have good reason to believe about the world—and continuously finding out where we were wrong.
No comments:
Post a Comment