Whew! ScienceBlogs is back up. Mostly. There’s been some kinks, but so far things are mostly working. No LaTeX yet, but I’m agitating for it vigorously. Especially for the comments. The ability to work with equations is something that no self-respecting science blog should be without. I’m hopeful that the process will be simplified soon, and that you can write your own equations as well.

While things are still getting squared away internally, let’s tackle a simple question. What is science?

It’s a question that has come up several times when the various ScienceBloggers chat in our internal discussion forum, mainly with regard to the difference between science and pseudoscience. In one recent instance, I waded right in with my own opinion, which is that science is simply what you do when you test your ideas with experiment.

This would not do, said some people. What do you mean by test? What about sciences where repeatable experiment isn’t really possible, such as climatology, cosmology, or population ecology? What about theoretical ideas that aren’t yet testable, like string theory? What, if any, is the ontological status of falsifiability in all of this? Must the tests be numerical? Is it even possible to define science in an airtight way?

We went back and forth on those and other questions. Progress was limited, not least of the reasons why is that I’m only modestly familiar with the philosophy of science. I’m also strongly of the “shut up and calculate” persuasion and can’t escape thinking the whole thing is a waste of time. Still, it’s an interesting way to waste time. After bantering back and forth here’s what I concluded at least for myself. I don’t know if I convinced anyone else.

Science is the testing of ideas.

That’s all. Every technicality I can think of is avoided so long as the person doing the science is honest. Create fair and objective tests, try not to fool yourself or anyone else, don’t be wedded to your hypothesis, basic things like that. Be dishonest and I doubt there’s a definition in the world that some sufficiently clever pseudoscientist can’t wriggle out of. Test your ideas and be honest about it. That’s about it.

Maybe because I’m also a physics grad student but I think the simple definition you propose is perfectly fine. Science is when you make up some model, then compare it to the experimental evidence and reject it if it doesn’t fit. That’s it.

Not having easily repeatable experiments makes it harder but it doesn’t change the definition of science. Even in physics there are plenty of things you can’t experiment with – i.e. you can’t move a planet around to see how the gravitational force affects it; but that didn’t stop Newton from figuring out gravity (although admittedly there are many other easily repeatable experiments to verify gravity). Alot of astrophysics also has similar issues, it being a bit hard to make a supernova in your lab and all.

And theoretical ideas that aren’t yet testable are simply hypothesis without confirmation. So long as those proposing them are working towards having them verified experimentally someday, all’s well. Whether string theorists actually do that is another question that I don’t know the answer to.

I think your definition should be slightly expanded to be “Science is the testing of ideas through experiment and observation in a systematic way”

Some fields aren’t lucky enough to be able to set up nicely controlled experiments, but can still test their ideas based on observations of whatever system they are studying. It just makes drawing conclusions more difficult.

I don’t think its as simple as labeling the social and metal sciences “not science”. I myself am wary of them, however it is certainly possible for scientists in these fields to do things in controlled ways that allow them to draw strong conclusions, however it is my experience that some do not.

As long as one follows the scientific method in their investigations it should be considered science, regardless of the field.

I agree, with the small addendum that the ideas must be CONFIRMED by their testing. If the idea is discredited by testing and experimentation, then it shouldn’t be considered a part of science anymore.

Example: Astrology is an idea (The planets are indicative of terrestrial affairs), and it is tested all the time. That would make Astrology scientific by the above definition.

But if we include the addendum that the ideas must be confirmed by testing, then astrology is put in the proper non-scientific category.

I would say something slightly different from Max Fagin above: there’s nothing at all with mentioning Lamarck or phlogiston theory or heat fluid (or astrology) as failed theories. They are good examples of how science is able to dismiss demonstrably erroneous ideas, which is a critical component to the scientific enterprise.

As others have mentioned, your definition is probably too broad. I predicted the sunrise would be beautiful this morning. It was beautiful. Was that science?

Or: I prayed for happiness. I became happy. Was that science?

I do not think you can define “science” without the concepts of “precise statements”, “making predictions”, and “external world” (as in what you get from your senses, not just your internal mental states). Your definition only includes the “predictions” part, and that only implicitly.

I like the various proposed refinements; the problem is all of them lead into defining the words in the refinements and pretty soon it’s turtles all the way down. You can always fool yourself and finagle your way out of definitions if you try hard enough, because I’ve never yet seen a crackpot give up because he’s presented with a clever enough word game.

Some notes:
“Isn’t coming up with the ideas at least as important as testing them?”

Sure, the ideas have to come from somewhere. It’s not explicit in my wording, but it’s certainly required to have an idea to test in the first place.

“Or: I prayed for happiness. I became happy. Was that science?”

Sure. Doesn’t mean it was necessarily supernatural, but the mental effects of prayer are an active area of research. An n=1 sample size isn’t good, but every sample has to start somewhere.

“I agree, with the small addendum that the ideas must be CONFIRMED by their testing.”

Yes indeed. A test is intrinsically something that can be passed or failed, and having failed the test an idea ought to be abandoned unless further testing shows the first test to be faulty.

“Science is the search for naturalistic explanations of observable data by testable hypotheses”

The word “naturalistic” is optional, it is there to disqualify hypoteses of the kind “god did it” or “it just magicaly happend”… But those should be disqualified anyway by the requirement for testability of the hypothesis.

Also dont forget that the placebo effect to some might be proof that crackpot medicine works. Just about any ridiculous treatment gives positive results to some extent. Having the data support your hypothesis is vague

Well it seems that there is some form of consensus about what science is. To do science is “to test ideas”.

The rest of the discution is mainly about the nature of tests. What qualifies as a good test? Obviously “does it feel right?” is a bad test but “does it contradict the data?” is a good one. This is an interesting diskution indeed.

Another interesting discution would be “what constitutes a valid idea?”. Obvously testable is a requirement, if you cant test it that means it does not to any predictions and is thus not a scientific idea.

Funny you should mention that…
I just wrote about a study in which the authors basically took 70,000+ variables and looked for the one which was affected by a certain drug. They found one which was very reliably altered by that drug, and they found that it was also affected by other drugs of the same type, implying that it could be very useful for discovering new drugs.

But is that science? There’s no hypothesis. There’s just a huge amount of data being searched for something interesting. On my blog I said that it’s not science.

Have you read Karl Popper’s “Conjectures and Refutations”? It is available in paperback and I understood much of what he had to say.

Hypotheses are not confirmed; they are, at best, supported.

I like to think of scientific theories as not right nor wrong, but rather as more or less general in application. I’m pretty sure my house was built on a flat earth, for example. I suppose having no application would equal wrong.

With respect to Vangel and a few others, my introduction of testing of ideas in the humanities as a counter example is serious. What was Socrates doing if not testing ideas? His tests were verbal, not numerical, but rational. So, if numerical tests are excluded as too restrictive, then the humanities merge with the sciences. Unfortunately,if we go along with Popper we have to exclude from the sciences some disciplines now included. As an applied biologist and believer in natural selection, I find this painful.

I always like to think of science as a technique to remove bias from observation. Even something as simple as going to grocery store on a full stomach is a form of science because it acknowledges the bias and empty stomach can bestow upon innocent shoppers. We do science all the time we though it is admittedly as less formal version.

Science is a process that at the very least attempts to provide a well reasoned description of an observation.
The “at the very least” leaves the definition open ended , it could by many more things but must be this at the least.

Even at the most central, I’d add one weasel word: Science is the competitive testing of ideas.

More formally: Science refers to the process of gathering evidence, forming conjectures about the evidence, developing a formal hypothesis which indicates how the current evidence may be described under the conjecture, competitive testing of all candidate hypotheses under a formal criterion for probable correctness, plus the body of hypotheses testing best thereby and which thereafter are referred to as “Theories”.

The method of Testing used by Science is dependent on the philosophical assumptions that propositional logic is valid for formal inference, that joint affirmation on the Zermelo-Fraenkel Axioms is self-consistent, and that Reality is Relateable (with at most RE-comlexity) to Evidence.

Nemo:Isn’t coming up with the ideas at least as important as testing them?

Not so much, in that methodologically it doesn’t matter how you get your ideas, only that you have them. It does not matter if you get the idea via drinking excessive coffee, watching an apple fall by moonlight, take LSD and see snakes chasing each others’ tails, or even read answers inscribed on tablets of gold delivered by Seraphim choir. (As an anthropological practice, the last might require co-authorship for publication, but that’s incidental to the methodological requirements.)

“But is that science? There’s no hypothesis. There’s just a huge amount of data being searched for something interesting. On my blog I said that it’s not science.”

Neuroskeptic – how do you feel about metagenomics which generate a lot of data or pangenomes in Microbiology? I mean all of these studies could be said not to have a traditional hypothesis – in that they are go see type science. I believe their work is valid science. Is this considered “pseudoscience”?

I am very sorry to disagree with this definition. What you or I call testing and what a dowser calls testing have nothing in common, and yet all of us think we test our hypothesis honestly.

The James Randi Educational Foundation (JREF) regularly tests dowsers who honestly think their discipline has passed every necessary test and should not be considered pseudo-scientific.

Science includes work on every step of the knowledge gathering process: it includes the speculation on possible new hypothesis, thought experiments to seed new and future areas of investigation, definition of hypothesis, designing of experiments and observations, performing experiments and observations, analysis of results, even the teaching of the hypothesis and the methods of science.

But the main point of dissent is: what is a good-enough test? And the answer cannot be expressed in a few words. The farther down the previous list we are, the harder the tests get. But people will always be involved in deciding what is a good enough standard for that area of knowledge.

The site is currently under maintenance. New comments have been disabled during this time, please check back soon.