Criticisms of Dembski's <i>No Free Lunch</i> go unnoticed . . . again and again

Posted 23 August 2011 by

Over at Uncommon Descent, Eric Holloway has declared that the critics of William Dembski's 2002 book No Free Lunch actually accept that the No Free Lunch Theorem applies to evolution. He uses as his evidence the replies to Dembski's use of the NFLT by Allen Orr and by David Wolpert (who co-wrote the original NFL paper). They had argued that evolution was a more complicated process than the simple model used in the NFLT, a model that for evolution would associate fitnesses with genotypes in a simple search for the genotype of highest fitness. So aren't computer scientists (Wolpert) and biologists (Orr) implicitly acknowledging that the NFLT theorem applies to any such simple model, and prevents it from searching effectively? But there have been other criticisms of Dembski's use of the NFLT, and Holloway does not cite them. I summarized them in a 2007 article I wrote in Reports of the National Center for Science Education. And in the matter of the use of the NFLT my criticisms were actually not new --- as I noted there, the fundamental point had been made many times since 2002, originally in a 2002 article by Richard Wein, and also in articles by Jason Rosenhouse (2002), Mark Perakh (2003), Jeffrey Shallit and Wesley Elsberry (2004), Erik Tellgren (2005), and Olle Häggström (2007). I will immodestly claim that my article is the clearest of these many clear articles. So what is this oft-repeated criticism? When we have a simple model of evolution with genotypes and phenotypes, the NFLT argues that if we average over all the ways that set of fitnesses could be associated with the genotypes, that a simple model of search that climbs uphill on the fitness surface cannot do any better than a random search by pure mutation (one which is unaided by natural selection). That is disastrously bad. It sounds like it says that natural selection in such a model cannot work at all. But notice the averaging part. It is critical to Wolpert and Macready's theorem. In effect, it says that we are dealing with an infinitely rough fitness surface. If we change a genotype by making one mutation --- changing a single position in its DNA --- we arrive at a genotype whose fitness is randomly chosen from the whole set of possible fitnesses. In effect, a single mutation has the same effect as mutating every site in the genome simultaneously. (I apologize for shouting, but the point is not being noticed over at UD). Of course real biology doesn't work like this. Mutations are on average worse, but they mostly don't instantly reduce the organism to rubble. In the real world, nearby genotypes are usually similar in fitness --- often a bit worse but sometimes a bit better. In the NFLT world essentially all mutations are disastrous, and evolution would not work. So the No Free Lunch Theorem does not model real biology, not even in a simple model of evolution searching for genotypes of higher fitness on a fitness surface. So far Holloway has not cited any of these criticisms, and when asked by a polite commenter whether there are any such criticisms, he has simply declared that
I spent some time reading the critics, and this bore [sic] my frustration. I could not find one author who treated Dembski's work fairly! If someone could fairly refute Dembski's work I'd be all over it, but I haven't found anyone! Instead its all passive aggressive ad homineum [sic] and brow beating, with ample burning of strawmen, very tiring to read.
So the discussion at UD continues, hermetically sealed in a self-reinforcing bubble (though I notice now that in that discussion Elizabeth Liddle has tried to raise the relevant point). Note added 8/29/2011: Eric Holloway has now replied to this post in a post he made recently at Uncommon Descent. For my response to this reply, see the two comments I have made below dated 8/29/2011 at 1:17am and the one following that.

139 Comments

mrg · 23 August 2011

I'm not entirely following all of the NFLT argument for ID because it screams "red herring" on the face of it, and it is uninteresting to work to learn something just to confirm that yes, it is as bogus as it appears ...

... but it seems the root fallacy is like that of a supply officer for a military unit who determines the average size of the troops in the unit, and then obtains uniforms for them all in that one size.

Reed A. Cartwright · 23 August 2011

I think it's the other way around. It's like a supply officer saying that it is impossible to order uniforms for a unit because the sizes of troops are random.

Of course, one can go out and measure a specific unit and order the uniforms that fit them.

mrg · 23 August 2011

Reed A. Cartwright said: Of course, one can go out and measure a specific unit and order the uniforms that fit them.
Or even, for that matter, obtain a set of uniforms with quantities declining on both sides of the mean -- which is how logistics works in the real world. "Random does not mean incoherent."

Reed A. Cartwright · 23 August 2011

Well in my army, everyone get hand tailored uniforms because the military-sartorial complex is too powerful in Washington. Gotta spend the tax dollars somewhere.

mrg · 23 August 2011

Reed A. Cartwright said: Well in my army, everyone get hand tailored uniforms because the military-sartorial complex is too powerful in Washington. Gotta spend the tax dollars somewhere.
Huh? Tailored fatigues? Was this the same Army I was in? Reminds me of the graffiti I saw in a latrine in Basic at Ford Ord: "If my mother wanted me to be a soldier, I would have been born with green baggy skin." But that may have been the era before starch went away.

RodW · 23 August 2011

So what has Dembski said in reply to these criticisms?

mrg · 23 August 2011

He says: "I don't have to match your pathetic level of detail."

ogremk5 · 23 August 2011

I think the whole point of that article on UD was to make that ONE quotemine of Wolpert.

harold · 23 August 2011

Uncommon Descent used to be amusing because of the unstable nature of Dembski and DaveScot (maybe I'm crazy, but I always wondered if the latter was Berlinski - but of course, extreme arrogance, foul temper, and claims of mathematical genius are a common trait cluster).

Now it's just a rubber room for a tiny cult of not-very-bright deniers. I doubt if there's much of a recruitment rate.

Possibly relevant - there has been some evidence of increased acceptance of evolution in polls since 2005.

I've often complained about polls that bias the question with implications that accepting evolution contradicts religion. This latest Gallup poll simply used a "yes, no, don't know" structure. The response of science supporters has been, understandably, to complain about the mere 39% "yes" rate, but look at the rest. Only 25% outright deny evolution. I personally see it as a sign of honesty that 36% admit they "don't know". Also, when broken down by education, the "yes" to "don't know" ratio increases, which suggests honest answers. I'd certainly like to see more "yes", but a 39:25 "yes/no" ratio is probably an improvement over past levels. http://www.gallup.com/poll/114544/darwin-birthday-believe-evolution.aspx

Also, FASEB did a poll, the raw results of which I can't find, in 2008. They claim a 61% rate of acceptance of evolution among Americans. That poll was apparently structured in the biasing "did God create humans of did they evolve" format, but nevertheless, "only evolution" and "evolution guide by God" apparently combined to 61%. I need to find the raw questions and how the sampling was done, but that seems like an improvement over similar polls of the past. Caveat - FASEB is a "pro-science" source, of course.

Obviously, we can't be sure whether any of this is related to ID. But one possible tentative conclusion is that the whole ID scheme backfired. Bringing evolution into the media again and provoking scientists to make strong rebuttals mildly to moderately increased public understanding and acceptance of evolution. As I said, this is just a tentative, hypothetical idea, but it's intuitively credible.

In particular, it fits with my personal experience from the early heydays of ID - when I tried to actually explain ID and counter it with an explanation of evolution to actual neutral people from non-science backgrounds, they saw the logical flaws in ID much more quickly than I expected (which is evidence of how dishonest and/or conflicted creationist trolls are).

mrg · 23 August 2011

harold said: Uncommon Descent used to be amusing because of the unstable nature of Dembski and DaveScot (maybe I'm crazy, but I always wondered if the latter was Berlinski - but of course, extreme arrogance, foul temper, and claims of mathematical genius are a common trait cluster).
"Mad yes, scientist no." There was something flamboyant and outrageous about Dembski. ID now seems to be dominated by the Denyse O'Luskin crowd, who are simply dull and whiny.

https://me.yahoo.com/a/Qjp5enRppdSW.nr6IdCgLASLhOc-#9be9d · 23 August 2011

Eric Holloway once said this:
Interestingly, Kolmogrov [sic] complexity is uncomputable [sic] in the general case due to the halting problem. This means that in general no algorithm can generate orderliness more often than is statistically expected to show up by chance. Hence, if some entity is capable of generating orderliness more often than statistically predicted, it must be capabable [sic], at least to some extent, of solving the halting problem.
It's like gibberish for weasels. And GodEntity can make immovable rocks He can move. At least to some extent. And "Kolmogrov" is spelled that way for many paragraphs.

eric · 23 August 2011

https://me.yahoo.com/a/Qjp5enRppdSW.nr6IdCgLASLhOc-#9be9d said: Eric Holloway once said this:
Interestingly, Kolmogrov [sic] complexity is uncomputable [sic] in the general case due to the halting problem.
AIUI, "in the general case" is the same flaw (or directly analogous to) the one Joe cited above. Kolmogorov - in reference to a single, actual programming language (rather than the infinite variety of possible programming languages), this problem disappears. NFLT - in reference to a single, actual real world (rather than some average over "all the ways" fitnesses could be associated with genotypes), this problem disappears.

rni.boh · 23 August 2011

In effect, a single mutation has the same effect as mutating every site in the genome simultaneously. (I apologize for shouting, but the point is not being noticed over at UD).
IIRC, DaveScot got this point, and commented somewhere that he had told Dembski that this pushes ID back to cosmological ID. Of course, Dave is a UD outcast too, nowadays.

mrg · 23 August 2011

rni.boh said: IIRC, DaveScot got this point, and commented somewhere that he had told Dembski that this pushes ID back to cosmological ID.
Of all the lunacies of creationists, one of the most baffling is the insistence that the Big G had to have created the Universe, but also has to keep on tinkering with it on an ongoing basis (or put otherwise, the Big G could not have "intelligently designed" evolution). They will go to every mad length to maintain this logical disconnect, since if that barrier falls they become TEs. "And this would be bad because why?" The only reason I can think of for playing this game is to protect scriptural literalism, but I'm unsure if that's the only motive.

Joe Felsenstein · 23 August 2011

RodW said: So what has Dembski said in reply to these criticisms?
Over the years, basically nothing, even when he wrote The Design Revolution which had as its subtitle "Answering the Toughest Questions About Intelligent Design". But he didn't answer that criticism. But he very quietly, implicitly, acknowledges it by bringing forth his (and Robert Marks's) Search For A Search argument: if fitness surfaces are smooth (so that natural selection will work) this is supposedly because they are "front-loaded" to allow this. My own reaction (see here) is that the weakness of interactions at a distance in physics is sufficient to make fitness surfaces smooth. For example a gene affecting my eye pigment typically does not interact strongly with one that affects the length of my big toe, and that is not evidence that some Designer has been tinkering around.

Rolf · 23 August 2011

The only reason I can think of for playing this game is to protect scriptural literalism, but I’m unsure if that’s the only motive.

I suggest This as the ultimate objective.

harold · 23 August 2011

It’s like gibberish for weasels.
The word "like" is superfluous here.
Of course, Dave is a UD outcast too, nowadays.
He was, uproariously, banned from UD in 2009. Apparently his head didn't explode after Dover, despite his prediction that the school board would win the case because Judge Jones is an ostensible "good ol' boy appointed by George W. hisself". (A prediction which unwittingly concedes that the creationists could only win via unethical judicial bias, but incorrectly predicts such bias.) Not that I pay much attention, but that particular username seems to have disappeared after the UD banning. He may still be out there. He may still be out there, babbling on UD in a more compliant manner, under a new username.
The only reason I can think of for playing this game is to protect scriptural literalism, but I’m unsure if that’s the only motive
Yes, of course that is the only direct motive. Creationism in public schools has been a religious right obsession since the dawn of America's decline into a second rate right wing dystopia. The point of creationism is authoritarianism. Economic decline for most people and a fair degree of blocking the progress of ethnic minorities has been achieved, but pesky women haven't given up their new rights, and gays have made progress. To justify denying rights to relatively popular and affluent groups, some claim that "you can't support that even if you think you agree with it" has to be made. You can't "interpret" the Bible because some other guy can "interpret" it the opposite way. So you have to claim it's "literally true". But since Genesis is at odds with modern science, to claim that, you have to claim that modern science is wrong. Hence "creation science". But "creation science 1.0" was thrown out in courts, due to occasional respect for America's vestigial constitution. ID always was nothing but a "court proof" version of "creation science". It's sole content can be summarized as this - "Forget the evidence, here's a crazy reason why 'evolution can't be true'; so what else happened, well, 'the designer could be an alien, judge, wink, wink', but of course, kids, it could also be right wing Jesus - you decide kids, which makes more sense, 'an alien', or Jesus?" It was always just "creation science 2.0, now with more weasel words!".

mrg · 23 August 2011

harold said: Yes, of course that is the only direct motive.
I have this suspicion that there are other motives lurking in there. There are creationists who are not fundies; they are rare, of course, and since it is hard to understand why anyone who wasn't a fundy would want to be a creationist, they have to be far crazier than anyone could imagine.

Mike Elzinga · 23 August 2011

So the No Free Lunch Theorem does not model real biology, not even in a simple model of evolution searching for genotypes of higher fitness on a fitness surface.
I would suggest that it doesn’t even model the formation of Jell-O or rock salt.

Joe Felsenstein · 23 August 2011

Mike Elzinga said:
So the No Free Lunch Theorem does not model real biology, not even in a simple model of evolution searching for genotypes of higher fitness on a fitness surface.
I would suggest that it doesn’t even model the formation of Jell-O or rock salt.
The conditions of the NFLT may not model much of anything. But the simple model of genotypes with constant fitnesses is worth investigating (I know you didn't say it wasn't). Basically the NFL argument of Dembski was saying that natural selection could not work even in that simple model. The Orr-Wolpert Defense is basically irrelevant to that point -- we have to look at that simple model and see whether natural selection can work there. And in fact, once we look, we see that NS does work as the NFLT imposes an unreal condition on the way genotypes affect phenotypes. In cases with smoother fitness surfaces NS works fine. Looking over at UD, I thought Elizabeth Liddle was going to point this out -- but she diverted to the Orr-Wolpert Defense, alas. So it's still true that no one over there has answered -- or raised --the criticisms mentioned here.

https://me.yahoo.com/a/Qjp5enRppdSW.nr6IdCgLASLhOc-#9be9d · 23 August 2011

In addition to Dr. Felsenstein's smoothness argument, it seems to me........
The peaks in biology are not independent of the organisms' presence on them, but exhibit non-linear self-feedback. One way to get off being "trapped on a fitness peak" is to have lots of nearly identical offspring. Should they compete heavily with each other in the same niche, propagate disease, etc., average fitness will go down. Their (or some eventual even higher populated generation's) offspring can then wander around the fitness landscape again after the peak has been "leveled".

harold · 23 August 2011

mrg said:
harold said: Yes, of course that is the only direct motive.
I have this suspicion that there are other motives lurking in there. There are creationists who are not fundies; they are rare, of course, and since it is hard to understand why anyone who wasn't a fundy would want to be a creationist, they have to be far crazier than anyone could imagine.
Technically the point is not that they themselves are fundamentalist, but that they seek to make others fundamentalist, so that unpopular authoritarian policies can be pushed through on "Biblical" grounds. A Straussian desire to make the population appropriately God-fearing and science denying so that the correct right wing policies can be enforced tends to explain the rare oddballs like Berlinski. I suspect it explains Behe has well. I challenge you to name even one evolution denier who will openly deny the possibility that the earth could be 6000 years old. Anyone else who thinks they can find an OEC openly stating that the earth is definitively more than 6000 years old is welcome to take up this challenge. They fall in three clear groups - Openly claim that the earth is 6000 years old (common), privately claim that the earth is 6000 years old when in the right company but try to dissemble in public (common), or consistently claim that they "don't know" (rare but extant). There may or may not be super-rare members of a fourth category (crackpots who deny young earth openly but also deny evolution). I used to think there were such types but they always seem to turn out to be fundies in the end.

mrg · 23 August 2011

harold said: Technically the point is not that they themselves are fundamentalist, but that they seek to make others fundamentalist, so that unpopular authoritarian policies can be pushed through on "Biblical" grounds.
You are assigning to them greater logical capability than they possess. I think I figured out what my puzzlement on the issue of this logical disconnect is: they've been telling themselves this isn't about religion for so long that they honestly believe it, and when confronted with a gap in their thinking that apparently can only be plugged by "scriptural literalism", they simply pretend the gap isn't there. It isn't to fool anyone else, since it doesn't; it is just to fool themselves. I see these people as far crazier than you do. If you disagree, all I can say is I hope you're right, but I don't believe you are.

Joe Felsenstein · 23 August 2011

https://me.yahoo.com/a/Qjp5enRppdSW.nr6IdCgLASLhOc-#9be9d said: In addition to Dr. Felsenstein's smoothness argument, it seems to me........ The peaks in biology are not independent of the organisms' presence on them, but exhibit non-linear self-feedback. One way to get off being "trapped on a fitness peak" is to have lots of nearly identical offspring. Should they compete heavily with each other in the same niche, propagate disease, etc., average fitness will go down. Their (or some eventual even higher populated generation's) offspring can then wander around the fitness landscape again after the peak has been "leveled".
I think absolute fitness will go down, the question is whether relative fitness of different genotypes changes. This isn't obvious -- depends on how you have the ecology set up. The NFL argument applies to constant relative fitnesses. To refute it within that model you need to stay within that model and stick to that case.

harold · 23 August 2011

mrg -

I do assign them more "logic", in the sense of being consciously or unconsciously able to pursue their authoritarian goals, than some others do.

It's also true that the human mind is a complex thing.

If a used car salesman is trying to sell someone a car, a very concrete interpretation would be that the salesman is an idiot who sincerely believes everything he says about a lousy car. A slightly more sophisticated interpretation is that he's a conscious dastardly schemer who is secretly chuckling, and that's sometimes true. But perhaps more often, even while being driven by his desire to sell the car, he begins to believe
his own lines. Nevertheless, he wouldn't be issuing them if it weren't for his desire to sell the car.

What authoritarians with sexual, gender, and ethnic obsessions are trying to sell is more complex and abstract, but it's kind of the same.

Henry J · 23 August 2011

Anybody who thinks lunch is free hasn't been to a fast food place lately. :p

https://me.yahoo.com/a/Qjp5enRppdSW.nr6IdCgLASLhOc-#9be9d · 23 August 2011

Mike Elzinga · 23 August 2011

Joe Felsenstein said: The Orr-Wolpert Defense is basically irrelevant to that point -- we have to look at that simple model and see whether natural selection can work there. And in fact, once we look, we see that NS does work as the NFLT imposes an unreal condition on the way genotypes affect phenotypes. In cases with smoother fitness surfaces NS works fine.
I think your point about the smoothness of fitness landscapes is a crucial one; and I think it is more than metaphorical that it has its anchor in fundamental physics. Deep down in the quantum world of atoms combining with atoms, we may see things snapping into configurations determined by the rules of quantum mechanics. These tend to be at energies on the order of an electron volt or more. Changes at these levels are going to be influenced by energetic interactions with photons of at least that energy. However, once into the levels of complexity of solids and liquids and above – especially with what physicists refer to as “soft” systems (i.e. systems whose binding energies are comparable to the energies in the thermal baths in which they are immersed) – we almost never see things that snap from one configuration to another; something what would be suggestive of sharp-edged potential wells. If they do snap, there are wells involved that are considerably deeper than the kinetic energies in the ambient environment; and these wells have smooth edges. As we enter the realms of mesoscopic physics and macroscopic physics in these soft systems; and as these systems interact with the myriad of potential wells in their environment, smooth differentiable potential wells are the rule. Binding energies for the kinds of living systems we know about are on the order of a few hundredths to as much as a tenth of an eV. Action potentials are on the order of a tenth of an eV or less. Soft systems automatically imply smooth wells. You just can’t have a soft system with sharp wells; it would be either all locked together or all apart. Nothing at these levels is “jagged.” And even though fitness landscapes are not potential energy wells turned upside down, I suspect they are a phenomenological manifestation of the smoothness of the underlying physics (I don’t say chemistry at this point because traditionally we associate chemistry with the combinations of atoms and molecules at energies on the order of an eV and where quantum jumping results in “snapping together or snapping apart,”). So whatever quantum jumps that may take place in the chemical bonds that make up DNA and other underlying templates, by the time their impact on the higher levels of complexity are felt, it is pretty much all smoothness and only occasional snapping and “bumpiness.” Dembski, et. al. continue to make the fundamental mistake that atoms and molecules are just lying around to be picked up randomly and plopped into specified arrangements. All of Dembski’s sampling examples expose this misconception about chemistry and physics. It’s not sequences of ones and zeroes in complex systems. It’s generally a “bumpy slip-slide” in conjunction with an environment that preserves some configurations long enough to replicate themselves into subsequent generations. Soft systems in particular don’t generally behave like ones and zeroes.

mrg · 23 August 2011

https://me.yahoo.com/a/Qjp5enRppdSW.nr6IdCgLASLhOc-#9be9d said: Who is Eric Holloway?
AITSE -- clearly NCSE turned inside out.

Joe Felsenstein · 23 August 2011

mrg said:
https://me.yahoo.com/a/Qjp5enRppdSW.nr6IdCgLASLhOc-#9be9d said: Who is Eric Holloway?
AITSE -- clearly NCSE turned inside out.
I see Holloway is a computer science masters student now in the Air Force, went to college at Biola University (surprise!). He worked on evolutionary algorithms for his MSc. In his posting at UD he keeps calling for experts in computer science to defend evolution. I'm not sure that makes sense. Wolpert and Macready's original NFL theorem is true for general searches, no one is arguing it isn't. Once you get past that, the issue is whether it applies to biological evolution, and computer scientists won't know as much about that as mathematical and computational biologists, particularly population geneticists.

Tom English · 23 August 2011

Joe Felsenstein, Tweak: Wolpert and Macready are physicists. It seems to me that their claim in "Coeveolutionary Free Lunches" that the NFL theorem applies to biological evolution contradicts what Wolpert said in "William Dembski's Treatment of the No Free Lunch Theorems is Written in Jello":
Indeed, throughout there is a marked elision of the formal details of the biological processes under consideration. Perhaps the most glaring example of this is that neo-Darwinian evolution of ecosystems does not involve a set of genomes all searching the same, fixed fitness function, the situation considered by the NFL theorems. Rather it is a co-evolutionary process. Roughly speaking, as each genome changes from one generation to the next, it modifies the surfaces that the other genomes are searching. And recent results indicate that NFL results do not hold in co-evolution.
This is similar to what I wrote in "Evaluation of Evolutionary and Genetic Optimizers: No Free Lunch" (1996):
Do the arguments of this paper contradict the evidence of remarkable adaptive mechanisms in biota? The question is meaningful only if one regards evolutionary adaptation as function optimization. Unfortunately, that model has not been validated. It is well known that biota are components of complex, dynamical ecosystems. Adaptive forces can change rapidly and nonlinearly, due in part to the fact that evolutionary adaptation is itself ecological change. In terms of function optimization, evaluation of points changes the fitness function. The Conservation Lemma [from which the necessary and sufficient condition for NFL follows] clearly does not apply to such a process.
Wolpert and Macready found that their results regarding coevolution do not apply to biological coevolution. This does not imply that the NFL theorems apply. I sought clarification from Wolpert, but got an... unhelpful response. Nowadays I say without reservation that to regard biological evolution as fitness optimization is to let teleology slip through the back door. Optimization models are useful in certain limited contexts. But divergence of one biological type from another does not depend on the novel type being fitter in any sense than the original type. We know that mere geographic isolation, for instance, can do the trick. People are at a loss for a non-teleological verb to describe what life does as it evolves. Lately I've thought that life spreads. That seems particularly appropriate when one considers that bacteria comprise most of the Earth's biomass. Bacteria spread like a big infection into the damnedest places, without trying at all to do so. They've gotten into geyser pools, and they've gotten onto spent nuclear fuel rods. The spread of life is not optimization of fitness. Tom English

Tom English · 23 August 2011

Had some problems posting, and lost track of a revision: "But divergence of one biological type from another does not depend on either type being fitter than the other in any sense."

Mike Elzinga · 23 August 2011

Tom English said: ... People are at a loss for a non-teleological verb to describe what life does as it evolves. Lately I've thought that life spreads. That seems particularly appropriate when one considers that bacteria comprise most of the Earth's biomass. Bacteria spread like a big infection into the damnedest places, without trying at all to do so. They've gotten into geyser pools, and they've gotten onto spent nuclear fuel rods. The spread of life is not optimization of fitness. Tom English
A better description might be taken from physics by saying that life percolates. The processes of percolation are extremely complex when they involve many systems interacting. The systems are all continuously adjusting among themselves as they interact and percolate through each other. Another way to look at it is that such complexes of interacting systems are a mixture of thermodynamic processes all passing energy and matter among each other such that various free energies are minimized given the constraints imposed by the heat and matter bath in which they are all immersed. And there has to be a heat and matter bath that maintains these systems in a narrow temperature range in which they are “soft” enough to have billions of degrees of freedom, organization, and coordination, some of which are maintained by the energy and matter flow through them. There are, however, features that seem to be common to percolating systems, such as non-integer scaling laws in the development of branching structures. In the case of living systems, there is the additional issue of “pruning” of these structures that distorts the overall picture because such pruning is highly contingent on random events intruding from outside such a collection of systems coevolving, or “interpercolating.” But at the bottom of it all, it is the physics and chemistry of complex soft systems that “adapt” by passing on approximate replicas of themselves that branch around the “obstacles” or take advantage of "opportunities" in their paths, including other such systems doing the same.

Joe Felsenstein · 24 August 2011

Tom English said: Joe Felsenstein, Tweak: Wolpert and Macready are physicists.
Thanks for the reminder.
Tom English: [snip Wolpert and Macready quote] This is similar to what I wrote in "Evaluation of Evolutionary and Genetic Optimizers: No Free Lunch" (1996):
Do the arguments of this paper contradict the evidence of remarkable adaptive mechanisms in biota? The question is meaningful only if one regards evolutionary adaptation as function optimization. ... [snip description of complexities of evolution] The Conservation Lemma [from which the necessary and sufficient condition for NFL follows] clearly does not apply to such a process.
... Tom English
I think that, as much as we need to appreciate the complexity and subtleties of evolving living systems, simple models in which fitness is optimized are worth analyzing. Here Dembski's NFL argument is argued to show that fitness cannot be effectively increased even in such a simple model. That would be a major surprise. In fact, as the many critics I quoted (from Richard Wein on) pointed out, what was wrong with Dembski's argument was that it used the NFLT which required us to average the behavior of the optimization algorithm over all possible ways a bunch of fitnesses could be assigned to genotypes. But almost all of these make very jaggy fitness surfaces, nearly "white noise" surfaces. But real biology makes much smoother fitness surfaces. To my mind, that, and not the broader issue of whether fitness optimization is close to what living systems do, is the real objection to Dembski's argument. Your argument is an argument from the complexities of real organisms, but what I hear it doing is implicitly conceding that within a simple fitness optimization case Dembski's argument would be convincing. But no, his argument isn't convincing even there, as it relies on fitness surfaces that are unlike real biology. So it can be rejected without even getting to the complexities.

Rolf · 24 August 2011

A very interesting thread with ideas expressed that are in harmony with my way of thinking.

But with respect to Dembski I think we have to acknowledge that he has painted himself into a corner out of which the cost of backing out is preemptive.

Paul Burnett · 24 August 2011

Joe Felsenstein said: So it's still true that no one over there has answered -- or raised --the criticisms mentioned here.
...that we know of. Dozens or even hundreds of posts answering or raising criticisms may have been submitted, but not made it past the censors. They only let through stuff that reinforces their looniness.

SWT · 24 August 2011

Tom English said: Nowadays I say without reservation that to regard biological evolution as fitness optimization is to let teleology slip through the back door. Optimization models are useful in certain limited contexts. But divergence of one biological type from another does not depend on either type being fitter than the other in any sense. We know that mere geographic isolation, for instance, can do the trick.
Thanks for making this point; you managed to say in a couple of sentences what I was about to say in a couple of paragraphs.

ogremk5 · 24 August 2011

Joe Felsenstein said:
https://me.yahoo.com/a/Qjp5enRppdSW.nr6IdCgLASLhOc-#9be9d said: In addition to Dr. Felsenstein's smoothness argument, it seems to me........ The peaks in biology are not independent of the organisms' presence on them, but exhibit non-linear self-feedback. One way to get off being "trapped on a fitness peak" is to have lots of nearly identical offspring. Should they compete heavily with each other in the same niche, propagate disease, etc., average fitness will go down. Their (or some eventual even higher populated generation's) offspring can then wander around the fitness landscape again after the peak has been "leveled".
I think absolute fitness will go down, the question is whether relative fitness of different genotypes changes. This isn't obvious -- depends on how you have the ecology set up. The NFL argument applies to constant relative fitnesses. To refute it within that model you need to stay within that model and stick to that case.
Of course, this brings up a good point. If you have all these organisms that are near the 'peak of fitness'... what happens when the peak changes? Well, then those organisms are not the 'peak of fitness' anymore and the search continues. That's one major issue with Dembski's (and creationists) work. They fail to realize that not only to the organisms change, but the definition of fitness changes over time. For example, cheetahs are freaking fast, but they only catch the slowest gazelles, no one likes to work harder than they have to. So the fastest gazelles survive to reproduce. What was the peak of fitness 3 generations ago, is old tech now. Then, you can have a massive environment change (natural dam breaking, volcano, earthquake, global warming. Then the 'fitness landscape' underneath the organism radically shifts. What was the 'peak of fitness' last week, is now struggling to survive in the new environment, while the organism that struggled last week, is now much more fit. Regarding fitness of a species in isolation of the environment and the fitness of all species that interact with it is just wanking. It's totally useless in the real world (for all that it makes ID types feel good).

Starbuck · 24 August 2011

Is it still a barrier, though if the peak remains for a timescale thats larger than the timescale necessary to reach the peak?

Tom English · 24 August 2011

Rolf said: But with respect to Dembski I think we have to acknowledge that he has painted himself into a corner out of which the cost of backing out is preemptive.
Back in ARN days, I emailed Dembski to explain that he had gotten something wrong about NFL. He replied, "Well, don't expect me to admit that."

mrg · 24 August 2011

Joe Felsenstein said: I see Holloway is a computer science masters student now in the Air Force, went to college at Biola University (surprise!). He worked on evolutionary algorithms for his MSc. ... computer scientists won't know as much about that as mathematical and computational biologists, particularly population geneticists.
Long occupational experience with software jocks left me skeptical of them, and as far as regarding them as necessarily good sources of insight outside their domain of professionalism -- not a chance. Personal prejudices aside, there's the entirely familiar irony that creationists deride any evolutionary simulation as a "computerized just-so story" -- not without some cause, no simulation or analysis being any more valid than the assumptions on which it is based -- but eagerly embrace any and all anti-evolutionary simulations no matter how shoddy they are. Incidentally, AITSE appears to be a fancy website with little evidence that it's actively maintained. One of the interesting features is that a good number of the members are listed as "anonymous" ... there's something a little wrong with that picture.

harold · 24 August 2011

https://me.yahoo.com/a/Qjp5enRppdSW.nr6IdCgLASLhOc-#9be9d said: Who is Eric Holloway?
This is unbelievably infuriating. 1) More evidence that the taxpayers of the United States are being forced to support an Air Force that compromises its national security mission with religion-pushing. 2) I find it a sign of very poor character that this person is trying to deny a scientific field of which he is deliberately ignorant, and doing so in a forum the shields him from valid critiques of his work. 3) If he is posting creationist rants on Air Force time, that is a true outrage. Hopefully he's doing it all on his own time. However, I am skeptical of that. 4) A pattern of science denial among technical personnel is the last thing the Air Force needs. I very strongly support everyone's right to believe as they see fit. Merely being a creationist is his own business. It is clearly potentially compromising, in theory, to technological performance in the Air Force (for example, a flat earther would be a danger even in the most basic technical jobs), but his job may well be so compartmentalized that his denial of the underlying science that allows us to fly airplanes may not be significant. However, if he is being paid by the US taxpayer to perform national security duties in the Air Force, and is spending any part of that time posting divisive, ignorant science denial on the internet, he should be disciplined.

mrg · 24 August 2011

harold said: However, if he is being paid by the US taxpayer to perform national security duties in the Air Force, and is spending any part of that time posting divisive, ignorant science denial on the internet, he should be disciplined.
Hopefully if he's got any brains he knows better than to do it as any more than an off-duty hobby -- I'd think his CO would step on him pretty hard no matter what hobby he was into, if he was doing it on Uncle Sugar's time. But if it's just a hobby, and masquerading as "scientific inquiry", they would have neither motive nor inclination to hassle him about it. Not like that fool at NASA JPL who got into hot water selling creationism on company time.

Joe Felsenstein · 24 August 2011

harold said:
https://me.yahoo.com/a/Qjp5enRppdSW.nr6IdCgLASLhOc-#9be9d said: Who is Eric Holloway?
This is unbelievably infuriating. 1) More evidence that the taxpayers of the United States are being forced to support an Air Force that compromises its national security mission with religion-pushing.
He has a right to push his own views on his own time.
3) If he is posting creationist rants on Air Force time, that is a true outrage. Hopefully he's doing it all on his own time. However, I am skeptical of that.
We don't know whose time he posts on. Nor do we for most posters here. Let's concentrate on one undeniable fact -- he has his head up his ass. He has a right to have it there but it must be painful.

mrg · 24 August 2011

Joe Felsenstein said: Let's concentrate on one undeniable fact -- he has his head up his ass. He has a right to have it there but it must be painful.
It's a common disease in the military.

harold · 24 August 2011

Joe Felsenstein -

Yes, I very strongly support his right to hold and express his own views on his own time.

Joe Felsenstein · 24 August 2011

I was recently granted (by the PT powers-that-be) the power to manage comments here. Some seem to need approval by me (perhaps from people who are not logged in). I'm just learning the system.

If you posted a comment and it has not been approved, please be patient -- I just figured out that I need to do that. Now I need to rush off for several hours on other business. Please be patient, this is not censorship, it is merely incompetence.

mrg · 24 August 2011

Joe Felsenstein said: If you posted a comment and it has not been approved, please be patient -- I just figured out that I need to do that. Now I need to rush off for several hours on other business.
Any comments that I had that didn't get posted, delete them please. I was wondering why the system seemed so inconsistent on accepting and rejecting my postings.

eric · 24 August 2011

Tom English said: Nowadays I say without reservation that to regard biological evolution as fitness optimization is to let teleology slip through the back door.
I somewhat disagree. There's no teleology implied in saying proximate causes (like the environment and other animals) do the optimization. That's like saying gravity does the pulling. Now, I would agree that both 'the environment does...' and 'gravity does...' may give some people a linguistic sense of intelligent agency, design, or ultimate cause. So there may be a linguistic back door, even if there isn't a substantive one. But if 'gravity does the pulling' doesn't make you believe in god (and I find it hard to think anyone would take that sentence teleologically), then 'the environment does the selecting' shouldn't either. I also agree with you that optimization is not all that's going on. But local optimization over generations is part of it.

Richard B. Hoppe · 24 August 2011

mrg said:
https://me.yahoo.com/a/Qjp5enRppdSW.nr6IdCgLASLhOc-#9be9d said: Who is Eric Holloway?
AITSE -- clearly NCSE turned inside out.
I note that Caroline Crocker is President of that outfit.

mrg · 24 August 2011

Richard B. Hoppe said: I note that Caroline Crocker is President of that outfit.
Yeah, I saw that and it rang a bell. On investigation: "Oh, THAT Carolyn Crocker!" Such an appropriate name. From what I saw of AITSE it seems to be a fancy website that sees very little maintenance. One interesting factoid was how many of the members were listed as "anonymous" -- "there's something a little funny about this picture."

https://me.yahoo.com/a/Qjp5enRppdSW.nr6IdCgLASLhOc-#9be9d · 24 August 2011

The Biola Doctrinal Statement, accepted by all Holloway's professors:
The origin of the universe, the origin of life, the origin of kinds of living things, and the origin of humans cannot be explained adequately apart from reference to that intelligent exercise of power. A proper understanding of science does not require that all phenomena in nature must be explained solely by reference to physical events, laws and chance. Therefore, creation models which seek to harmonize science and the Bible should maintain at least the following: (a) God providentially directs His creation, (b) He specially intervened in at least the above-mentioned points in the creation process, and (c) God specially created Adam and Eve (Adam’s body from non-living material, and his spiritual nature immediately from God). Inadequate origin models hold that (a) God never directly intervened in creating nature and/or (b) humans share a common physical ancestry with earlier life forms.
(Biola also insists on this, although perhaps not limited to those w/ skirts and bellbottoms.)

SWT · 24 August 2011

eric said:
Tom English said: Nowadays I say without reservation that to regard biological evolution as fitness optimization is to let teleology slip through the back door.
I somewhat disagree. There's no teleology implied in saying proximate causes (like the environment and other animals) do the optimization. That's like saying gravity does the pulling. Now, I would agree that both 'the environment does...' and 'gravity does...' may give some people a linguistic sense of intelligent agency, design, or ultimate cause. So there may be a linguistic back door, even if there isn't a substantive one. But if 'gravity does the pulling' doesn't make you believe in god (and I find it hard to think anyone would take that sentence teleologically), then 'the environment does the selecting' shouldn't either. I also agree with you that optimization is not all that's going on. But local optimization over generations is part of it.
IMO, the teleology is implicit in "optimization" -- finding an optimum means defining what's optimal. If I take a non-equilibrium system and let move to equilibrium, it will reach a minimum free energy state. Is that state "optimum"? Only if someone says it is.

mrg · 24 August 2011

Joe Felsenstein said: Please be patient, this is not censorship, it is merely incompetence.
"Inexperience". Easily forgiven.

Joe Felsenstein · 24 August 2011

https://me.yahoo.com/a/Qjp5enRppdSW.nr6IdCgLASLhOc-#9be9d said: The Biola Doctrinal Statement, accepted by all Holloway's professors: ... [snip Biola science denial]
I think that what is notable about Holloway is not his creationism (boring!) but that # He has training in evolutionary algorithms, and # He is particularly calling for computer scientists to comment on whether the NFLT applies to evolutionary searches, but # He nevertheless seemingly doesn't "get" the oft-repeated criticism of the applicability to biological evolution of the NFLT, which points out that the NFLT implicitly assumes an unreal model of massive gene interaction in which one mutation is as bad as mutating all sites in the genome So he is in the unusual position of calling for computer scientists to validate his view that Dembski;s NFL argument presents biological evolution from working, while at the same time he does not acknowledge the main opposing view that shows that the NFL doesn't prevent biological evolution from working. This indicates either obliviousness or chutzpah.

mrg · 24 August 2011

Joe Felsenstein said: This indicates either obliviousness or chutzpah.
I vote "obliviousness". I get a little exasperated at the idea that creationists are incredibly devious. Devious in a low cunning way, certainly, but it's driven more by perversity than cleverness.

Reed A. Cartwright · 24 August 2011

mrg said: Any comments that I had that didn't get posted, delete them please. I was wondering why the system seemed so inconsistent on accepting and rejecting my postings.
It is a vestigial anti-troll feature for when we didn't have registration. You comments were getting flag because you accidentally use a word that matched a troll's handle. I should review the filter.

Mike Elzinga · 24 August 2011

eric said:
Tom English said: Nowadays I say without reservation that to regard biological evolution as fitness optimization is to let teleology slip through the back door.
I somewhat disagree. There's no teleology implied in saying proximate causes (like the environment and other animals) do the optimization. That's like saying gravity does the pulling. Now, I would agree that both 'the environment does...' and 'gravity does...' may give some people a linguistic sense of intelligent agency, design, or ultimate cause. So there may be a linguistic back door, even if there isn't a substantive one. But if 'gravity does the pulling' doesn't make you believe in god (and I find it hard to think anyone would take that sentence teleologically), then 'the environment does the selecting' shouldn't either. I also agree with you that optimization is not all that's going on. But local optimization over generations is part of it.
Teleological language shows up quite frequently in physics, chemistry, biology, engineering, economics, mathematics, and other disciplines in which states of equilibrium, or stationary points are achieved. But the language is only metaphorical and highly dependent on the processes being discussed. For example, equilibrium in an isolated thermodynamic system simply means that all net transfers of energy and/or matter have ceased. In open systems through which energy and/or matter are flowing, it could mean a steady state flow. A limp rope suspended between two points in a gravitational field will settle into a catenary curve shape provided it is an open system in which energy can be dissipated. The balance between supply and demand in an economic system is achieved by “market forces” (another metaphor). The teleological language that characterizes a system such as a rope “seeking to minimize potential energy” is only a metaphor that captures the fact that frictional forces within the rope and with the air, and the mechanical transfer of energy out of the rope by phonons and other mechanical waves traveling through the rope to the suspension points all drain energy out of the system until no more kinetic energy remains. Since biological systems are governed by the laws of physics and chemistry, any language of “optimization” simply expresses the fact that living systems are interacting with their environments and exchanging matter and energy with that environment. Whatever state they find themselves in after a sufficient period of time will be somewhere nearby an “optimal point” (a point in a multidimensional space) in which it is possible for them to persist for a period of time long enough to be identified as, say, a species. I am not under the impression, however, that what persists couldn’t be replaced by something “more optimal,” i.e., something that experiences smaller “generalized forces” that continue to select slightly different versions of it as time passes. The generalized forces in its environment may not be sufficient to nudge it into a slightly different configuration. Genetic drift might do that over a sufficiently longer period of time; but in evolution, “relaxation times” are often longer than the history of the species itself.

mrg · 24 August 2011

Reed A. Cartwright said: Your comments were getting flag because you accidentally used a word that matched a troll's handle.
No worries matey, but now I am curious -- what was the handle? I found out that "MrG" was a well-known incoherent troll banned over on Pharyngula, which makes me suspect that PZ Myers was not too amused at my own handle. "Please, I may sound goofy but I'm not psychotic."

Tom English · 24 August 2011

Mike Elzinga said:
Tom English said: ... People are at a loss for a non-teleological verb to describe what life does as it evolves. Lately I've thought that life spreads. That seems particularly appropriate when one considers that bacteria comprise most of the Earth's biomass. Bacteria spread like a big infection into the damnedest places, without trying at all to do so. They've gotten into geyser pools, and they've gotten onto spent nuclear fuel rods. The spread of life is not optimization of fitness. Tom English
A better description might be taken from physics by saying that life percolates.
That's very interesting. I'm a thermo wimp, but I'll take a shot at some papers I found Googling.

https://me.yahoo.com/a/Qjp5enRppdSW.nr6IdCgLASLhOc-#9be9d · 24 August 2011

what is notable about Holloway is not his creationism (boring!) He nevertheless seemingly doesn't "get" the oft-repeated criticism... He is in the unusual position of calling for computer scientists to validate his view, while at the same time he does not acknowledge the main opposing view... This indicates either obliviousness or chutzpah.
The connection with his creationism? Shoddy scholarship, thus obliviousness, because of overconfidence. Cultivated by years of serious creationist education. Arrogance and ignorance -- it's a defining trait.

Mike Elzinga · 24 August 2011

Tom English said:
Mike Elzinga said:
Tom English said: ... People are at a loss for a non-teleological verb to describe what life does as it evolves. Lately I've thought that life spreads. That seems particularly appropriate when one considers that bacteria comprise most of the Earth's biomass. Bacteria spread like a big infection into the damnedest places, without trying at all to do so. They've gotten into geyser pools, and they've gotten onto spent nuclear fuel rods. The spread of life is not optimization of fitness. Tom English
A better description might be taken from physics by saying that life percolates.
That's very interesting. I'm a thermo wimp, but I'll take a shot at some papers I found Googling.
I don’t seem to have it on my shelves any longer, but Stauffer and Aharony is a pretty good introduction as I recall. It’s an older book that is now out in a second edition; but I am sure there are many more textbooks on this topic nowadays.

Joe Felsenstein · 24 August 2011

mrg said: I get a little exasperated at the idea that creationists are incredibly devious. Devious in a low cunning way, certainly, but it's driven more by perversity than cleverness.
Let's distinguish between "creationists" as meaning highly visible creationist debaters, and "creationists" as meaning the rank and file. The latter (at least Young Earth Creationists) are at least 25% of the U.S. population. Let's not call them dishonest -- they are surely (mostly) nice, honest sincere people who mean well. The debaters -- well, that's another story. I hope you meant the former (the debaters) when you described "creationists".

https://me.yahoo.com/a/Qjp5enRppdSW.nr6IdCgLASLhOc-#9be9d · 24 August 2011

There's a 3rd category besides creationist debaters.
EH's a serious creationist -- choosing to specialize in evolutionary algorithms. He's not a person in the pew who accepts cre-ism like they accept sand in the Sahara -- without fervor, interest, nor understanding of why/how/etc.
Serious creationism is more than a series of bullet points on a doctrinal statement -- it's contempt for much of the science community, history, etc as delusional/incompetent/ideological/etc.
Thus EH gets "bored to frustration" reading things he rejects. Why try to grok the workings of mediocrities/ideologues?

What is your explanation for behavior you point tout?

Joe Felsenstein · 24 August 2011

https://me.yahoo.com/a/Qjp5enRppdSW.nr6IdCgLASLhOc-#9be9d said: What is your explanation for behavior you point tout?
Who points what?

mrg · 24 August 2011

Joe Felsenstein said: I hope you meant the former (the debaters) when you described "creationists".
I was talking about the people trolling the internet that I run into. Anyone who's just going along with it because they were told to and otherwise doesn't exert themselves much over the matter -- well, I just don't notice them much.

https://me.yahoo.com/a/Qjp5enRppdSW.nr6IdCgLASLhOc-#9be9d · 24 August 2011

Joe Felsenstein said:
What is your explanation for behavior you point tout?
Who points what?
Obviously you, pointing out EH's "obliviousness or chutzpah". His behavior of "calling for" while then "refusing to acknowledge". Would your explanation be purely his character, completely unrelated to his serious creationism and years of fundamentalist education? Or was that a typo comment re " t out"?

mrg · 24 August 2011

https://me.yahoo.com/a/Qjp5enRppdSW.nr6IdCgLASLhOc-#9be9d said: Obviously you, pointing out EH's "obliviousness or chutzpah". His behavior of "calling for" while then "refusing to acknowledge". Would your explanation be purely his character, completely unrelated to his serious creationism and years of fundamentalist education? Or was that a typo comment re " t out"?
Maybe it would be simpler if you told us what language you were writing in so we could run it through translation software and figure out what it says.

Joe Felsenstein · 24 August 2011

Re: who pointing tout what

I give up on that part of the thread. I am less interested in Holloway's motivation and past influences than I am in how he reconciles his training in evolutionary algorithms and his call for serious comment by computer scientists with his ability to ignore the most serious criticism that has been made (and by about 7 people over the years) of the use of the No Free Lunch argument against evolutionary theory. The NFL argument is, after all, arguing that natural selection cannot improve fitness effectively in a simple evolutionary algorithm, and he's supposed to know about such things.

mrg · 24 August 2011

Joe Felsenstein said: I give up on that part of the thread.
I am embarrassed. You had the sense to bail before I did.

Flint · 24 August 2011

Maybe someone can lend me a hand here, since I've never understood the fitness landscape. Let's say a species has 1000 characteristics that contribute to its success. Let's say that some mutation alters one of these in such a way as to make the possessor of this mutation less competitive for the old lifestyle, but more competitive for a slightly different lifestyle. Evolution being opportunistic, I should think this is more the rule than the exception. So do we say its fitness peak moved, or do we say that there's an upward path to a different peak? If the organisms currently occupying this different niche aren't as competitive as the new "invasive" species, then could this be a downward path? Or what WOULD its slope be considered?

With so many characteristics to modify, I would envision paths of all different slopes heading in all directions all the time, even with a stable environment. Is this accurate? How does NFL handle this situation?

harold · 24 August 2011

I am less interested in Holloway’s motivation and past influences than I am in how he reconciles his training in evolutionary algorithms and his call for serious comment by computer scientists with his ability to ignore the most serious criticism that has been made (and by about 7 people over the years) of the use of the No Free Lunch argument against evolutionary theory.
Well, you're not going to be able to understand any of that without understanding his background and biases. He didn't come to his ideas spontaneously, and he won't discuss them in an appropriate forum or with people with relevant expertise. He's clearly intelligent enough to understand why Dembski's method of applying NFT to biological evolution is wrong, and clearly intelligent enough to understand that natural selection is a real phenomenon, but he I predict that he never concedes either of those things. How can we understand this? He was taught that denying evolution (among other things) is central to his identity, internalized that message, and interprets or misinterprets the world according to that presupposition. Evolution denial for him is a shibboleth; failure to deny evolution identifies people as members of a hostile group. There's no point in approaching him as a guy who simply made an honest logical error, because it's exquisitely unlikely that he fits that description. The "creationists are silly people who came up with a silly idea while walking down the street one day" model doesn't work. It doesn't explain creationist behavior. It's an ingroup-identifying ideology and they risk severe ego disruption and total rejection by their fellow group members or even family if they violate it. This model does explain the behavior. There is a massive emotional resistance to giving up the idea, and every possible cognitive strategy of self-deception is typically employed to avoid doing so. We don't get a lot of posters who have "converted from" fundamentalism/creationism here - they tend to be angry (understandably), and prefer venues that focus more on atheism/religion. But their stated experiences are highly consistent with what I just said. On the positive side, the relatively more public scientific critique of ID/creationism of the last decade and a half (provoked by the aggression of ID/creationism) seems to be working. The number of relatively neutral people who mistake ID/creationism for "one side of a valid controversy" seems to be reducing. I'm not interested in arguing with other people with whom I strongly agree on the issue otherwise, so this will be my last comment (assuming that someone doesn't take advantage of that statement to try to misrepresent my line of reasoning, which seems highly unlikely in this thread). However, without in the slightest denying the full right of people to believe as they see fit, while being a strong opponent of religious discrimination, and indeed, while having frequently been castigated for "not hating religion enough" in other contexts, I feel that his background is an important part of understanding his activities.

mrg · 24 August 2011

harold said: Well, you're not going to be able to understand any of that without understanding his background and biases.
Sadly that can be kind of a quagmire. I suppose creationists are easier than conspiracy theorists, since I can at least perceive the motivations of creationists -- I have given up trying to figure out the kind of people who make up conspiracy theories on every possible pretext.

Flint · 24 August 2011

mrg said:
harold said: Well, you're not going to be able to understand any of that without understanding his background and biases.
Sadly that can be kind of a quagmire. I suppose creationists are easier than conspiracy theorists, since I can at least perceive the motivations of creationists -- I have given up trying to figure out the kind of people who make up conspiracy theories on every possible pretext.
Oddly perhaps, it's never seemed that much of a problem to me. What we have is a tension set up between evidence on the one hand, and committed preference on the other. And as many have observed, the human brain always tend to draw foregone conclusions on emotional grounds and justify those conclusions with carefully selected and interpreted evidence if possible. If not possible, then evidence is disregarded altogether. Scientists are certainly not immune to this, as Kuhn observed. The scientific approach to evidence is cultivated only with great difficulty and intense training, and even so often succombs to conflicting phenomena such as public positions, "marriage" to interpretations, and confirmation bias. Einstein's discomfort with quantum mechanics and the conspiracy nuts' discomfort with the Official Story of 9/11 are not qualitative differences. I really don't thing the source of evidence-rejection is all that imporant. We manufacture whatever sources satisfy our emotional needs, whether it be scripture or myth or whatever.

mrg · 24 August 2011

Flint said: Oddly perhaps, it's never seemed that much of a problem to me. What we have is a tension set up between evidence on the one hand, and committed preference on the other.
One conspiracy I can understand. Making them up continually on all pretexts I do not. I have seen conspiracy theorists online talking among themselves online on making up conspiracy theories, like they were plots of sci-fi novels. If you tell me you understand this, I won't believe you.

Henry J · 24 August 2011

Flint said: With so many characteristics to modify, I would envision paths of all different slopes heading in all directions all the time, even with a stable environment. Is this accurate? How does NFL handle this situation?
Another complication is that 1000 traits implies that the "landscape" has at least that many dimensions to deal with. Henry

Henry J · 24 August 2011

How did that NFL theorem get that name, anyway?

Joe Felsenstein · 24 August 2011

harold said:
I am less interested in Holloway’s motivation and past influences than I am in how he reconciles his training in evolutionary algorithms and his call for serious comment by computer scientists with his ability to ignore the most serious criticism that has been made (and by about 7 people over the years) of the use of the No Free Lunch argument against evolutionary theory.
Well, you're not going to be able to understand any of that without understanding his background and biases. ... [lots snipped] There's no point in approaching him as a guy who simply made an honest logical error, because it's exquisitely unlikely that he fits that description. ... On the positive side, the relatively more public scientific critique of ID/creationism of the last decade and a half (provoked by the aggression of ID/creationism) seems to be working. The number of relatively neutral people who mistake ID/creationism for "one side of a valid controversy" seems to be reducing. ...
Important point. People who are strongly committed will either react dishonestly, or (and we should not ignore this possibility) just be self-deluded. But the point about neutral observers is important too. And by simply pointing out self-contradictions in creationists' views we may be able to make an impact on neutral people, and even on people who oppose creationism but just don't know how to counter some arguments. We might not be able to convince the creationist who makes the argument, but that is usually not worth attempting.

Joe Felsenstein · 24 August 2011

Flint said: Maybe someone can lend me a hand here, since I've never understood the fitness landscape. Let's say a species has 1000 characteristics that contribute to its success. Let's say that some mutation alters one of these in such a way as to make the possessor of this mutation less competitive for the old lifestyle, but more competitive for a slightly different lifestyle. Evolution being opportunistic, I should think this is more the rule than the exception. So do we say its fitness peak moved, or do we say that there's an upward path to a different peak? If the organisms currently occupying this different niche aren't as competitive as the new "invasive" species, then could this be a downward path? Or what WOULD its slope be considered? With so many characteristics to modify, I would envision paths of all different slopes heading in all directions all the time, even with a stable environment. Is this accurate? How does NFL handle this situation?
You are discussing this in very much the terms that present-day evolutionary quantitative genetics does. And I know, because I recently spent a week doing this. If you have 1000 traits (hence, as was pointed out, 1000 axes) and fitness functions defined as a function of these 1000 variables, then if we have two fitness functions f1 and f2 for two different situations (say high and low ambient temperature), then you have to consider how these are combined. If each individual in a population lives in one of these temperature regimes, and there are 60% in Hot and 40% in Cold, then the overall fitness is 0.6 f1 + 0.4 f2. Which is a function of the 1000 variables and will have peaks and valleys. And yes, evolutionary quantitative geneticists do talk about how a change in the proportions of the two temperatures changes the fitness function and may result in moving off one peak and climbing another. When the Hot and Cold temperatures are in different, geographically partially isolated populations, or when they occur in different years, things get more complicated.

Joe Felsenstein · 24 August 2011

Henry J said: How did that NFL theorem get that name, anyway?
It was named by its authors, Wolpert and Macready. They showed that when you averaged over all the ways the values of the objective function could be assigned to points in the space, on average no search strategy would outperform simple random search. So there was No Free Lunch, in the sense that to do well, you had to have something extra that makes the surface smooth. In the case of evolution it is just physics, that makes similar genotypes have similar fitnesses quite often. They were generalizing about general search spaces and general strategies, and were not trying to cast doubt on evolution. Wolpert was quite angry when he found Dembski using his theorem for that.

Flint · 24 August 2011

mrg said:
Flint said: Oddly perhaps, it's never seemed that much of a problem to me. What we have is a tension set up between evidence on the one hand, and committed preference on the other.
One conspiracy I can understand. Making them up continually on all pretexts I do not. I have seen conspiracy theorists online talking among themselves online on making up conspiracy theories, like they were plots of sci-fi novels. If you tell me you understand this, I won't believe you.
I can understand dreaming up alternative scenarios as an intellectual exercise, and reality doesn't have much respect for occam's razor. But I think you're referring to the fanatical evidence-no-object determination with which they cling to their conspiracies. And for this, you'd need an abnormal psychologist. Which sure isn't me.

Mike Elzinga · 25 August 2011

Flint said: And for this, you'd need an abnormal psychologist.
It would take a rather “abnormal psychologist” who would be able to simply stay in a room with them long enough to form a diagnosis.

RodW · 25 August 2011

Joe Felsenstein said:
RodW said: So what has Dembski said in reply to these criticisms?
Over the years, basically nothing, even when he wrote The Design Revolution which had as its subtitle "Answering the Toughest Questions About Intelligent Design". But he didn't answer that criticism. But he very quietly, implicitly, acknowledges it by bringing forth his (and Robert Marks's) Search For A Search argument: if fitness surfaces are smooth (so that natural selection will work) this is supposedly because they are "front-loaded" to allow this. My own reaction (see here) is that the weakness of interactions at a distance in physics is sufficient to make fitness surfaces smooth. For example a gene affecting my eye pigment typically does not interact strongly with one that affects the length of my big toe, and that is not evidence that some Designer has been tinkering around.
Hmm...it seems to me that network interactions are not the issue. Being more networked would actually provide a buffer against harmfull mutations. I would think it comes from the simple observation that most mutations in a particular protein are not lethal, and the vast majority of mutations in the genome are neutral. I'm surprised Dembski hasnt addressed you're criti cisms more directly, hes usually pretty good at that. Not that I think they'd be effective rebuttals- in this area and many others in our society, when an individual is shown to be completely and totally wrong they'll say something; they'll say anything, in the belief that if their mouth is moving and words are coming out they're somehow refuting those arguements. I have to say I dont think any of these models reflect reality. There may be fitness peaks and adaptive mutations but these are a rare sideline to evolution. The real fitness landscape is mostly flat with lots of pot-holes and populations tend to spread over the entire landscape avoiding the pot-holes of course. And genotypes dont move over a landscape. They create and mold and deform it under them with each mutation.

Rumraket · 25 August 2011

RodW said: I have to say I dont think any of these models reflect reality. There may be fitness peaks and adaptive mutations but these are a rare sideline to evolution. The real fitness landscape is mostly flat with lots of pot-holes and populations tend to spread over the entire landscape avoiding the pot-holes of course. And genotypes dont move over a landscape. They create and mold and deform it under them with each mutation.
That's my impression too. People like D. Axe has tried to claim that evolution is impossible because functional sequence space is akin to a static, flat, unfathomably vast desert of nonfuncitonality with isolated islands of function. If I remember correctly, the claim was something like one in 1x10^77 sequences will have function. The rest are dead ends. http://bio-complexity.org/ojs/index.php/main/article/view/BIO-C.2010.1/BIO-C.2010.1 So he argues evolution can't proceed(in the given timeframe), even with selection, because the distances of nonfunctionality the search would have to traverse are so enormous. So what he never gets(or probably intentionally ignores) is that the landscape is shaped and manipulated by by the genes themselves in addition to the evironment. What may be a nonfunctional, flat surface now, may be a steep slope for selection to climb in a different environment. He never takes this into account. His research seems to be nothing more than to take some enzymes, mutate them until they lose function(in their environment) and then calculate how many sequences out of the total possible sequence space remain functional(with their one, original function, in their one original environment). Needless to say, this argument is massively flawed exactly because he never chekcs for alternative function, under alternative conditions. The shape of the environment of the genes isn't static, and the genes themselves are part of what makes the shape of the environment. His research is bunk.

RodW · 25 August 2011

Rumraket said:
RodW said: I have to say I dont think any of these models reflect reality. There may be fitness peaks and adaptive mutations but these are a rare sideline to evolution. The real fitness landscape is mostly flat with lots of pot-holes and populations tend to spread over the entire landscape avoiding the pot-holes of course. And genotypes dont move over a landscape. They create and mold and deform it under them with each mutation.
That's my impression too. People like D. Axe has tried to claim that evolution is impossible because functional sequence space is akin to a static, flat, unfathomably vast desert of nonfuncitonality with isolated islands of function. If I remember correctly, the claim was something like one in 1x10^77 sequences will have function. The rest are dead ends. http://bio-complexity.org/ojs/index.php/main/article/view/BIO-C.2010.1/BIO-C.2010.1
It seems to me that what that shows is that its very unlikely that any particular pile of random matter will spontaneously form life. Any serious consideration starts at T=0 with a living thing that is already perfectly adapted ( since it is alive and not dead) and considers how the population will explore genetic space. We know that populations have a tremendous amount of genetic diversity so they DO in fact explore genetic space. Right now I'm sympathetic to the notion of 'constructive neutral evoluion' which holds that much of the complexity we see is due to a neutral ratcheting up in complexity that cant be avoided and has no immediate benefit or harm. I think its conceptually appealing though I admit there isnt much evidence for it now and over at the ID blog Behe has a more or less reasonable critique of it.

Henry J · 25 August 2011

It seems to me that what that shows is that its very unlikely that any particular pile of random matter will spontaneously form life.

No surprise there, but now multiply that probability by the number of different piles of matter in the universe. (Not any one planet in the universe, but all of them.)

Mike Elzinga · 25 August 2011

Henry J said:

It seems to me that what that shows is that its very unlikely that any particular pile of random matter will spontaneously form life.

No surprise there, but now multiply that probability by the number of different piles of matter in the universe. (Not any one planet in the universe, but all of them.)
:-) Bingo! And on those planets where it didn’t happen, there is no one to ask why it didn’t happen there.

Joe Felsenstein · 25 August 2011

Mike Elzinga said:
Henry J said:

It seems to me that what that shows is that its very unlikely that any particular pile of random matter will spontaneously form life.

No surprise there, but now multiply that probability by the number of different piles of matter in the universe. (Not any one planet in the universe, but all of them.)
:-) Bingo! And on those planets where it didn’t happen, there is no one to ask why it didn’t happen there.
Not so fast. I think all the scenarios suggested for the origin of life do not just relay on random piles of matter (though creationists like to present it that way). They rely on chemicals that, when present together, mutually encourage each other's presence and persistence. That is much less than biological replication, but it is partway there.

Rumraket · 25 August 2011

RodW said: It seems to me that what that shows is that its very unlikely that any particular pile of random matter will spontaneously form life.
Exactly. Axe hasn't presented an argument against evolution, he's presented an argument against the spontaneous formation of a modern cell. We didn't need him to tell us this, since noone is suggesting extant cells suddenly coalesced into existence in a single leap from a random mix of monomers.
RodW said:Any serious consideration starts at T=0 with a living thing that is already perfectly adapted ( since it is alive and not dead) and considers how the population will explore genetic space. We know that populations have a tremendous amount of genetic diversity so they DO in fact explore genetic space.
I think Axe is also arguing against a straw-man. Most of the evolution we see going on today, and the change we observe in the fossil record around the Cambrian explosion, isn't contingent on the evolution of vast quantities of new enzymes and complex biochemistry. Those genes all seem to be extremely old and conserved, and haven't changed much since their origin. So even if Axe is right and evolution can't produce new, long, unique and complex enzymes from extant ones in the given timescales, this is still not going to prevent the evolution of Homo Sapiens Sapiens from the common ancestor we share with Chimps. I think this earlier post on Panda's Thumb testifies to this pretty well: http://pandasthumb.org/archives/2011/04/the-true-story.html
RodW said:Right now I’m sympathetic to the notion of ‘constructive neutral evoluion’ which holds that much of the complexity we see is due to a neutral ratcheting up in complexity that cant be avoided and has no immediate benefit or harm.
This also seems to me to square well with the nature paper referenced in that PT post by PZ Myers. The paper presents a picture where genomic complexity in extant biodiversity seems mostly a product large amounts of duplications, shufflings and transfers of already existing, functional genes.
RodW said:I think its conceptually appealing though I admit there isnt much evidence for it now and over at the ID blog Behe has a more or less reasonable critique of it.
I'm not familiar with it so I can't comment on that.

Mike Elzinga · 25 August 2011

Joe Felsenstein said:
Mike Elzinga said:
Henry J said:

It seems to me that what that shows is that its very unlikely that any particular pile of random matter will spontaneously form life.

No surprise there, but now multiply that probability by the number of different piles of matter in the universe. (Not any one planet in the universe, but all of them.)
:-) Bingo! And on those planets where it didn’t happen, there is no one to ask why it didn’t happen there.
Not so fast. I think all the scenarios suggested for the origin of life do not just relay on random piles of matter (though creationists like to present it that way). They rely on chemicals that, when present together, mutually encourage each other's presence and persistence. That is much less than biological replication, but it is partway there.
Random piles it’s not. No self-respecting physicist would ever think that. But even allowing for billions and billions of random piles, at least a few piles are going to have approximately the right stoichiometry under the right conditions. Then lots of non-random things can happen. And, I would suggest, the universe is not finely tuned. The “fine tuning” argument is a fallacy. Vary all the “constants” and pick from the ensembles those that permit a universe of some sort. There is no reason to believe that some kind of complex living systems could not emerge from those also.

Tom English · 25 August 2011

Joe Felsenstein said: I think that, as much as we need to appreciate the complexity and subtleties of evolving living systems, simple models in which fitness is optimized are worth analyzing. Here Dembski's NFL argument is argued to show that fitness cannot be effectively increased even in such a simple model. That would be a major surprise. In fact, as the many critics I quoted (from Richard Wein on) pointed out, what was wrong with Dembski's argument was that it used the NFLT which required us to average the behavior of the optimization algorithm over all possible ways a bunch of fitnesses could be assigned to genotypes. But almost all of these make very jaggy fitness surfaces, nearly "white noise" surfaces. But real biology makes much smoother fitness surfaces. To my mind, that, and not the broader issue of whether fitness optimization is close to what living systems do, is the real objection to Dembski's argument. Your argument is an argument from the complexities of real organisms, but what I hear it doing is implicitly conceding that within a simple fitness optimization case Dembski's argument would be convincing. But no, his argument isn't convincing even there, as it relies on fitness surfaces that are unlike real biology. So it can be rejected without even getting to the complexities.
Joe, I initially believed that Dembski had purposefully misconstrued NFL results in No Free Lunch. Interacting with him online, I learned that he was woefully confused. After he joined up with Marks, and shifted from complex specified information to active information, it took me a while — too long — to see that he was still getting things terribly wrong. He and Marks came out and said what they really meant only when they released a preprint of "Life's Conservation Law," which appears in The Nature of Nature:
Though not denying Darwinian evolution or even limiting its role in the history of life, the Law of Conservation of Information shows that Darwinian evolution is inherently teleological. Moreover, it shows that this teleology can be measured in precise information-theoretic terms.
As I indicated above, I was teleology-averse long before this appeared. Dembski and Marks are likely to score a rhetorical victory if you step onto a field where teleology is apparent. The argument countering the notion that where there's a successful program, there must be an informed programmer, i.e.,
Searches that operate by Darwinian selection, for instance, often significantly outperform blind search. But when they do, it is because they exploit information supplied by a fitness function — information that is unavailable to blind search. Searches that have a greater probability of success than blind search do not just magically materialize. They form by some [intelligent] process.
is relatively subtle. They've reified (hypostasized) the fitness function — but so have many life scientists. The fact is that when we observe evolutionary "optimization," what we have done is to frame a process in which evolutionary change is not just difference, but something we recognize as improvement. (Stuart Kauffman has rightly emphasized that we recognize adaptation only after the fact.) I find that many scientists have trouble understanding that processes do not define themselves. "If gold should rot, then what of iron?" I'm in danger of going another day without responding if I don't wrap this up quickly. As best I can tell, Dembski drew entirely on Wolpert and Macready (1997) before teaming with Marks. The emphasis on uniformity was always wrong. I had established that exchangeability was necessary and sufficient for NFL in my 1996 paper. Contrary to what Wolpert and Macready said (in Bayesian terms), when the optimization practitioner selects an algorithm without exploiting knowledge of the fitness function, the random fitness values of solutions are exchangeable. Schumacher, Vose, and Whitley, working in a non-probabilistic framework, established in a high-profile 2001 paper that there is NFL when the set of fitness functions is closed under permutation. Dembski should have known that NFL was not about uniformity. But he remains obsessed with the uniform distribution to this day.

Henry J · 25 August 2011

The argument countering the notion that where there’s a successful program,

But, successful from what point of view? That of some of the creatures inside that "program"?

Tom English · 25 August 2011

Some relevant comments from the introduction of a critique I never completed. They apply to Dembski's earlier work, as well as to his work with Marks. Forgive the LaTex formatting. Note that I was not entirely sure that Dembski and Marks had interpreted NFL precisely backwards until I heard Marks explain it in the plainest language on a Christian podcast. I was astounded. ----------- Misunderstanding the No Free Lunch Theorem Dembski and Marks lapse into circular reasoning because they misinterpret ``no free lunch'' (NFL) results as saying that an algorithm must have problem-specific information to perform well. A correct interpretation is that the practitioner must exploit knowledge of the problem in selecting an algorithm, or else there is no justification for believing that the algorithm will outperform an arbitrary enumeration of the search space. A lack of justification does not preclude an algorithm from performing well. As Wolpert and Macready explain~\cite{WM97},
Intuitively, the NFL theorem illustrates that if knowledge of [problem] f... is not incorporated into [algorithm] a, then there are no formal assurances that a will be effective. Rather, in this case effective optimization relies on a fortuitous matching between f and a.
Theoretically, it is almost always the case that success in search reflects no more than a fortuitous match of algorithm and problem. With canonization of search algorithms in terms of decision trees, almost all algorithms are algorithmically random. This means that the typical algorithm is so disorderly in its decisions that it cannot be regarded as a product of design. Although it performs just as an orderly algorithm does over all problems, by the NFL theorem, there is never any reason for it to perform as it does. Furthermore, almost all problems are algorithmically random. That is, there is no order in the typical problem that can be exploited in design of an algorithm to solve it. Active information is supposedly the ``specific information about target location and search-space structure incorporated into a search algorithm that guides a search to a solution''~\cite{DM09}. But the typical search success has utterly nothing to do with structure or guidance. A search process does not input a description of the problem, and does not gain exploitable information by observing properties of possible solutions~\cite{English96}. Thus a theoretically atypical search process that operates methodically is not informed, but is instead biased in its sampling of the solution space. Investigators of machine learning have long understood methodical processing of data to make guesses as bias~\cite{Mitchell}. Ignoring Benchmark Performance in the Real World The term ``active information'' suggests that something must \emph{act} to make the algorithm suit the problem. But the (1+1) evolutionary algorithm has been applied to thousands of problems to obtain performance benchmarks, i.e., without design, and has often performed very well. Negative results tend to go unreported, so let us assume, in the spirit of NFL, that the algorithm often performs quite poorly. How, then, could extremes in performance be common? Problems that are theoretically typical are also physically infeasible (Sect.~\ref{feasibility}), so there is reason to suspect that atypical search results occur much more often in reality than in theory. Dembski and Marks make high performance into a miracle requiring a supernatural cause, but they actually do not know that it is rare for a fixed algorithm operating with bias on real-world problems.

Mike Elzinga · 25 August 2011

Dembski and Marks continue to set up the same straw-man argument every time. It is an egregious misrepresentation of what programs like genetic algorithms and Monte Carlo programs, for example, do.

When a computer program incorporates within its algorithms the very processes found in nature, the outputs produce what nature produces. What can possibly be so difficult in that for Dembski and Marks to understand?

They continue to take potshots at Dawkins’s Weasel program without recognizing that a simple shift in perspective turns the program into one in which atoms are settling into a configuration of potential wells by radiating energy. That’s what nature does. The results are things like crystals and living organisms.

There is no “answer smuggled in.” It’s a simulation of nature as we best can understand it, approximate it, and are able to cast it in the form of a set of algorithms that can run on a computer.

Way back in my ultrasonic imaging days I developed algorithms that synthesized the way a lens or focusing aperture guided rays to a focal point. I derived these from minimizing the time of travel from a point in one media to another point in another media. In effect, the computer became a lens that took all the captured waveform data from a scan with a single transducer and sharpened the image of what was inside the object being scanned. I even wrote programs that "injected" data into these focusing programs and measured their point-spread-functions under various conditions.

I didn’t put in the answer; I turned the computer into a lens. I instructed the computer to do what nature does when focusing.

Genetic algorithms and Dawkins’s little Weasel program are nature simulators; and insofar as they faithfully reproduce what falls out in nature, they confirm our understandings of nature.

Tom English · 25 August 2011

eric said:
Tom English said: Nowadays I say without reservation that to regard biological evolution as fitness optimization is to let teleology slip through the back door.
I somewhat disagree. There's no teleology implied in saying proximate causes (like the environment and other animals) do the optimization. That's like saying gravity does the pulling. Now, I would agree that both 'the environment does...' and 'gravity does...' may give some people a linguistic sense of intelligent agency, design, or ultimate cause. So there may be a linguistic back door, even if there isn't a substantive one. But if 'gravity does the pulling' doesn't make you believe in god (and I find it hard to think anyone would take that sentence teleologically), then 'the environment does the selecting' shouldn't either. I also agree with you that optimization is not all that's going on. But local optimization over generations is part of it.
See in my response to Joe above how we frame optimization processes. I think that life scientists are altogether all too accepting of teleological language these days. Careless language indeed leads to careless thinking. I do not find "we know what we really mean by this" an acceptable excuse. Before Google hamstrung the search of books, I did a lot of poking around in an effort find out when the talk about search and optimization took hold in evolutionary biology. You might suspect that Sewall Wright, with his emphasis on adaptive landscapes, would lapse into teleological language. But I have found no evidence that he did. In the Fifties, G.E.P. Box came up with Evolutionary Operations (EVOP) for optimization of industrial processes. In the Sixties, researchers like Larry Fogel and Hans Bremermann applied evolution-inspired algorithms to solution of problems in search and optimization. As best I can tell from my admittedly superficial survey, only after that did notions of search and optimization enter explicitly into evolutionary biology. It seems that the back-application of evolution-as-optimization began with E.O. Wilson's work in the early 1970's. As biologists gained proficiency with computers in the Eighties, references to evolutionary search and optimization skyrocketed. There is a wonderful snapshot of biological language (and thought) of 1955 in the panel discussion transcribed in Concepts of Biology, available in full at Google Books. The discussants include Ernst Mayr, George Gaylord Simpson, Sewall Wright, and other leading educators. Not only is the language exemplary, but the discussion is of considerable historical interest.

Tom English · 25 August 2011

Mike Elzinga said: They continue to take potshots at Dawkins’s Weasel program without recognizing that a simple shift in perspective turns the program into one in which atoms are settling into a configuration of potential wells by radiating energy. That’s what nature does. The results are things like crystals and living organisms.
David Fogel indeed turns the fitness landscape into a cost landscape in his (1995?) introduction to evolutionary computation. Some who have cast biological evolution as optimization have talked about minimizing behavioral error.

Tom English · 25 August 2011

Henry J said: How did that NFL theorem get that name, anyway?
Wolpert and Macready were at the Santa Fe Institute, affiliated with a number of economists. I think it was Milton Friedman who said that there's no free lunch in microeconomic systems. Gains in one part of such a system must be precisely balanced by losses in others. Analogously, an optimizer's superiority in performance on a subset of functions must be precisely balanced by inferiority in performance on the complementary subset, relative to the performance of an arbitrary enumeration of solutions.

Tom English · 25 August 2011

Henry J said:

The argument countering the notion that where there’s a successful program,

But, successful from what point of view? That of some of the creatures inside that "program"?
ID creationists are bent on turning wonders into miracles. As I wrote at Bounded Science,
Scientists work to explain the wonders of nature, not "unexplain" them by accepting that they are miracles due to purposeful intervention of something invisible. The history of science is full of cases in which the seemingly unexplainable was explained. As a practical matter, scientists can never give up trying to show that the wondrous is not miraculous.

Joe Felsenstein · 25 August 2011

Tom English said: How, then, could extremes in performance be common? Problems that are theoretically typical are also physically infeasible ... so there is reason to suspect that atypical search results occur much more often in reality than in theory. Dembski and Marks make high performance into a miracle requiring a supernatural cause, but they actually do not know that it is rare for a fixed algorithm operating with bias on real-world problems.
Which is the essence of the problem with Dembski's use of the NFLT. If we randomly assign fitnesses to genotypes we typically get a fitness surface that is impossibly rough, on which natural selection in evolution would achieve little. But real fitness surfaces are not like that -- it is typically not true that mutating a single base is just as bad as mutating every base in the genome. If fitnesses were randomly assigned to genotypes, then the two types of mutation would be equivalent. They are not, at all. Dembski and Marks have not acknowledged this, but they have retreated to asserting that when fitness surfaces are smooth enough for natural selection to work, that they must have been actively selected from among all possible fitness surfaces by Someone. They have not shown that ordinary physics -- the weakness of interaction of physically- and temporally-separated phenomena, could not be the source of the smoothness. Links to the criticisms of their use of the NFL (by many people) will be found in the Original Post above. My take on the Dembski/Marks "Search For A Search" argument will be found here and here.

Paul Burnett · 25 August 2011

yahoomess mentioned: The Biola Doctrinal Statement...
Maybe everybody here already knows this, but "Biola University" wasn't always "Biola University." "BIOLA" is an acronym for the "Bible Institute Of Los Angeles" - it's a Bible College. Biola is, among other things, partially responsible for the very word "fundamentalism" as we know it today. It was the location of one of the Founders' Conferences in 1996 that led to the development of intelligent design creationism.

Tom English · 25 August 2011

Mike Elzinga,

IDC is forensics. The objective of Dembski and Marks has been to show that simulation models that have long been on the creationists' shit list would not have "solved the search problem" unless the programmer had exploited information. The very craziest thing they do, IMO, is to regard fitness values as "information." In all evolutionary models, fitness is associated with the propensity to reproduce, so generating more offspring from more-fit individuals than from less-fit individuals is hardly "exploitation of information that is not available to blind search."

So-called search algorithms are sampling algorithms. If a sampling algorithm decides how to extend the sample on the basis of properties of the current sample, then it is biased, not informed. That's obvious, once said, but it seems not to appear in the optimization literature. I should publish, but my ADHD - Primarily Inattentive brain has been having a harder and harder time with writing. It seems that all I can turn out is little chunks. Posting here has been fun, but I'm generally very frustrated.

Henry J · 25 August 2011

Tom English said:
Henry J said: How did that NFL theorem get that name, anyway?
Wolpert and Macready were at the Santa Fe Institute, affiliated with a number of economists. I think it was Milton Friedman who said that there's no free lunch in microeconomic systems. Gains in one part of such a system must be precisely balanced by losses in others. Analogously, an optimizer's superiority in performance on a subset of functions must be precisely balanced by inferiority in performance on the complementary subset, relative to the performance of an arbitrary enumeration of solutions.
In other words, the NFL says that if one species gets a better success rate, some other(s) lose out or get a reduced success rate? Given that the rate of extinctions is presumed to correlate fairly well with the number of speciations, I don't see an issue there. Henry

Mike Elzinga · 25 August 2011

Tom English said: IDC is forensics. The objective of Dembski and Marks has been to show that simulation models that have long been on the creationists' shit list would not have "solved the search problem" unless the programmer had exploited information. The very craziest thing they do, IMO, is to regard fitness values as "information." In all evolutionary models, fitness is associated with the propensity to reproduce, so generating more offspring from more-fit individuals than from less-fit individuals is hardly "exploitation of information that is not available to blind search."
From the history I know - going all the way back to Henry Morris and Duane Gish and possibly back to A.E. Wilder-Smith – their early, and forced, misconceptions about thermodynamics and evolution set the stage for something that had to intrude to “overcome entropy” and make complex living systems possible. That overriding “force” became “information” which was a “blueprint” written by a deity. It was this mischaracterization that, in Morris’s very own words, pitted the “science of thermodynamics against the myth of evolution” and started all this crap about “information.”

So-called search algorithms are sampling algorithms. If a sampling algorithm decides how to extend the sample on the basis of properties of the current sample, then it is biased, not informed. That's obvious, once said, but it seems not to appear in the optimization literature.

Indeed; any system adjusting to the generalized forces in its environment is “biased.” That, for example, is what a potential well is to a particle or system in its vicinity. I think I mentioned this some time ago on another thread, but I’ll mention it again here. If one thinks of living, replicating systems as passing on slightly varying replicas acting as surrogates of themselves in the presence of the generalized forces in their environments, evolution isn’t all that much different from a single complex system that is able to deform in the presence of external forces in order to minimize the energies, subject to the constraints in the system plus environment; with the end result being that the system then “fits better” in the new environment.

Dale Husband · 25 August 2011

Henry J said: In other words, the NFL says that if one species gets a better success rate, some other(s) lose out or get a reduced success rate? Given that the rate of extinctions is presumed to correlate fairly well with the number of speciations, I don't see an issue there. Henry
The NFL? What does football (the American kind, descended from the British game known as rugby) have to do with research on evolution?

Tom English · 25 August 2011

Joe Felsenstein said:
Tom English said: How, then, could extremes in performance be common? Problems that are theoretically typical are also physically infeasible ... so there is reason to suspect that atypical search results occur much more often in reality than in theory. Dembski and Marks make high performance into a miracle requiring a supernatural cause, but they actually do not know that it is rare for a fixed algorithm operating with bias on real-world problems.
Which is the essence of the problem with Dembski's use of the NFLT. If we randomly assign fitnesses to genotypes we typically get a fitness surface that is impossibly rough, on which natural selection in evolution would achieve little. But real fitness surfaces are not like that -- it is typically not true that mutating a single base is just as bad as mutating every base in the genome. If fitnesses were randomly assigned to genotypes, then the two types of mutation would be equivalent. They are not, at all. Dembski and Marks have not acknowledged this, but they have retreated to asserting that when fitness surfaces are smooth enough for natural selection to work, that they must have been actively selected from among all possible fitness surfaces by Someone. They have not shown that ordinary physics -- the weakness of interaction of physically- and temporally-separated phenomena, could not be the source of the smoothness. Links to the criticisms of their use of the NFL (by many people) will be found in the Original Post above. May take on the Dembski/Marks "Search For A Search" argument will be found here and here.
There's no search for a search when there's no search in the first place. Just say no. Call us computer scientists and spit in our eyes, but Mark Chu-Carroll and I agree that a search for a search collapses to a search. Yawn. I've published quite a bit about information in search, and I've lived to regret it. I used to say, as you do, that evolution transfers information from the environment to the genome. But it is clear that reproduction-with-variation proposes, and the environment (including other organisms) disposes. It seems that there is information both in "mutation" and in natural selection — information of different types. Messy. Fun fact to know and tell: Almost all functions from seven 64-bit numbers to one 64-bit number require more bits to describe than Seth Lloyd estimates are registered by the known Universe. (The length of function descriptions generally does not depend much on the choice of descriptive formalism, e.g., programming language.) It's important to keep it in mind that performance on typical (Kolmogorov random) fitness functions is about average with high probability. Assuming that the solution space is much larger than the codomain of fitness values, the sample size required to obtain a solution with fitness in the top 0.001% of the codomain with probability .9999 is a modest 921 thousand. It would be wrong to assume that a stochastic hill-climber does better than this on a smooth surface. The hill-climber may be much better suited to the smooth surface than is "blind" search, but the smooth surface may be harder for it than one that is Kolmogorov random.

Joe Felsenstein · 25 August 2011

Tom English said: The very craziest thing they do, IMO, is to regard fitness values as "information." In all evolutionary models, fitness is associated with the propensity to reproduce, so generating more offspring from more-fit individuals than from less-fit individuals is hardly "exploitation of information that is not available to blind search."
This fits in with one of the points I made in my 2007 article (cited in the OP). I was trying to show that natural selection could generate Specified Information [Please, let's not fight about what, if anything this means!]. In this case I identified it with choosing genotypes that had higher fitness. In a case where there were initially four alleles, A, C, G, and T representing variation at a DNA site, all equally frequent in the population, if C had fitness 20% higher than the other three, one can calculate that after 84 generations 99.9% of the gene copies will be C. In that case natural selection does choose genotypes with higher fitness, getting the population further out into the tail of the initial distribution of fitnesses. It mystifies me how anyone can describe this case as having information about adaptation built in in advance -- it's just a case of some genotypes with different fitnesses. The theorems put forward by Dembski do not even start to apply to this case, even if we were to regard the theorems as proven.

Joe Felsenstein · 25 August 2011

Henry J said: In other words, the NFL says that if one species gets a better success rate, some other(s) lose out or get a reduced success rate?
I don't think so. It is talking about search among genotypes within one species, for those with high fitness.

Joe Felsenstein · 25 August 2011

Mike Elzinga said: From the history I know - going all the way back to Henry Morris and Duane Gish and possibly back to A.E. Wilder-Smith – their early, and forced, misconceptions about thermodynamics and evolution set the stage for something that had to intrude to “overcome entropy” and make complex living systems possible. That overriding “force” became “information” which was a “blueprint” written by a deity. It was this mischaracterization that, in Morris’s very own words, pitted the “science of thermodynamics against the myth of evolution” and started all this crap about “information.”
A perspicacious historical analysis. Just as the thermodynamics argument against evolution did, Dembski's Law of Conservation of Complex Specified Information has collapsed in a heap, and so has his No Free Lunch argument. Yet creationist commenters and posters keep mindlessly repeating, zombie-style, that it's been "proven" (somewhere-or-other) that "new information cannot arise in evolution". Your quick history helps understand why this survives even after it is disproven.

Tom English · 25 August 2011

Henry J said:
Tom English said:
Henry J said: How did that NFL theorem get that name, anyway?
Wolpert and Macready were at the Santa Fe Institute, affiliated with a number of economists. I think it was Milton Friedman who said that there's no free lunch in microeconomic systems. Gains in one part of such a system must be precisely balanced by losses in others. Analogously, an optimizer's superiority in performance on a subset of functions must be precisely balanced by inferiority in performance on the complementary subset, relative to the performance of an arbitrary enumeration of solutions.
In other words, the NFL says that if one species gets a better success rate, some other(s) lose out or get a reduced success rate? Given that the rate of extinctions is presumed to correlate fairly well with the number of speciations, I don't see an issue there. Henry
The NFL theorem is mathematical. See "No free lunch theorem" in Wikipedia. What it has to do with biological evolution is at issue here. Having published six papers regarding NFL, I would love for it to apply. But I don't believe that it does.

Tom English · 26 August 2011

the sample size required to obtain a solution with fitness in the top 0.001% of the codomain with probability .9999 is a modest 921 thousand.
Oops! Dropped a 9 there. The probability is .99999.

Tom English · 26 August 2011

Joe Felsenstein said:
Mike Elzinga said: From the history I know - going all the way back to Henry Morris and Duane Gish and possibly back to A.E. Wilder-Smith – their early, and forced, misconceptions about thermodynamics and evolution set the stage for something that had to intrude to “overcome entropy” and make complex living systems possible. That overriding “force” became “information” which was a “blueprint” written by a deity. It was this mischaracterization that, in Morris’s very own words, pitted the “science of thermodynamics against the myth of evolution” and started all this crap about “information.”
A perspicacious historical analysis.
Perspicacious, indeed.

Joe Felsenstein · 26 August 2011

Tom English said: The NFL theorem is mathematical. See "No free lunch theorem" in Wikipedia. What it has to do with biological evolution is at issue here. Having published six papers regarding NFL, I would love for it to apply. But I don't believe that it does.
(Quibble} If we model evolution with a space of genotypes, each with a fitness, and do uphill-climbing search in this space, the NFL certainly applies. The question is what it then means about evolution. Mostly it means nothing, because it talks about the average behavior of the uphill search over all possible genotype-phenotype maps, with the overwhelming number of these being biologically unreasonable. So the theorem applies, it is just that knowing that doesn't tell us anything interesting about how effective natural selection is in real cases, or even in a semi-real model like this with semi-reasonable fitnesses of genotypes. OK, I know, you do know this.

Mike Elzinga · 26 August 2011

Henry J said: In other words, the NFL says that if one species gets a better success rate, some other(s) lose out or get a reduced success rate? Given that the rate of extinctions is presumed to correlate fairly well with the number of speciations, I don't see an issue there. Henry
I’ll take a crack at this without any math. Imagine yourself in a very, very large room and it’s completely dark. You can’t see anything, you can’t hear anything; and all you have is some sense of “slope” of the floor on which you are standing (in other words, you do feel gravitational force; but we are going to take this away in a moment). You want to find the highest point in the room; but you don’t even know if there is a highest point. What strategy do you use? If you have a sense of slope (i.e., steepness), you could adopt a strategy that says something like, “continue in the direction of most difficult climb.” But does that guarantee that you are climbing the largest peak in the room? How do you strike out looking for another peak for comparison; and how do you make the comparison? You could take a random shot at another location and start climbing the steepest feeling slopes there. But then you will also have to have some memory of the other slopes you have climbed and where they are in relation to where you are now. As you can see, the more you think about this, the more you realize you have to be able to map the room by feel and develop some kind of record of the relative locations of where you are and where you have been. Your most likely strategy with this kind of information is that you will remain in the vicinity of where you started, but creep up on a local maximum. But now take away any sense of slope (turn off gravity) and try to find a strategy to map out the room. The NFL theorem says that, on average, no strategy you can come up with will be any better than a uniformly random sampling of the room. Compare this with a strategy that allows you to feel the steepness and curvature of all the places you are and at the same time tells you that you are higher or lower at your present location than at others nearby (maybe the barometric pressure or concavity downward in all directions from where you are). At least with this kind of information you can find local maxima (or minima). But does it tell you that you are at the highest place? Are you going to explore farther or remain where you are? Dembski and Marks assume you are in a room with no sensory input that gives any indication about where you are relative to any place else or where to go. They assume that this is the way that molecules find their way into complex assemblies with specified shape. There is “no sense of feel;” molecules are just picked up randomly and placed, and then repeat until the specified assembly is achieved. That’s how they think nature works; and if it did work that way, they would be correct that no complex assemblies like the ones we see in living organisms would appear. But nature is a myriad of potential wells that atoms and molecules “feel;” and the configurations are set by the rules of quantum mechanics. With living organisms, the “strength of the feeling” is in the number of surviving offspring (fitness). And in real examples, these systems are adjusting from “nearby positions” in “fitness space.” It is not likely that they will “leap all over the landscape” to find a place where even more offspring survive (other systems will very likely be exploring those other regions from nearby). And all this has its roots in the fundamental physics.

Tom English · 26 August 2011

My first NFL argument (during a student's thesis defense, in 1994) was that optimizing a function drawn uniformly at random is equivalent to optimizing the output of a uniform random number generator. That is, you don't have to construct the entire fitness function in advance of the optimization run by associating each individual with a random fitness value. You can generate the random fitness values on the fly. Clearly there is no strategy for optimizing the output of a uniform random number generator.

Joe Felsenstein · 26 August 2011

Mike Elzinga said: I’ll take a crack at this without any math. Imagine yourself in a very, very large room and it’s completely dark. You can’t see anything, you can’t hear anything; and all you have is some sense of “slope” of the floor on which you are standing (in other words, you do feel gravitational force; but we are going to take this away in a moment). You want to find the highest point in the room; but you don’t even know if there is a highest point. What strategy do you use? If you have a sense of slope (i.e., steepness), you could adopt a strategy that says something like, “continue in the direction of most difficult climb.” But does that guarantee that you are climbing the largest peak in the room? How do you strike out looking for another peak for comparison; and how do you make the comparison?
I am not sure this is a close enough analogy. The NFL allows you to remember all points you have looked at, and their relative heights. It does not assume lack of memory. And it does not insist that you must find the very highest point in the room, it just asks how well you do at finding high points (at least, in the use in evolutionary search that is what is of interest). And then it assumes the heights of the different points in the room are completely scrambled -- that there is no connection between physical closeness (horizontally) and height, hence no smoothness of the floor. How do we convey that to an audience? It's hard in that analogy.

Rumraket · 26 August 2011

Would it not be more correct to say that, the theorem states that you can program a really smart algorithm to search a specific landscape for peaks or valleys very well(the search will be "optimized"). With specific rules for how the search behaves when it finds slopes(go left: measure hight, go right: measure hight, etc. etc.).

And if you change the landscape, your algorithm may do even better(and is this "highly optimized"). The ruleset is very effective at finding peaks.

But on most landscapes, it will do worse. The ruleset is less effective because the shape of the landscape doesn't match the "system" of your algorithm very well. It may be "confusing" to the system, and it may spend a lot of time wandering around in areas that look like noise from the outside(if you could see the whole landscape from the top).

And if you calculate how effective your algorithm is at finding peaks, averaged over all possible landscapes, it is performing no better than randomly guessing coordinates would do.

Joe Felsenstein · 26 August 2011

Rumraket said: Would it not be more correct to say that, ... [details snipped, see above for them] But on most landscapes, it will do worse. The ruleset is less effective because the shape of the landscape doesn't match the "system" of your algorithm very well. It may be "confusing" to the system, and it may spend a lot of time wandering around in areas that look like noise from the outside(if you could see the whole landscape from the top). And if you calculate how effective your algorithm is at finding peaks, averaged over all possible landscapes, it is performing no better than randomly guessing coordinates would do.
That is correct and it needs only one thing more -- the definition of "most landscapes". In effect the world is divided into (say) 1-meter squares and then their locations are scrambled. If this were done for heights of landscapes in the real world, the result would be a total mess -- a lot of patches of ocean with many 1-meter-wide mountains of various heights. And just as this does not look like the real world, the NFLT's random assignment of fitnesses to genotypes does not at all look like real biology.

Mike Elzinga · 26 August 2011

Good! Progress. I’m always on the lookout for good non-mathematical analogies and metaphors that explain concepts and misconceptions.

If we look at the criticism that ID/creationists most often level at Dawkins’s Weasel program, for example, I think it would be that there is a target string. It is the presence of that target string that they say is putting the “answer” into the algorithm; and I think this “criticism” extends to genetic algorithms as well.

Now the misconception that I am seeing here is that they are conflating two similar sounding concepts. They note that scientists say that evolution is not targeted toward any particular phenotype, and so they criticize scientists for putting a target in a concept-illustrating program like Weasel.

But, to say that evolution is not targeted simply means – from the knowledge we have of nature – that there are literally billions upon billions of “targets” (hills or potential wells, if you like) that organisms are exploring; and this results in literally billions of phenotypes that survive at least for a period of time near many of those hills (wells).

Having a target in Weasel is simply and example of one such target out of myriads of targets in the real world; and the purpose of Weasel is to demonstrate how selection can help a local organism to converge on a target (phenotype). It is one “organism” climbing a nearby hill by acquiring fitness. In an analogous physics example, it is particles falling into a nearby configuration of wells by shedding energy.

So the Weasel program concentrates on a single hill (well); it does not “see” a broader landscape. It shows only how hills can be climbed or how wells become populated if there is something in the vicinity that “senses” the hill (well); and it shows that random variations can produce offspring that are closer to the peak (bottom) and selection keeps sorting out the ones that are closest.

The untargeted nature of evolution is captured in the fact that there is an entire landscape of hills (wells) which are being climbed (populated) by an entire array of creatures exploring that landscape. Any one of these creatures could end up on a number of nearby hills (wells) depending on how contingencies play out. There is a very low probability that any given creature will leap a great distance across that landscape.

Thus, as to memory, it is not likely that any given creature will have “memory” of other “distant” parts of the landscape. It is more likely to have “memory” about where it was, and is, in relation to a nearby hill (well); and it works its way toward a peak based on how fit it currently is.

My general impressions of the ID crowd come primarily from the misconceptions they have about the second law of thermodynamics, entropy, and evolution that they picked up from Henry Morris. As a result, they need to have an overriding “force” called “information” that “overcomes the second law of thermodynamics” in order to build complex systems of molecules and creatures.

Those misconceptions have led to their almost complete addiction to uniform random sampling of essentially infinite sample spaces in order to construct things that have a specified structure and behavior. Their misconceptions lead them to “prove” that this process cannot lead to evolution and complexity without the “input of information.”

But nature doesn’t work that way; so ID “proofs” are simply demonstrating that ID concepts of nature do not represent how nature actually behaves.

So when Dembski, et. al. claim that their concepts don’t simulate nature, the proper response should be to advise them to step back and learn how nature actually does things; and then put those processes in their programs.

(Oh; and don’t forget to initialize the variables in your programs.)

Joe Felsenstein · 26 August 2011

Mike Elzinga said: If we look at the criticism that ID/creationists most often level at Dawkins’s Weasel program, for example, I think it would be that there is a target string. It is the presence of that target string that they say is putting the “answer” into the algorithm; and I think this “criticism” extends to genetic algorithms as well.
I don't particularly want to get into the Weasel issue here (as people repeat the same arguments endlessly) but the Weasel program was intended only as a simple teaching example to show that an evolutionary algorithm can find better fitnesses in a far faster way than purely random search. It was not, was never, intended as a comprehensive realistic model of evolution. Creationists had been misrepresenting evolution as a purely random search. For most of their audience that effectively discredited natural selection, as it is obvious to anyone that pure mutation cannot make organisms anywhere near as well adapted as the ones we see (that is, pure mutation unaided by natural selection). This was an outrageous misrepresentation of evolutionary theory. The Weasel program was an effective answer to that fabrication. Partly because they were stung by its effectiveness, and partly because they love to present Dawkins as their main opponent so that they can present the issue of yes-or-no-on-evolution as an up-or-down vote on atheism, antievolutionists started to dramatically claim that the Weasel program was wrong because it did not accurately simulate all aspects of evolution. They also criticised it for having a (supposed) feature, "locking" which it in fact it didn't have. In any case, locking makes little difference, though they never admitted that. All of which are diversions from the reason for Weasel and the fact that it was a successful teaching simulation. So to me, whether or not Weasel has a defined target is a side issue that the antievolutionists have tried to elevate into a major issue. Let's not fall into their trap.

Kevin B · 26 August 2011

Joe Felsenstein said:
Mike Elzinga said: If we look at the criticism that ID/creationists most often level at Dawkins’s Weasel program, for example, I think it would be that there is a target string. It is the presence of that target string that they say is putting the “answer” into the algorithm; and I think this “criticism” extends to genetic algorithms as well.
I don't particularly want to get into the Weasel issue here (as people repeat the same arguments endlessly) but the Weasel program was intended only as a simple teaching example to show that an evolutionary algorithm can find better fitnesses in a far faster way than purely random search. It was not, was never, intended as a comprehensive realistic model of evolution.
The bit that seems to get missed with the Weasel program is that there is, in fact, two programs; the "single-stage selection" one that Dawkins only discussed (because it would run for a time that is large relative to the age of the Universe), and the "cumulative selection" one that will complete in the course of a lunchtime, even in interpretive BASIC on an early 1980s Apple microcomputer. It is the comparison of the two programs that is the point that is (perhaps deliberately) glossed over by the Creationist critics. Dawkins abstracted out one element of the theoretical basis of evolution and devised an experiment to investigate it. This is how science is done, and anyone who does not understand how the Weasel program is merely a small part, rather than the whole, has no right to call themselves a scientist.

Mike Elzinga · 26 August 2011

Kevin B said: The bit that seems to get missed with the Weasel program is that there is, in fact, two programs; the "single-stage selection" one that Dawkins only discussed (because it would run for a time that is large relative to the age of the Universe), and the "cumulative selection" one that will complete in the course of a lunchtime, even in interpretive BASIC on an early 1980s Apple microcomputer. It is the comparison of the two programs that is the point that is (perhaps deliberately) glossed over by the Creationist critics. Dawkins abstracted out one element of the theoretical basis of evolution and devised an experiment to investigate it. This is how science is done, and anyone who does not understand how the Weasel program is merely a small part, rather than the whole, has no right to call themselves a scientist.
There are a number of easily visualized examples from physics that demonstrate how one can map potential wells with random sampling. Probably the most well-known analog example is the sprinkling of iron filings onto a sheet of paper or a clear plastic sheet placed over a magnet. This illustration carries an important idea that such wells can be quite accurately mapped by noting the probability that one finds a “sampling particle” within a given region of space; and, indeed, that is one of the techniques used by Monte Carlo techniques or other kinds of analog techniques for mapping fields. There are other techniques that fall under the category of “relaxation methods” that vary parts of a system locally in order to minimize both globally and locally some field such that there is self-consistency that changes less and less as the computing process proceeds. Hartree-Fock and mean-field computations, for example, converge quite well; and these all fold in fundamental principles that find usually maxima or minima of something like energy or internal stresses or some other physical variable. In things like the ultrasonic focusing algorithms I wrote many years ago, nothing has to be known about what amplitudes are in any given reflected waveform that has been digitized and stored according to the position from which it was retrieved. One simply scans over the set taking waveforms from within a synthesized aperture and shifting them as a lens would do according to where the waveform appears within the aperture. Any reflected amplitudes in those waveforms that add up coherently then produce a focused image. You don’t have to know what is there; the process automatically pulls it out if it is there in the waveforms. All of these processes that are run on a computer are simulations of what we understand nature to do. The thing that impressed me about Dawkins’s Weasel program was its pedagogical simplicity in demonstrating a specific mechanism. At the time I read The Blind Watchmaker, I didn’t have access to a computer where I could play with it. By the time I actually got a computer that I didn’t have to share with everybody else, I had forgotten about Weasel and was doing other things. Looking back, I regret having forgotten about it, because with a slight change in perspective, it also illustrates some important ideas in physics and chemistry; and I could have made good use of it. I have since run this program on an HP48/49/50 series graphing calculator, and it works just fine; that’s how simple it is.

harold · 27 August 2011

Let's take a step back here and look at what is really going on.

1) There is abundant evidence for biological evolution, from multiple fields of inquiry, all of which converges on the same conclusion. This evidence includes numerous incomplete but valid computer science and mathematical models of evolution or aspects of evolution.

2) Dembski starts with the pre-conceived goal of "proving evolution to be false".

3) Yet he does not familiarize himself with the relevant evidence, let alone address it. Immediately, his work is suspect on this grounds alone. We may compare him to someone seeking theoretical proof, for example, that Jared Lee Loughner did not did not engage is a shooting spree at an appearance by Representative Gabrielle Giffords. Even if he comes up with something plausible, how does he explain away the strong evidence in favor of that which he declares "theoretically impossible"?

4) We are spared the dilemma, fortunately, of a conflict between convincing evidence for the occurrence of evolution, and a compelling theoretical argument that the evidence cannot exist. Dembski does not provide a theoretical argument. In the case under discussion here, he misrepresents the NFL theorem as being a model which "theoretically disproves" biological evolution. However, the reaction of computer scientists, mathematicians, and biologists, including the many scholars cross-trained in two or all three of those fields, is pretty much unanimous. All neutral observers simply agree that Dembski has misapplied and misrepresented NFL theorem.

5) Eric Holloway engages in odd behavior. I think any reasonable observer would agree that the following are true of Eric Holloway - a) He starts with a rigid predisposition to "disprove" biological evolution. b) He ignores all relevant evidence. c) In fact he actively hides from relevant evidence. d) He issues the patently false claim that Dembski's interpretation of NFL has not been adequately refuted - yet he does so from a venue where he can control feedback, and when feedback to the contrary comes in, he refuses to acknowledge it.

Joe Felsenstein · 27 August 2011

harold said: Let's take a step back here and look at what is really going on. ... 5) Eric Holloway engages in odd behavior. I think any reasonable observer would agree that the following are true of Eric Holloway - a) He starts with a rigid predisposition to "disprove" biological evolution.
He would argue that he's not rigid and is open to counter-arguments. For example on UD he declared:
Eric Holloway: So, I spent some time reading the critics, and this bore [sic] my frustration. I could not find one author who treated Dembski’s work fairly! If someone could fairly refute Dembski’s work I’d be all over it, but I haven’t found anyone! Instead it’s all passive aggressive ad homineum [sic] and brow beating, with ample burning of strawmen, very tiring to read.
I suspect that his self-image is of someone who is trying to fairly assess the evidence. We might disagree given that
harold: b) He ignores all relevant evidence. c) In fact he actively hides from relevant evidence. d) He issues the patently false claim that Dembski's interpretation of NFL has not been adequately refuted - yet he does so from a venue where he can control feedback,
Agreed so far.
harold: and when feedback to the contrary comes in, he refuses to acknowledge it.
Well, we don't know for sure that any feedback has come in to that thread at UD that conveys the main criticism that has been made of Dembski's NFL argument. Elizabeth Liddle sounded like she was about to do this when she said:
Elizabeth Liddle: The NFL theorems would only apply to evolution if we also considered solutions to the problems of survival that are unconnected with each other. Evolutionary algorithms are far better than blind search algorithms at finding connected solutions, and connected solutions is exactly what they find.
... but then she went on to revert to the Orr-Wolpert Defense of "evolution is more complicated than this simple model". Of course the ID types are strangely unable to see the chief criticisms of Dembski's NFL argument when they're right before their nose. But a little of the blame attaches to commenters who attack Dembski's NFL argument by raising all sorts of side issues rather than taking the trouble to understand the main issue -- which is that the random association of fitnesses with genotypes produces a situation where one single base change is as bad for the organism as changing every base in the genome. And real biology deals with much smoother fitness surfaces than that. No one actually raised the main criticism over in UD (except for this brief allusion by Liddle) and if Holloway is unable to find Panda's Thumb he could claim innocence. Sort of.

Mike Elzinga · 27 August 2011

Joe Felsenstein said: No one actually raised the main criticism over in UD (except for this brief allusion by Liddle) and if Holloway is unable to find Panda's Thumb he could claim innocence. Sort of.
There have been a few times that I have gone over to UD and tried my best to get into the minds of the people making arguments there. I have done this mostly for selfish pedagogical reasons in my attempts to grasp the essence of misconceptions about science. But I can’t do it for very long over there at UD; it makes me nauseous. In fact, if any of them could find Panda’s Thumb, or any other textbook that explains scientific concepts, it is highly unlikely they could derive any benefit from it. Their wiring is just too screwed up; it has to be torn out and entirely replaced.

Joe Felsenstein · 27 August 2011

Mike Elzinga said: But I can’t do it for very long over there at UD; it makes me nauseous. In fact, if any of them could find Panda’s Thumb, or any other textbook that explains scientific concepts, it is highly unlikely they could derive any benefit from it. Their wiring is just too screwed up; it has to be torn out and entirely replaced.
Threats of violence, eh? ;-) More seriously, I just reread Elizabeth Liddle's comments and have to retract something -- she never alluded to the main (Richard Wein, Jason Rosenhouse, et al.) criticism of Dembski's NFL. I misread her remarks which alluded to the coevolution criticism of Orr and Wolpert. So there is a 100% record at UD of opponents of the NFL argument not raising the right points.

mrg · 28 August 2011

harold said: Let's take a step back here and look at what is really going on.
Another way of putting this is that the game he is playing is: "You can show you are right in practice but I can prove you are wrong in theory." I've thrown this at creationists a dozen times and all I get is "dumb looks are still free".
Joe Felsenstein said: Threats of violence, eh? ;-)
Maybe a less threatening way of saying that would be: "We can't patch up the system -- we'll have to install a new OS from scratch."

Joe Felsenstein · 28 August 2011

Oh here we go. Eric Holloway has posted a long rant essay on the Broader Implications of ID.

It seems it validates everything in a laundry-list of political and social opinions of his. First, it proves that Keynesian economic theory is wrong ...

Mike Elzinga · 28 August 2011

Joe Felsenstein said: Oh here we go. Eric Holloway has posted a long rant essay on the Broader Implications of ID.
Oh, groan; Aristotle’s (384 – 322 B.C.) efficient and final causes!

mrg · 28 August 2011

Joe Felsenstein said: Oh here we go. Eric Holloway has posted a long rant essay on the Broader Implications of ID.
I just glanced at it and the pomposity of it blasted me right off the page. You could float an airship on that class of rhetoric. It's another proof of the principle that, while creationists can say things that sound like they make sense, the longer any one of them talks the more obvious it becomes he's riding the crazy train.

Mike Elzinga · 28 August 2011

mrg said: I just glanced at it and the pomposity of it blasted me right off the page. You could float an airship on that class of rhetoric. It's another proof of the principle that, while creationists can say things that sound like they make sense, the longer any one of them talks the more obvious it becomes he's riding the crazy train.
It is not surprising that ID/creationists retain much of the distorted remnants of early Greek philosophy. The medieval church adopted much of what the Muslims had preserved of the Greeks after the Crusades in Spain during the 11th century. Much of the active (re)translation of these works took place during the 12th century. Holloway’s rant is sophomoric; as though he just discovered an introductory philosophy textbook and thinks he now has deep insight into how the world works.

Joe Felsenstein · 28 August 2011

You folks are missing the profound implications of ID. It makes lots of other scientific activities unnecessary.

Economists: Do you want to know whether Keynesian theory is correct? Don't study economics, just read William Dembski!

Physicists: Do you want to know how string theory fits into the rest of physics and gibes with physical reality? Stop messing around with those equations, read Denyse O'Leary instead!

Astronomers: Do you want to know whether intelligent life exists elsewhere and has any prospect of communicating with us? Turn off those telescopes and fire up the browser: Uncommon Descent knows the answer!

and of course

Biologists: Do you want to know about the history of life and the mechanisms that led to it? Stop the sequencing machine, and head to the nearest fundamentalist church where all will be revealed.

apokryltaros · 28 August 2011

Joe Felsenstein said: You folks are missing the profound implications of ID. It makes lots of other scientific activities unnecessary.
Hence my summarizing Intelligent Design as "It's all too complicated for us, stupid mortal researchers to ever hope to understand, therefore DESIGNERDIDIT"

Joe Felsenstein · 29 August 2011

Eric Holloway has finally responded to the Original Post in a new post at UD.

He cites David Wolpert as saying that the NFL applies to a simple model of evolution. He sees me as saying it does not apply to that model because "the relevant fitness landscape for evolution is not under the domain of the NFL."

Let me be even clearer. In a simple model of uphill search on a fitness surface NFLT applies. But what does it prove? It proves that this uphill search is on average ineffective, on average when averaged over all possible ways you could associate the fitnesses with the genotypes.

A typical one of these random associations of fitnesses with genotypes is a completely "jaggy" fitness surface. On it, a single base change at a single site carries you to a genotype that has a totally different fitness (randomly-drawn from all possible fitnesses). Now if you instead change all bases in the genome, simultaneously, you also get a randomly drawn fitness. So the two kinds of change should have the same average effect on fitness.

Holloway tries to argue that biology shows that fitness effects of mutations are indeed disastrous. Well, they aren't perfect but they sure aren't that disastrous!

So the fitness surfaces we actually have are not at all typical of the ones that contribute the overwhelmingly to the NFLT average. They are much better for natural selection, but that is swamped out in the NFLT average by all the jaggy ("white noise") fitness surfaces.

This being the case, Dembski's use of the NFLT does not have the effect of showing that natural selection cannot achieve substantial adaptation.

Holloway has a response for that. See the following comment.

Joe Felsenstein · 29 August 2011

Eric Holloway says that if my point about the invalidity of Dembski's NFL argument is correct,
In this case Dembski would be indeed wrong about the applicability of the NFL. However, given the high specificity of such a landscape, this would mean that evolution itself is intelligently designed to an extraordinary degree.
That is equivalent to the Dembski-Marks "Search For A Search" argument. As I have argued in posts here and here, if fitness surfaces are far smoother than a random association of fitnesses with genotypes (and they are) that does not prove that any Designer has intervened to do that. Mere physical reality could do that -- the weakness of long-range interactions. Holloway argued in his response to me that Kolmorogov Complexity shows that jaggy fitness surfaces will be overwhelmingly common. I don't think it shows that because I don't think there is any proof (or even good argument) that physical reality allows this. If I type on my keyboard (a small physical perturbation of the keys) there are not strong effects on Holloway's house -- the roof does not start leaking, for example. Yet in a physical world that followed this Kolmogorov Complexity rule everything would interact infinitely strongly with everything. Blatantly, physical reality does not work that way -- even without a Designer to smooth things out and calm everybody down. I have given some common-sense arguments to this effect in my 2007 response to Dembski. I am happy that Holloway is at least trying to respond to that -- there was no response to it before now. One footnote: I am off on vacation for five days with my family in the morning. I will try to respond to any further exchanges before then, but may not be able to do so in a very timely fashion.

Mike Elzinga · 29 August 2011

Finally, perhaps Dr. Felsenstein is right after all and evolution does happen to possess the extremely rare and valuable fitness landscape whereby algorithmic search is significantly effective to be worthwhile. In this case Dembski would be indeed wrong about the applicability of the NFL. However, given the high specificity of such a landscape, this would mean that evolution itself is intelligently designed to an extraordinary degree.
The highlighted part is not an argument; it is a bald assertion with nothing to back it up. The laws of physics don’t change just because someone doesn’t understand them and then covers up that lack of understanding by tossing around pseudo-scientific jargon.

mrg · 29 August 2011

Joe Felsenstein said: It was named by its authors, Wolpert and Macready. They showed that when you averaged over all the ways the values of the objective function could be assigned to points in the space, on average no search strategy would outperform simple random search. So there was No Free Lunch, in the sense that to do well, you had to have something extra that makes the surface smooth. In the case of evolution it is just physics, that makes similar genotypes have similar fitnesses quite often. They were generalizing about general search spaces and general strategies, and were not trying to cast doubt on evolution. Wolpert was quite angry when he found Dembski using his theorem for that.
Ah. Is this effectively like saying that, given an infinite variety of types of data, no data compression method works any better than any other? Which is true but irrelevant, since given specific types of data some compression methods work very well and some work poorly. Use the wrong compression method on certain types of inappropriate data and you can in principle get data EXPANSION. One illustration of this is that for a typical "busy" photo, JPG image compression can on an easy bet beat PNG compression. For a simple block drawing, PNG compression will as an easy bet beat JPG compression. "Use the right tool for da job." I recall Mike Elzinga pointing out that physical phenomena don't generally have flat behavior over their range of operation. Indeed, they can be very selective, even when everyone admits there's no intelligence running them by remote control.

Joe Felsenstein · 29 August 2011

mrg said: Ah. Is this effectively like saying that, given an infinite variety of types of data, no data compression method works any better than any other? Which is true but irrelevant, since given specific types of data some compression methods work very well and some work poorly. Use the wrong compression method on certain types of inappropriate data and you can in principle get data EXPANSION. ...
Yes, there is a good analogy there to the NFLT. The issue is that real genotypes do not live on a fitness surface that is pure white noise, just as images we want to compress are not pure white noise either.

mrg · 29 August 2011

Joe Felsenstein said: Yes, there is a good analogy there to the NFLT. The issue is that real genotypes do not live on a fitness surface that is pure white noise, just as images we want to compress are not pure white noise either.
Well, they CAN be but they are notoriously hard to compress! Thanks JF. I didn't want to wade through figuring out the NFLT because it looked like such a handwaving red herring as far as evosci is concerned and I have lots of other things to learn. But by that analogy I can see that, yes, evolution wouldn't work if it was rooted in a completely unpredictable chaotic universe. It isn't, of course, being based on and constrained by a range of phenomena from the rules of chemical bonding to selection pressures.

Mike Elzinga · 29 August 2011

mrg said: Well, they CAN be but they are notoriously hard to compress! Thanks JF. I didn't want to wade through figuring out the NFLT because it looked like such a handwaving red herring as far as evosci is concerned and I have lots of other things to learn. But by that analogy I can see that, yes, evolution wouldn't work if it was rooted in a completely unpredictable chaotic universe. It isn't, of course, being based on and constrained by a range of phenomena from the rules of chemical bonding to selection pressures.
There are a couple of other examples that can also illustrate the issue. In nature, the surfaces represented by potential wells, or some other kind of surface used to represent a physical variable, are generally continuous and smooth. A surface that has random “spikes” or delta functions sticking up is not a physically realizable surface. With real 3-D surfaces one can have issues with saddle points where a surface can have zero slope in every direction yet be neither a maximum nor a minimum. It gets much more complicated in higher dimensional spaces; but if one has something like fitness that is a measure of “how well one is doing,” one can “feel around” in the space to find where this measure maximizes locally. The white noise example is also useful. As you know, the Fourier transform of white noise is an infinite spectrum of frequencies. White noise is not band limited. Real noise, on the other hand is band limited; there is an upper limit to the frequencies. That already tells us something about the smoothness of the functions we are dealing with; in other words, that the temporal or spatial distribution of the function does not contain spikes anywhere. I think that one of the ways one can think of “fitness” is that it is analogous to a rate meter or Geiger counter that varies as it approaches a radioactive source. If an organism is doing a good job of producing surviving offspring, that becomes a measure of how close the organism is to “fitting comfortably” within its environment. In physical terms, the myriad of physical stresses on the organism are, in a sense, minimized locally. But the physical stresses on an organism are ultimately derived from physical processes described in terms of potential wells; and at the level of a complex living organism, all wells are smooth locally. Zooming way out, however, might produce the appearance that some of them look like “spikes” pointing downward (fitness spikes upward). I suspect that is also part of the problem that ID/creationists are having with their sampling methods. These sampling methods betray their misunderstanding that all of evolution takes place “locally,” with organisms moving on smooth surfaces to nearby peaks. Current organisms are always built on previous templates that get modified or changed in function incrementally.