Wednesday, May 3, 2023

Feynman’s Maze-Running Story

A 1974 Richard Feynman speech recounts an anecdote about a scientist, Mr Young, who in 1937 discovered serious flaws in rat maze-running psychology research: the rats were using information from the environment, like smells or the sound of the floor, to find their own, rendering experiments dangerously ambiguous if the mazes are not carefully constructed to eliminate these side-channels (eg. by putting them on sand beds to dampen sounds). This discovery was then ignored by researchers, Feynman says, illustrating the difference between successful sciences like physics and ‘cargo cult’ ones like psychology.

Who was Mr Young and what was his research which was ignored by mainstream psychology? This question has often been asked, particularly by myself for over a decade, and mysteriously, never answered.

Here we finally answer it: Mr Young was probably Quin Fischer Curtis, in his theses published in 1931/​1936, as part of John F. Shepard’s multi-decade research programme at the University of Michigan into ‘floor cues’, going well beyond just putting sand on the floor.

This research programme & its results tragically fell into oblivion due to the unfortunate circumstances of the UMich department which turned it into almost a parallel-universe of maze-running research: few results were published formally (in part due to Shepard’s perfectionism & constantly coming up with new maze experiments to run), the department drifted far out of the mainstream, and the maze-running paradigm fell out of fashion around WWII, which is also when the UMich department was ‘rebooted’ to fix its hermeticism—leading to collective amnesia.

So while it turns out the maze-running story supports the Feynman usage, it also tells a broader cautionary lesson about when academia does and does not function, in a different version of ‘publish or perish’.

At the 1974 Caltech commencement, Nobelist physicist Richard Feynman gave a famous speech on “cargo cult science” (WP), in which he discussed methodology & the philosophy of science—what distinguishes science that works from ‘science’ that goes through all the motions of things like formal peer review and involving lots of numbers and costing a lot of money but doesn’t work & the proverbial ‘cargo’ does not land; the epistemological issues would become even more pointed in his 1986 Rogers Commission Report Appendix F⁠.

In it, he gives a few examples like the Millikan oil experiment where physicists got the ‘right’ answer even when it turned out to be wrong (cf. Henrion & Fischhoff1986), and toward the end, he gives a non-physics one, from animal psychology, about the rat maze-running experiments of a “Young”, which showed how rat maze-running should be done for the causal inferences to be valid.

To quote the anecdote in full:

…Other kinds of errors are more characteristic of poor science. When I was at Cornell [1945–1950], I often talked to the people in the psychology department. One of the students told me she wanted to do an experiment that went something like this—I don’t remember it in detail, but it had been found by others that under certain circumstances, X, rats did something, A. She was curious as to whether, if she changed the circumstances to Y, they would still do, A. So her proposal was to do the experiment under circumstances Y and see if they still did A. I explained to her that it was necessary first to repeat in her laboratory the experiment of the other person—to do it under condition X to see if she could also get result A—and then change to Y and see if A changed. Then she would know that the real difference was the thing she thought she had under control. She was very delighted with this new idea, and went to her professor. And his reply was, no, you cannot do that, because the experiment has already been done and you would be wasting time. This was in about 1935 or so, and it seems to have been the general policy then to not try to repeat psychological experiments, but only to change the conditions and see what happens.

…[Not] All experiments in psychology are of this type, however. For example, there have been many experiments running rats through all kinds of mazes, and so on—with little clear result. But in 1937 a man named Young did a very interesting one. He had a long corridor with doors all along one side where the rats came in, and doors along the other side where the food was. He wanted to see if he could train the rats to go in at the third door down from wherever he started them off. No. The rats went immediately to the door where the food had been the time before.

The question was, how did the rats know, because the corridor was so beautifully built and so uniform, that this was the same door as before? Obviously there was something about the door that was different from the other doors. So he painted the doors very carefully, arranging the textures on the faces of the doors exactly the same. Still the rats could tell. Then he thought maybe the rats were smelling the food, so he used chemicals to change the smell after each run. Still the rats could tell. Then he realized the rats might be able to tell by seeing the lights and the arrangement in the laboratory like any commonsense person. So he covered the corridor, and, still the rats could tell.

He finally found that they could tell by the way the floor sounded when they ran over it. And he could only fix that by putting his corridor in sand. So he covered one after another of all possible clues and finally was able to fool the rats so that they had to learn to go in the third door. If he relaxed any of his conditions, the rats could tell.

Now, from a scientific standpoint, that is an A-Number-1 experiment. That is the experiment that makes rat-running experiments sensible, because it uncovers the clues that the rat is really using—not what you think it’s using. And that is the experiment that tells exactly what conditions you have to use in order to be careful and control everything in an experiment with rat-running.

I looked into the subsequent history of this research. The subsequent experiment, and the one after that, never referred to Mr. Young. They never used any of his criteria of putting the corridor on sand, or being very careful. They just went right on running rats in the same old way, and paid no attention to the great discoveries of Mr. Young, and his papers are not referred to, because he didn’t discover anything about the rats. In fact, he discovered all the things you have to do to discover something about rats. But not paying attention to experiments like that is a characteristic of Cargo Cult Science.

This is one of his most-read works, especially when it was republished unmodified in his 1985 quasi-autobiography Surely You’re Joking, Mr. Feynman!⁠.

Feynman refers to several things like Rhine & ESP or Millikan’s oil drop experiments, which are easy enough to find, and sometimes linked in recurring mentions of Feynman’s speech; but a source for Young is never given. Back in 2010, in a discussion of the burgeoning Replication Crisis⁠, a LW commenter “Costanza” mentioned the speech as an early example of systematic methodological problems in psychology & asked for the Young reference, because he couldn’t find anything about it.

2 years later, no one had found anything either. 2 years after that, I took a crack, set my timer to record how few seconds I found it in, expecting to get a nice Google-fu case study—and found nothing!

This was surprising because Feynman is extremely specific & concrete: it should not require any more than a single query to Google Scholar of the form author:Young date:1937 rat sand maze. It should be extremely easy to find this reference: Feynman did not make things up, he provides plausible background (a prior interest in psychology & Cornell does indeed have a strong psychology program), he gives a name (which is, however, both a common adjective & unfortunately common surname in the USA—in the top 50), describes the circumstances (you can infer ‘Young’ is a grad student because maze-running research is so pure it is done only in academia and Feynman repeatedly refers to him as ‘Mr’, to emphasize his role as underdog/​gadfly), describes the research in considerable depth, even describes doing a literature search to look for citations or mentions (implying it was published such that it could be cited), and so on.

The only challenge would appear to be that it was probably a grad student, and it was obscure, but as challenging as that might be in 1937 or even 1974, fulltext search in the 2010s obviated most of the problem in searching these sorts of things—if it’s not in Google Scholar, it’s in Internet Archive⁠, or HathiTrust, or ProQuest for student theses etc. It can be tedious or time-consuming, and one can rack up fees scanning old used books or purchasing ProQuest scans, and sometimes one hits frustrating walls like a document available only by visiting the Library of Congress in person—but it’s not usually that hard. In particular, one does not usually run into a blank wall of zero leads.

Every once in a while, I would be reminded of my white whale, and mention it on Twitter, or list it on my Open Questions page, and run into the blank wall again.

The first plausible lead one usually finds is award-winning animal psychology Dr Paul Thomas Young (1892–1978), who earned a PhD under Edward B. Titchener at Cornell in 1918, and had a long successful career at the University of Illinois (obituary). Dr Young was a noted animal psychologist, and unsurprisingly given his era, used maze-running experiments.

So, is he Mr Young? Doesn’t look like it; there are obviously a few problems with this:

  1. Dr Young had held a doctorate for ~20 years by the time ‘Mr Young’ is being described as running mazes.

  2. Dr Young would be a senior professor, possibly department head, and unlikely to be running experiments himself.

    This is especially true if he took after his doctoral advisor, who is generally described as hewing to the tyrannical German style of academia he would’ve learned from his doctoral advisor, Wilhelm Wundt⁠, which was part of importing German academic practices (like the doctorate itself) into the fledgling American higher-ed universe.

  3. Dr Young was not obscure nor are his works ignored.

  4. There is no Feynman nexus: how did Feynman learn all this in the first place?

    Young was at Cornell for his doctorate, yes, but that had nothing to do with maze-running and was a good 27 years before Feynman arrived. If Young did it, it had to be at the University of Illinois where he moved to for the rest of his life.

Still, he seems at first glance to be the right guy. For example, on Quora, a Michael A. Gottlieb (who is described as “editor of The Feynman Lectures on Physics⁠, coauthor of Feynman’s Tips on Physics” & sounds like he should know what he’s talking about), replies to a question about Mr Young by suggesting Dr Young and a specific paper. However, his citation doesn’t work because it is the wrong year (a minor issue) and has nothing to do with ‘sand’, much less the story:

I believe Feynman was referring to psychologist, P. T. Young. See, for example, Young’s1938 paper, “Preferences and demands of the white rat for food” in the Journal of Comparative Psychology, Vol 26(3), Dec 1938, pp 545–589. The first part concerns spatial factors in feeding behavior, and may have been the very research Feynman referred to.

No, Young1938 is not the correct citation, I just read the paper after seeing your response. He talks about spatial factors by way of placement of feeding tubes in boxes (the rat picks the right side or the left side of the box, habits recorded), and rotating cups of food around rats. The issues seemed comparable, but I did not find any of the specific issues described by Feynman.

I’m still looking for the actual citation, starting with the Journal of Comparative Psychology.

OK, so perhaps that specific paper isn’t it nor does it helpfully cite related work which might be it; we can’t pass up such a lead, no matter the problems—an animal psychologist, named ‘Young’, who has done rat maze-experiments! He has to be investigated more.

More focused Google Scholar searches, restricting it to all Dr Young-authored papers, and looking for ‘sand’, turns up nothing. Mietek Bak made a list of Young publications (most of which go far afield from maze-running or rigorous experimental method, one infers from the titles), and highlights 5 worth checking for discussion of sand; I checked 3 of the most promisingly-titled ones myself [Young1940⁠, Young1948⁠, Young1949], zilch, as well as Young’s animal psychology textbooks like Emotion in Man and Animal (surely there he would cover any sand-related methodology), also nothing.

All of Dr Young’s publications turn out to be irrelevant after exhausting the corpus; and none offer even a hint of the research, much less a smoking gun.

The only possible lead is Young’s correspondence with even more noted psychologist Edwin Boring: Boring had an interest in methodology like experimenter bias (coming up several times in Rosenthal1976⁠, which thanks Boring). It is not implausible that somewhere in Boring’s correspondence, sand comes up; but unfortunately, like most such academics’ papers, his have not been digitized and would require a long trip to examine thoroughly, and thus is a dead end.

The biggest problem the Young dead-end poses is that having failed to find any trace in it, one must begin to assume that Feynman got the year, surname, or both wrong. Unfortunately, if we drop either one, and we search just ‘maze sand’, we are swamped with vastly too many hits to vastly too hard to access papers/​books/​monographs. We could spend the rest of our life painstakingly obtaining fulltext of each one to look at the context around each hit for ‘sand’, and may well still not find it.

Perhaps going in reverse from Feynman to the anecdote would help: the Caltech Feynman archives, which hold a comprehensive collection of Feynman papers because he made a practice of retaining & donating his papers there (including after the 1974 speech), might hold the answer?

When asked for more information, they’ve apparently said they didn’t know anything. Searching the Feynman papers digitally turns out to be impossible, and their copyright / visiting policies are draconian⁠. So, barring a visit to Los Angeles, this is a dead end too.

Given the extensive literature on all the ways rats can cheat mazes, it’s not surprising that—whether or not Young turned out to be real—there might be other real examples.

A Twitter user noted a 1993-04-10 Usenet discussion (sci.bio: “Pulling Habits out of Rats”) about Mr Young, asking not for sourcing but for reasons why “Young” was ignored, where Marvin Minsky replied

I can think of several possible explanations for this situation.

  1. Feynman was wrong
  2. Rat experiments are no longer performed or even of interest
  3. Rat experiments don’t need to have these kinds of controls, because they are designed to measure attributes not affected by these things.
  4. Rat psychologists have crummy experimental procedures and hence worthless results.

Can anyone offer some insights into which of these might be the case? Perhaps someone who has worked or is currently active in the field?

What happened around 1937 was that

5. B. F. Skinner developed ways to control all those external variables by enclosing the experiment in a sealed, soundproof, lightproof, etc., box. The results were reliably reproducible, and a great deal was learned. The boxes were soon named “Skinner Boxes” and became the new paradigm for studying animal learning. Skinner and many others switched to pigeons, for various reasons, but others continued to use rats.

When I was undergraduate in the late 1940s, I hung around that lab [Skinner’s lab at Harvard University] and helped with some switching and sequencing stuff to make the experiments more convenient. I don’t remember the name of Young, but it was folklore that the change was because someone had found that rats appeared to be able to navigate by distant cues, eg. the appearance of the ceiling, so that the traditional open-topped maze experiments might be flawed.

A more contemporary example, of odour cues in a maze, comes from “Shortcut Learning in Deep Neural Networks”, Geirhos et al 2020:

2.1 Shortcut learning in Comparative Psychology: unintended cue learning

Rats learned to navigate a complex maze apparently based on subtle color differences—very surprising given that the rat retina has only rudimentary machinery to support at best somewhat crude color vision. Intensive investigation into this curious finding revealed that the rats had tricked the researchers: They did not use their visual system at all in the experiment and instead simply discriminated the colors by the odour of the color paint used on the walls of the maze. Once smell was controlled for, the remarkable color discrimination ability disappeared… [Nicholas Rawlins⁠, personal communication with F. A. W. some time in the early 1990s, confirmed via email on 12.11.2019]

I asked on Twitter if Rawlins had seen this first hand or if it was secondhand, and the second author stated:

Yes, the anecdote happened as described in Nicholas Rawlins’ laboratory at Oxford, confirmed in personal communication with Felix A. Wichmann in Nov ’19.

The solution turned out to be blind luck. My “Open Questions” page occasionally gets linked by blogs, and there were a flurry of links in April 2023. Frederic Bush happened to notice the Feynman entry & idly gave it a shot on the Internet Archive.

Surprisingly, he quickly found a hit about sand for maze-running inside a 1935 book scan uploaded to the IA in September 2019: a Principles of animal psychology⁠, by a Norman R. F. Maier & Theodore C. Schneirla at the University of Michigan⁠.

The description is so like the Feynman anecdote that it is hard to believe that it is not closely connected or indeed, the very anecdote itself!

Neither Maier, nor Schneirla, nor UMich had come up at all in prior discussions or papers, nor did they have any apparent connection to a ‘Young’, Cornell, or Feynman. Maier, for example, appears to have worked under a ‘John F. Shepard’ (no Wikipedia entry), among a list of prominent psychologists who otherwise all have Wikipedia articles like “Karl Lashley and Heinrich Kluver at Chicago”.

Ominously, the Wikipedia article on Maier notes that “Although rarely discussed today, Maier’s research received extensive publicity in its day…In the 1950s, Maier changed his area of research to industrial psychology, he claimed in response to prejudicial treatment of him in the profession.2” (He was most famous for the ‘two cord problem’, which I had vaguely heard of but the fulltext was not in Google Scholar—another bad sign.)

Principles was a textbook which was well-regarded, but otherwise unremarkable, and aside from a reprint of an expanded edition 2 decades later, long since out of print & use. Nor is it easy to find fulltext of it without either being at a university library or purchasing a used copy. Used copies of it are inexpensive, but it was not in Libgen, you cannot read it in Google Books (digitized 2007-11-01) nor HathiTrust⁠; a reasonable number of university libraries hold it (unsurprisingly), but typically relegated to long-term storage, and there are no signs of digital fulltext for non-HathiTrust universities.

So, until IA scanned it 2019, Principles was part of the large dark matter of 20th century orphan works: it’s there, it’s not usually that hard to get a physical copy of, but whoever is the copyright holder hasn’t bothered to free it so no one can provide a digital copy (“copyright is why we can’t have nice things”), and it’s hard to know that you want it in the first place—and this appears to be such a case.

Should we have been able to find Maier’s Principles before April 2023?

Looking at available results: I don’t think so. Sometimes you just get unlucky. In this case, given that finding Mr Young defied all efforts for so long, we should not be surprised if this extreme difficulty was due to extreme bad luck, because a lot of things went wrong—Feynman getting some critical bibliographic details wrong and omitting the key term ‘floor cue’, Shepard for not publishing & Pillsbury for letting him not publish, psychologists for forgetting & losing the work, copyright for suppressing orphan works, bad luck that Principles was scanned in 2019 rather than the ~15 years of scanning before that, the expense of cutting-edge DL systems that could have feasibly read all hits for ‘sand’ in a corpus and intelligently assessed if the context was similar to the Feynman anecdote…

The book scan cannot be downloaded. I have purchased a used book scan for easier consultation but it will not be available for some time; one can use an Internet Archive to ‘check it out’ for 1 hour and read it online.

Ch17 of Principles is “The Analysis of Maze Learning”⁠, focusing first on “The Sensory Control of the Maze Habit”, which is about “determining what differential sensory experiences an animal uses when it runs a maze”. This chapter recounts what turns out to be a bit of a long-running war in early 20th century maze-running research, about the varying capabilities of sight, smell, whisker and kinesthetic, sound, and smell, producing a complex set of findings suggesting that all of the senses could be relevant & rats would rely on combinations as available—in other words, that senses like smell could help them run the maze.

Illustrating the difficulty in nailing down how rat navigation is Hunter1929⁠/ ​Hunter1930⁠, who created a carefully-machined & daily-washed maze to remove kinesthetic & olfactory cues, but found that his blinded, de-whiskered mice still managed to learn the maze. He hypothesized it was due to the rats hearing something indicating direction like “a constant noise from one side of the room”; so he created a 3D maze to superimpose the different choices vertically and make each choice the same horizontal distance from any distant noise.

Maier passes to describing work by the afore-mentioned John F. Shepard⁠, who has done “many years of work in the analysis of learning of various types of mazes” and trying to nail down rat senses. In a new maze of his, rats were able to learn mazes with units up to 29, suggesting some serious misunderstanding, which Shepard also ascribed to “auditory” perception—specifically, “the patter of the rats’ feet seemingly resonated differently on different parts of the floor.”

How to eliminate it? Maier passes on to the section “The Elimination of the Floor Cue” on page 384, where he describes the work of one Curtis1931, who “covered the concrete floor of the building with sand to a depth of 1.5 inches.”

This change substantially reduced the performance of the rats. Even more strikingly, Curtis’s maze came in 5-units, with the rat positioned differently, “Thus, at the junctions the rat had to turn left at the first two units and right at the third.” This is also true of “a later study (unpublished)”, where “the starting point varied, so that the rat was required to run 2, 3, or 4 units before reaching the food.”

This chapter breaks through the blank wall: we have a technical term now, ‘floor cues’, and we have at least two names, ‘Curtis’ and ‘Shepard’. Curtis may not have been Mr Young, but he fits remarkably well.

We now know where to start.

The citation turns out to be a master’s thesis:

  • “The Control of Floor-cues in the Maze-learning of the White Rat”, Curtis1931 (requested)

Unfortunately, it is inaccessible, although described in Curtis1936⁠. However, we can search for more information about Curtis. Quin Fischer Curtis turns out to have had a successful subsequent career⁠, albeit one that had little to do with maze-running or pure psychological research, so he appears to’ve done little related followup research (aside from his subsequent PhD thesis). We can look at citations of Curtis1931. This doesn’t take long because the only citation in Google Scholar is Solomon1948 which briefly says

The literature concerning the kinesthetic control of maze performance in animals has been voluminous…In experiments involving manipulation of intra-maze and extra-maze stimulation, the results are also conflicting. Carr and Watson (8), Dashiell and Helms (16), Shepard (76), and more recently, Hunter (54) have all offered evidence that maze proficiency could be acquired on the basis of kinesthesis alone.

On the other hand the experiments of Carr (7), Dennis (18⁠, 19), Macfarlane (65), Curtis 1931 (15, original not seen, as cited in Maier & Schneirla1931), Honzik (41) and others have shown rats to be incapable of learning mazes when all extra-maze and intra-maze differential cues were well controlled.

This turns out to be quite helpful, as going through the references tells us several things:

  • there was a long-standing debate over how rats ran mazes and how to control sensory leakage, but that this literature is little-cited & now highly obscure
  • Principles was the only way a reviewer in 1948 had access to Curtis’s results
  • and Shepard published an extremely relevant but short paper on the ‘floor cues’ in 1929 (scarcely 1 page long), describing how using rubber flooring and swapping out floor sections confused rats running the maze, stating that it rendered unspecified earlier research uninterpretable, and stating their intention to study it more
  • searching for the cited, I came across as well: “The effects of olfactory cues on the maze learning of white rats”, De Mand1940; “Visual Cues in Maze Running by the Albino Rat”, Walton1930

Maier’s reference to an unpublished study makes sense when we continue searching for information on Curtis and discover he moved universities from Illinois to University of Michigan (ie. where Maier, Schneirla, and Shepard all worked), and published his PhD thesis in 1936 (after Principles in 1935):

The experiments are both extensive & intensive, and border on monomania. There can be little doubt that if these experiments described in either thesis are not the exact experiments that Feynman is referring to, then they must have been done in this context, by Curtis, Shepard, or another Illinois/​Michigan person. This is as good an answer as one can expect, and if we had only Curtis’s theses to go on, we could stop there. But the answer to one question often brings us another question.

Reading the thesis, the role of Shepard jumps out much more than it did from Maier: this is Shepard’s thesis from start to finish⁠, and Curtis is constantly referring to unpublished work by Shepard.

So, what is up with all that? What is Shepard’s deal?

If we start googling Shepard more, we will stumble across the amazing work of the recently-deceased UMich professor Alfred C. Raphelson⁠, who has written an extensive history of the UMich psychology department. A condensed version was published in 1980⁠, which summarizes his two 1968 histories/​biographies.

These histories reveal all, and explain everything. Raphelson mentions no Young, and Curtis only in passing as one of many grad students working for Shepard over the years; Shepard and the UMich psych department as a whole emerge as the key.

It turns out that Maier’s description is just the tip of an iceberg. The UMich psych department had decades of intensive research into maze-running, setting aside much of its building for it, and constructing elaborate mazes for humans as well. John F. Shepard helped build the department from scratch starting in 1906 (literally, spending many years overseeing the building program, from which he was ousted) to his de facto ouster in the late 1940s, and oversaw generations of grad students, who were in turn overawed by his extensive knowledge, rigorous experimentation, devastating critiques⁠, outspoken communism, and advanced courses where he systematically laid out his (never published) paradigm. The brief 1929 paper was but a hint of the mounds of data that they had compiled in their quest to understand and eliminate “floor cues”.

But almost none of it was published. The UMichers did not interact much with the rest of American psychology, published little (Maier is described by Raphelson as an unusual exception), promoted mostly from within (becoming ‘inbred’), and admiring students would be shocked to invoke Shepard elsewhere & get no reaction. Under the benevolent but distant leadership of department chair Walter B. Pillsbury⁠, faculty were not held to ‘publish or perish’, and the department gradually drifted ever more distant from outsiders.

Eventually, when Pillsbury began retiring in 1941, the university dean decided the department needed to be ‘rebooted’, and passed over the senior Shepard in favor of an outsider, Donald G. Marquis at Yale, who would rectify the problems. Raphelson describes this 1945 reboot as a success, and done as kindly as possible, but it largely ended Shepard’s career, who quietly retired, saying he would finally, at long last, properly write up & publish all his perfected results.

Shepard writes to Boring (yes, Boring again) at this point that his “only real source of anxiety now is the realization that much of my life would be lost if I don’t get my maze results published.” Raphelson notes Shepard fails, and is able to finish only one thing: an article confusingly titled the same thing as the 1929 abstract. He tries to get it published in Psychological Monograph, acknowledging in 1959 that

…frankly, I do not expect many readers to be concerned about this study until after the next monograph is out. However, I think there would be a few: some oldsters who still remember a little about the maze; and a few others curious enough to start reading. Lastly, I do not want you to bother anyone else with the matter. If, after you have read the manuscript, you have any doubts as to the advisability of publishing it, for any reason, please return the manuscript to me. I shall lithoprint it and let the Michigan department distribute it. It would be of use to the department in more than one way.

[journal editor] Norman Munn turned the monograph down since he believed that Shepard’s contribution on the floor cues had been known for a long time and all the details included in the monograph appeared to be anticlimactic.

One notes the irony of quoting on this page an editor rejecting a floor-cues paper for publication because it “had been known for a long time”.

He did indeed lithoprint it. It is not available online as far as I can tell⁠, and a copy is held in just 7 libraries worldwide⁠; Google Scholar erroneously conflates the 1929 & 1959 publications, and excluding citations to the earlier one, it appears to be cited by <5 publications, all on the different topic of ‘spontaneous alternation’⁠, and most of them due to a Robert J. Douglas. The monograph:

  • “An unexpected cue in maze learning”, Shepard1959 (requested⁠; may have to go to the Library of Congress for it)

Another attempted article failed to be published when Shepard withdraw it for unclear reasons. And that was it. Raphelson concludes his Shepard biography thus:

On November 2, 1965, at the age of 84, John F. Shepard died. His last draft of research writings were gathered up and examined by some former students. It was regretfully decided that there was nothing which might be salvaged for publication.

RIP.

Feynman’s description is consistent with having read it in Maier. But he also took a trip at the right time to UMich itself to hear about it, and that is a possible source for his knowledge.

Maier’s textbook was popular enough that Feynman could have read it, or someone in the Cornell psychology department could have read it & described it to him. If Feynman had checked for citations of Curtis1931 while he was at Cornell, then for most of that period (ie. 1945–1950), there would indeed have been zero citations if including Solomon1948 (and we can safely assume that indexing services back then would be long delayed).

However, there is another possible source. In his oral histories⁠, Feynman mentions taking a long trip to the University of Michigan in 1947 for a ‘summer symposium’:

…It [his senior thesis] was rather a useless theorem that nobody referred to. And I realized that it was not only useless but it was obvious. I could have written it in half a line. It was nothing.

Therefore I was quite surprised when, in 1948 or 1949, I went to Michigan—(I mean, a change in the timing, just to tell you, for my own amusement, because I always felt a little bit ashamed of it, on the grounds that it was too trivial and useless, not very interesting.)

At Michigan I was giving some lectures on electrodynamics and Ted Berlin said to me, “What do you think about the controversy about your paper?” I said, “What paper?” He was talking about “Forces and Molecules”, and he told me that there was a big debate as to whether the theorem is true—it’s called the Feynman-Hellman theorem or something like that, because somebody else has published a similar thing—and there’s big excitement about it, they’re arguing whether it’s true, and somebody in Germany said it’s not true because I only included the electrostatic forces, there are also the kinetic forces, and so on—I said, “No, that’s not right.” He said, “I know. We’ve been arguing back and forth. They claim you made two mistakes that cancel, and you were just lucky, and we claim that it’s not that you were lucky but you knew what you were doing.” I said, “Well, I knew what I was doing. It’s correct.” You know? Apparently it had caused interest, and it is interesting to physical chemists.

1947 is before Shepard completed his gradual retirement, while the Marquis era had just begun, so knowledge of the floor cue work would still be reasonably current. 1947 is also still consistent with zero citations to Curtis1931/​Curtis1936.

Further, Feynman’s description is low-key, and it sounds like he was bored. So he could have spent a long time talking to random UMich people, including the psych department, especially if he had been talking to Cornell psych people and so had points of comparison & a working knowledge, and might be interested in observing the still-rather-unique UMich department.

The Shepard research programme, as apparently conducted in part by Curtis, is the source of the Feynman anecdote.

The ‘Mr Young’ was probably Curtis as a grad student, and the work reported in most depth in Curtis1936, and Feynman is off by a year. Feynman is either wrong about the name, confusing it with a much more famous animal psychologist, or there is another Young in a minor role somewhere—perhaps the person who told him about the UMich maze-running. He is correct that it was not cited much, if at all, by subsequent psychology researchers (regardless of when one checks).

Does the Shepard-Curtis work on floor cues bear the weight of Feynman’s use of it as a morality play?

Maybe. Maze-running may not be a huge area, but it’s also not like it went away completely, and mazes continue to be used occasionally—are they vulnerable to floor cues? Presumably yes, because I am not aware of any standard maze construction methods which would inherently obviate floor cues. In this regard, the story works: Shepard-Curtis found something important about constructing mazes, and it simply got ignored, being somehow in a quantum superposition of so trivial & well-known it’s not worth even publishing but also done right by next to no one & this is not considered a problem or even known to the researchers ostensibly producing valuable knowledge.

On the other hand, it may be an embarrassing story about scientific flaws, but different, and more fundamental, flaws, which cannot be fixed by a sprinkling of sand.

The Shepard-Curtis work wasn’t all that obscure, when it was primarily done in the 1920s–1930s. It sat solidly in a tradition of maze-running work going back to Carr & Watson1908 on how rats are surprisingly flexible about how they learn to run a maze, exploiting any side-channel allowed them; this may not have been the most exciting or famous kind of maze-running research, exactly, but you certainly couldn’t call it hidden or suppressed.

The Raphelson histories explain why it fell into such obscurity even by the 1940s: Shepard was a stubborn perfectionist who was enabled to never published or make any real effort to propagate his findings beyond a narrow circle of maze-running psychologists centered on UMich and to a lesser extent, the University of Illinois, and a few old psychology acquaintances like Boring. Further, not long afterwards, the UMich department was ‘rebooted’, and much of the institutional memory of the maze work would have begun to disintegrate. Since hardly any of it had been published beyond difficult-to-obtain gray literature, this was a death knell. Even worse, the reboot was necessary in part because maze-running research had ceased to be the most exciting & fashionable psychology research, and the remarkable achievements like Tryon’s maze-running breeding experiments become history. This is not necessarily because any of it was wrong, or even fully explored (the simple question of ‘what senses does a rat use to run a maze’ still doesn’t appear to have a definitive answer); as Meehl notes, theories in psychology are never refuted—they just fade away. (The reason for Shepard1959 not being published is sadly telling in this regard.)

If it is so hard to recover this research now, then perhaps this historical amnesia is the real problem: that psychology is not cumulative, and that someone can discover “all the things you have to do to discover something about rats” and it doesn’t matter, and just becomes a matter of antiquarian curiosity for someone like me tracking down obscure anecdotes in some physicist’s speech half a century later.

There would seem to be plenty of blame to go around.



from Hacker News https://gwern.net/maze

No comments:

Post a Comment

Note: Only a member of this blog may post a comment.