Campbell's Law

During a C-Span broadcast of a discussion of Charles J. Wheelan's Naked Statistics: Stripping the Dread from the Data (2013), a member of the audience - a statistician - asked Wheelan if he knew about Campbell's Law. I turned to Wikipedia, of course, and found the following entry (see http://en.wikipedia.org/wiki/Campbell's_law):

Campbell's law is an adage developed by Donald T. Campbell:^[1]

"The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor."

The social science principle of Campbell's law is sometimes used to point out the negative consequences of high-stakes testing in U.S. classrooms.

What Campbell also states in this principle is that "achievement tests may well be valuable indicators of general school achievement under conditions of normal teaching aimed at general competence. But when test scores become the goal of the teaching process, they both lose their value as indicators of educational status and distort the educational process in undesirable ways. (Similar biases of course surround the use of objective tests in courses or as entrance examinations.)"^[1]

Campbell's law was published in 1976 by Donald T. Campbell, an experimental social science researcher and the author of many works on research methodology. Closely related ideas are known under different names, e.g. Goodhart's law, and the Lucas critique. Another concept related to Campbell's law emerged in 2006 when UK researchers Rebecca Boden and Debbie Epstein published an analysis of evidence-based policy, a practice espoused by Prime Minister Tony Blair. In the paper, Boden and Epstein described how a government that tries to base its policy on evidence can actually end up producing corrupted data because it, "seeks to capture and control the knowledge producing processes to the point where this type of ‘research’ might best be described as ‘policy-based evidence’."^[2] (Boden and Epstein 2006: 226)

&&&

Would Lon L. Fulller's students have given him high marks on teaching evaluation forms? I doubt it. I vividly remember hearing my fellow law students complain that Fuller just created confusion in the classroom.

What would or should Fuller have done to raise his teaching evaluation scores (if he cared about them)? I suppose he would have simplified the parable of the Speluncean Explorers and he would given a multiple-choice exam in the jurisprudence course he taught.

&&&


&&&

The dynamic evidence page

Evidence marshaling software MarshalPlan