Alex Tabarrok has a couple of recent posts that discuss the student evaluation of college teaching. One post ended as follows:
Indeed, the correlation between student evaluations and student learning is at best close to zero and at worst negative. Student evaluations measure how well liked the teacher is. Students like to be entertained. Thus, to the extent that they rely on student evaluations, universities are incentivizing teachers to teach in ways that the students like rather than in ways that promote learning.
It’s remarkable that student evaluations haven’t already been lawsuited into oblivion given that student evaluations are both useless and biased.
The final sentence is a good example of what’s wrong with our legal system. To an increasing extent, the courts are outlawing voluntary behavior between consenting adults. Perhaps student evaluation forms are next. I have no opinion either way on the effectiveness of these forms (even after using them for 35 years in my classes.) But I see no logical reason to outlaw consumer feedback in the education industry, while allowing consumer feedback in other industries.
While many of my former colleagues would agree with Tabarrok’s argument, I worry that too many educators miss the bigger picture. We’d like to believe that education is about learning, but in fact it’s ultimately about utility. Learning is just a means to an end, and not the most important role of our educational system.
Bryan Caplan has persuasively shown that much of what we teach our students has little practical value. Students are forced to learn an enormous amount of irrelevant trivia, and quickly forget what they cram into their minds before exams.
College can boost utility in two ways. First, students can learn things that make them more productive. That increased productivity can then lead to higher incomes, which boosts utility. Second, colleges can directly provide utility through entertaining classes, sports, parties, etc. In my view, this second type of utility augmentation is much more effective. I wish it were not so, but that’s my impression after 35 years of teaching.
If we start putting more weight on learning and less weight on student evaluations, then there’s a danger that our educational system will begin to resemble some of the more dysfunctional regimes in East Asia, where students lose the best years of their lives endlessly cramming for exams with information that will be of little value to them in their later life, in a zero sum game of trying to be more successful than their classmates.
READER COMMENTS
Garrett
Sep 10 2019 at 12:36pm
That seems to be what a lot of people want, with the constant comparisons to Singapore, Hong Kong, Japan, etc.
Scott Sumner
Sep 10 2019 at 9:17pm
Yes, I am seeing disturbing signs that we are moving in that direction. My daughter’s high school had much more homework than mine did (in the early 1970s)—too much in my view.
Lorenzo from Oz
Sep 11 2019 at 7:12pm
Homework is not about learning, it is about signalling to parents that their students are learning. There is an obvious danger of an upward spiral in such signalling …
nobody.really
Sep 10 2019 at 3:27pm
“Democratic education, says Aristotle, ought to mean, not the education which democrats like, but the education that will preserve democracy….” C.S. Lewis, from “Notes on the Way,” published in the English literary magazine Time and Tide, vol. XXIV, at 717 (September 4, 1943).
Was Tabarrok perhaps exaggerating for effect? Last I checked, the US legal system no longer criminalized gay sex, is rapidly decriminalizing marijuana, is removing most legal sanctions for gender-nonconformity, and thanks to the internet, barely regulates prostitution. In 2017, Kentucky became the 27th state to adopt (and retain) a right-to-work law. Can anyone think of an era when voluntary behavior between consenting adults was LESS regulated than today?
Adam Smith opposed putting teachers on a payroll, arguing that doing so would create a principle/agent problem: The teacher would not have proper incentive to educate the student.
Yet Smith recognized that education provided a social benefit (specifically, against the evil of religiously derived superstition). So, what remedy? The famously laissez-faire Smith advocated … licensure! That is, recommended that many public roles/offices require people to pass a relevant test. Students would then have an incentive to do whatever it took to pass the test—including hiring people who had a reputation for helping people in that endeavor.
Sounds like the bar exam.
Nobel Laureate Richard Feynman realized that his students could perform well on physics tests—cranking through problems and calculating answers—but didn’t internalize that the answers they gave were supposed to correlate with the world of their own experience. They could tell you how much a given fluid would deflect light, but didn’t associate this with the fact that a pencil would appear to bend when it stuck out of a glass of water.
Harvard prof Eric Mazur reached the same conclusion. But he also learned that students would better internalize material through a process of peer instruction—basically, small-group discussion. The downside? This process takes longer than simple lecturing, so the class covers less material. And in the final analysis, teachers are evaluated not based on much education occurs, but how much teaching occurs—that is, how much material the professor could claim to have “covered,” regardless of whether any students actually benefits from the coverage.
In short, the system rewards the credential of education—going through the motions—rather than getting more people to understand more stuff. And because high-performing students (just as the professors themselves) perform well on tests regardless of the uselessness of lectures, the current system of going-through-the-motions perpetuates itself.
Scott Sumner
Sep 10 2019 at 9:16pm
Good points.
Mark Brady
Sep 10 2019 at 6:25pm
“The proper goal of education is utility, not learning.”
Talking of a “proper goal” suggests that the author thinks that this is what education, or, more accurately, schooling should be doing. Yet I’m not clear that this is what Scott thinks schools and colleges should be doing.
For example, Scott writes, “Second, colleges can directly provide utility through entertaining classes, sports, parties, etc. In my view, this second type of utility augmentation is much more effective. I wish it were not so, but that’s my impression after 35 years of teaching.”
“We’d like to believe that education is about learning, but in fact it’s ultimately about utility. Learning is just a means to an end, and not the most important role of our educational system.”
But is “utility” the right word to use, especially in an economics blog? I suggest that “usefulness” or “serviceableness” would work better.
Scott Sumner
Sep 10 2019 at 9:15pm
Yes, utility is the right word for an economics blog. Schools should provide utility in two ways:
Directly, via an enjoyable or deeply meaningful educational experience.
Indirectly, by providing skills that allow people to achieve future goals that provide utility.
Michael Sandifer
Sep 11 2019 at 4:34pm
Scott,
My impression is that Tabarrok meant that he’s surprised the use of student evaluations of professors for the purpose of determining career advancement hasn’t been stopped by lawsuits. Employers who use irrelevant metrics to make hiring, firing, and promotion decisions leave themselves more vulnerable to claims of illegal discrimination, for example.
It’s tempting to assume colleges and universities have strong HR oversight to prevent obvious vulnerabilities, but they get sued too.
Scott Sumner
Sep 11 2019 at 7:47pm
Yes, I agree that’s what he meant.
Tom DeMeo
Sep 11 2019 at 5:21pm
Maybe we can eventually wake up to the notion that the educational learning is a form of exercise and exploration. Most of what is acquired fades long before it gets used, and what is left are the remnant experiences that introduce us to wider ideas and let us find out what we can and cannot do well. We work out our intellectual and disciplinary muscles.
Mostly, we explore, practice working and learning and transition into adults. The sharpness of the immediate learning isn’t really that important.
I know Caplan doesn’t buy the “we’re just learning to learn” explanation, but I think he’s wrong.
nobody.really
Sep 11 2019 at 6:25pm
Hm–good thought.
Mark Z
Sep 11 2019 at 9:05pm
Is there any empirical evidence that higher education makes people better at learning? To me this sounds suspiciously like a retreat into an unfalsifiable hypothesis.
Tom DeMeo
Sep 12 2019 at 9:15am
Empirical evidence is unavailable for about 99.9% of what you think about and act on concerning human behavior. It would be nice, but we are human beings, not lab rats. I’m sure there are any number of ambiguous, possibly dubious studies that can argue either conclusion here.
If we pulled your call for “empirical evidence” apart, we probably would strongly disagree what to even measure. Passing a test? Depth of mastery? Speed? Underlying core ideas? Judgement? Identification of skill set? Task competence?
I would be happy to grant you that we will likely come to the conclusion over the next couple of decades that higher ed as we understand it now is absurdly inefficient.
My point wasn’t to defend higher ed as a vehicle of learning development. It was to point out that when young human beings are learning something they aren’t about to engage in, the specific topic at hand and the degree of mastery is just an exercise, not an end unto itself.
A football player works out a lot. They might do hundreds of 40 yard dashes. Competing at this helps. Running a 4.5 indicates a particular form of speed. It doesn’t empirically prove they are a good cornerback, but it sure helps and still is probably worth the effort to work at if you want to play cornerback. If a player stops working out, after a period of time they are no longer excellent at that position. So what are your conclusions about how to develop as a football player? Is running sprints worth it?
I don’t think it is all that controversial to suggest that exploration, exercise and practice works, but that its effects will fade without continued rigor.
Bob Murphy
Sep 11 2019 at 11:04pm
Scott Sumner wrote:
(Bold added by me.)
Scott, why do you wish it were not so? The only way I can make sense of that phrase is if we both agree that the proper goal of education is learning, not utility–thus contradicting the title of your post.
Scott Sumner
Sep 12 2019 at 9:46am
I meant that I wish college education made workers much more productive. Sadly, that doesn’t seem to be the case.
Comments are closed.