As a human capital explanation, the “learning professional norms” hypothesis also suffers from many of the issues of the “learning academic knowledge” hypothesis—e.g. the sheepskin effect.
I think you are underselling the 'norm' theory here. I would say that it explains the sheepskin effect better than an appeal to either 'Conscientiousness' or 'conformity', because 'finishing things you start' is a professional norm much more than it is an outcome of Conscientiousness or is mere 'conformity', and inherently has a sharp kink - you either finish or you don't, it's defined that way.
People who are 'flaky' are unprofessional... but they aren't necessarily lazy. They may, in fact, be some of the hardest working and productive people you know. When I think of some people who have to be described under the label 'flaky' or 'hobbyist', I would say their problem is not that they lack energy or don't spend enough time working or do not sweat the details enough or are not careful or not diligent; they may have all of these, perhaps to an obsessive degree. What they lack is that they don't finish things. They do the first 90% and then not the last 10%. (They did, however, do 90% of the work.) A professional finishes things. They don't quit halfway. They don't get distracted by a new project which they work even harder on than the original thing. You can rely on and work with a professional. You can't with a flake, no matter how gifted and hardworking.
Mere 'conformity' also doesn't explain too much here, because conformity to what? The statistical norm? Lots of people drop out of college (many people never get their degree or finish years overdue or much later in life or settle for a lower degree), or do things which are not good ideas. Even if we discovered that the majority of college students flaked out and that was now median outcome, we would hardly stop seeing a sheepskin effect! Because the norm would still be 'adults finish what they start and can be relied upon', and getting your degree shows you are now above-median in conforming to that norm.
I would say that it explains the sheepskin effect better than an appeal to either 'Conscientiousness' or 'conformity', because 'finishing things you start' is a professional norm
This feels a bit post-hoc. "Not flaking on things" is indeed a professional norm. But businesses cancel projects that aren't working out all the time. And, equally, if you've gained the benefits of a project ahead of schedule, then I don't see a strong professional norm saying that you need to drag on the project for the originally-allotted amount of time. Neither of these are typically interpreted as flaking.
So in some sense you're just pushing back the question: why should employers interpret leaving college early as "flaking" rather than "I got what I came for (e.g. a job) and now I'm rationally reprioritizing"? Do they feel like the student has cheated the college in some way? If so, why?
Mere 'conformity' also doesn't explain too much here
Yes, I agree; I think we need a more sophisticated sociological concept of what we're vaguely gesturing at by using the term "conformity". To give a preview of my follow-up post: I think the best explanation for the sheepskin effect is that group membership is often fairly discrete. Many societies (and many institutions) have initiation rituals which sharply demarcate insiders from outsiders (e.g. citizens vs non-citizens, adults vs non-adults). And so if you think of college graduates as a group which is assigned special privileges within society, then you want to enforce a sharp boundary in order to make norm enforcement more tractable.
This feels a bit post-hoc.
Everything in this post is post hoc and discussing things you already knew, since you did not make any predictions and go collect new data to test them, so I can't help you there.
But businesses cancel projects that aren't working out all the time.
Yes, businesses cancel projects - through proper channels like executives and managers (ie. not the sort of employee fresh out of college, or non-college as it may be).
So in some sense you're just pushing back the question: why should employers interpret leaving college early as "flaking" rather than "I got what I came for (e.g. a job) and now I'm rationally reprioritizing"?
Because dropouts usually haven't gotten what they came for? They are applying for a job some time afterwards. People who are hired out of college, or who are, say, startup founders who took a leave of absence and never came back, would be regarded differently if decision-makers are given sufficient individuating information and compute to appropriately condition on. (And to the extent there is any uncertainty, there will be residual confounding.)
And so if you think of college graduates as a group which is assigned special privileges within society, then you want to enforce a sharp boundary in order to make norm enforcement more tractable.
Yes, no one is surprised if, say, doctors or lawyers are a bit sharp-elbowed about who has a MD or JD. But at least from this description, it seems like you're going to have a lot of problems because when you compare "the college degree" to a clear case like those, it's a really terrible, vague, poorly-enforced norm/identity!
Because dropouts usually haven't gotten what they came for?
Good point. I think I was implicitly thinking about the kind of dropouts in my social circles, but of course the sheepskin effect is primarily about more "normal" dropouts.
I think you are underselling the 'norm' theory here
Re your original point, though: when I said that the sheepskin effect weighs against the "learning professional norms" hypothesis, I specifically meant the learning professional norms (as human capital) hypothesis. This is distinct from the signaling professionalism hypothesis.
The former predicts that employers should favor students based on how much they've learned about professional norms (which shouldn't have any sharp discontinuities as a function of time spent at college). The latter predicts that employers should favor students who signal professionalism through things like graduating. (Of course you could have a combination of the two, but then it'd still only be the latter that contributes to the sheepskin effect.)
With most of your posts I already agree with the conclusion, I disagree and am still not convinced after reading the post, or the topic seems really confusing and after reading your post the topic seems more confusing than before. With this post I thought I had a good explanation, but now I see it wasn't adequate. When I saw the title of this post I was thinking this was going to be interesting. This post genuinely changed my mind.
Thank you! Out of interest (just to calibrate myself) any posts that you'd point to as particularly confusing?
I was especially thinking of your recent post "on goal models". I tried to look up other posts, then I just saw your post on distributed agents and then this clicked and I feel like I better understand now where you are going with this. I find distributed agents and how to think about them confusing.
A key problem with Caplan’s trinity is that most of it is easily replaceable. Getting good grades at college does signal intelligence and conscientiousness, but these could be signaled far more easily and cheaply. It’s very easy to signal intelligence via test scores: IQ is surprisingly predictive of many other desirable cognitive traits. This need not require literal IQ tests—standardized tests like the SAT or GRE are highly correlated with intelligence.
Good luck not getting a disparate impact suit if you try this. You have to prove that the test that you're using is necessary for the job. College is basically always considered necessary. The coding interviews you mention are obviously necessary. Trying to use an IQ-like test or even the SAT (unless you're a college) will get you in court.
college grades are far from the best way to signal intelligence; what he doesn’t discuss is that they’re even further from the best way to signal conscientiousness ... an even better signal of conscientiousness would be acquiring all the same knowledge without attending college at all
Acquiring the knowledge without the college structure would be a more accurate signal of conscientiousness, but it would be a less legible one. Evaluating potential employees involves sifting through a large number of applicants of mostly dubious quality, and unless you have reason to pay special attention to one of them, if a signal isn't obvious, it probably gets rounded off to zero.
A degree from Stanvard Institute of Technology gets an employer to treat your resume as worth reading (and not just skimming). Claiming (with evidence that require crossing a non-trivial inferential distance) to have gotten the same education for $1.50 in late fees at the library doesn't. You get about 5 words.
Asking "Why do companies care about higher education?" predisposes that companies are the agent under concern. Decisions about hiring decisions are however made by humans, managers and HR personal. Managers that have a college degree have a strong incentive to steer their company into valuing college degrees. Managers who went to Ivy league universities have a strong incentive to steer company policy into rewarding people with Ivy league degrees.
I'm not sure I understand how you imagine the proposed testing service for intelligence + conscientiousness. Would this test replicate all the exams and thesis-writing of the four-yours college course? If so, as you argue, most people would have hard time being motivated to study for this very long and hard test without the structure of something like a college. Or is the test shorter and easier than the current exam-suit, but still provides equally strong signal, because people study for it with one year of self-study instead of four years of structured college? But then why don't people still just do something like college to get the motivating structure? It seems pretty hard to me to set up this testing service right.
In general, I'm not sure there are much cheaper ways to legibly signal "this person is able and willing to sit around and do intellectual work for years" than to have the person actually sit around somewhere where their mistakes and potential quitting is low-stakes, and have them do some kind of intellectual work. I.e. college.
Very likely the current college format is not the exact optimal way to provide this signal, but I find it plausible that it's not that far off from the optimum that standard coordination difficulties and Inadequate equilibria dynamics can explain why it stays in place.
If so, as you argue, most people would have hard time being motivated to study for this very long and hard test without the structure of something like a college.
Yes, that's right. And so what we'd see if the signaling theory were true is people doing as little college as possible. E.g. you can imagine an externally-administered test (or even just a company interview, like a big tech coding interview) that you sit whenever you feel like you've learned a college degree's worth of material. As an employer, if I see someone who passes this test without any college attendance, I'd be very impressed by their conscientiousness and intelligence. If I see someone who spends two years at college then takes the test, I'd still be impressed. If they spend four years at college then pass the test, then eh, I'm less impressed (but it's still a better signal than not having passed at all).
In a rational world, the kid who self-taught himself CS in high school then passed a google interview should be much more impressive than the kid who got into Harvard then spent four years studying CS under the best professors in the world then passed the google interview. But somehow the prestige hierarchy is inverted; that's what we need to explain.
In general, I'm not sure there are much cheaper ways to legibly signal "this person is able and willing to sit around and do intellectual work for years"
From an employer's perspective, the "years" thing is a distraction; what matters is productivity. If I can spend one month and do the same work that takes you years, then employers should very much want to hire me.
I still think it will be hard to get credible evidence that someone didn't attend something like college.
As a parallel: Employers value people who got medals at the IMO. Preparing for the IMO doesn't teach any useful job skills or cultural fit (though maybe it teaches some conscientiousness). So I'm pretty sure that preference for IMO medalists is mostly explained by intelligence+conscientiousness signaling.
It is more impressive to be an IMO silver medalist if one is from Denmark with very little IMO preparation culture than if someone is from Hungary that has specialized schools and extracurricular math training camps. Even within a country, it is more impressive if someone got an IMO silver from a random small-town high school than if they attended the best specialized school in the country. And it's more impressive if someone didn't attend the extracurricular math camps than if they did.
But I never heard of any employer screening for any of this. I assume some employers have some heuristic that getting a silver from Africa is more impressive, but I don't think it's more fine-grained than that. I never heard of anyone mentioning the Denmark vs Hungary heuristic, or to give extra scores for coming from a small town. I think it's pretty hard to have legible metrics for all these disadvantages, so HR just doesn't take them into account.
And I definitely never heard of any student following the galaxy-brained plan of intentionally not enrolling in the best high school, not attending any of the math camps and after-class seminars, meticulously document all of this, and then presenting evidence to future employers that they got an IMO silver while intentionally handicapping their own study.
I expect that your scheme of students demonstrating that they passed the test without doing something like college fails for the same reason - it's hard to legibly demonstrate that one didn't do something like college or other structured prepping.
The one credible signal I see is age: if someone passes the big final exam at 19, while everyone else only at 22, that's legibly more impressive. (Indeed, in the parallel, getting an IMO silver in 10th grade is more prestigious than getting one in 12th grade.)
I think there could be some economic value in setting up the possibility of doing the college final exams at a younger age, but I think the result would be pretty dystopian cram schools during childhood. My guess is that in the West not very many people would take the opportunity to take the test early and then start working at 19, it doesn't sound very appealing.
I wonder though why it's not more common in East Asia to just immediately hire people at 18; I don't know how much additional signal college provides once people demonstrated they can sit through years of cram school and get a high score on their admission exam. But I know very little about East Asia.
This post seems to implicitly assume a monocausal explanation. It gives good reasons why various proposed explanations are not sufficient to explain university attendance and dismisses those explanations because they aren't sufficient. The reality is more likely a complex mix of different reasons, and the right question isn't which one is the reason; it's how much of the reason is each proposed explanation.
The Sheepskin Effect makes it pretty clear that a significant portion of the value is signaling (Wikipedia cites Caplan as claiming that "over 60% of the economic benefit" is from the degree, though it's hard to disentangle signaling effects from selection effects). Failure to complete an almost-completed degree seems more likely to be a failure of conscientiousness than of intelligence or conformity, so that part is probably mainly conscientiousness signaling.
Caplan's book has all kinds of flaws, one of which is that he talks about how "it's almost all signalling" throughout the book. But when he actually does the math, he conflates it with ability bias, which grossly inflates his signalling estimates (from 8-35% to 33%-80%).
I also think Caplan is wrong on the conformity point and he offers virtually no evidence for it - at least in his book. As far as I recall, he only points to employers not taking online credentials seriously, but that can be equally explained by employers valuing conscientiousness (online credentials are easier to get) and still don't really understand online credentials that well.
Three theories of higher education
Getting an undergraduate degree is very costly. In America, the direct financial cost of attending a private university is typically in the hundreds of thousands of dollars. Even when tuition is cheap (or covered by scholarships), forgoing three to four years of salary and career progression is a large opportunity cost. There are a variety of reasons why students are willing to pay these costs, but the key one is that desirable employers highly value college degrees.
Why? The standard economic answer is that college classes teach skills which are relevant for doing jobs well: the “human capital” theory. But even a cursory comparison of college curricula to the actual jobs college graduates are hired for makes this idea seem suspicious. And private tutoring is so vastly more effective than classes that it’s very inefficient to learn primarily via the latter (especially now that many university courses are more expensive than even 1:1 tutoring, let alone AI tutoring).
Another answer is that attending college can be valuable for the sake of signaling desirable traits to employers. An early version of this model comes from Spence; more recently, Bryan Caplan has argued that most of the wage premium from going to college comes from signaling. In this post I’ll be engaging with Caplan’s version of the signaling hypothesis, as laid out in his book The Case Against Education.
Your university degree signals many things about your underlying characteristics, but Caplan claims that there are three traits employers prioritize above all others: “the trinity of intelligence, conscientiousness, and conformity”. This hypothesis purports to explain a number of important gaps in the human capital theory—e.g. why college students so quickly forget so much of the material covered in their courses after passing exams, why the rise of free online courses hasn’t changed the college landscape very much, and why finishing 90% of a degree is far less than 90% as valuable as completing the whole thing.
However, I think Caplan’s signaling theory is also wrong. In particular, his concept of conformity can’t be understood in standard economic terms. Instead, I’ll argue that we need a sociological explanation centered around group membership and group norms—which I’ll try to flesh out in a follow-up post. First, though, let’s engage with Caplan’s position, starting with the other two aspects of his trinity.
College attendance isn’t explained by intelligence or conscientiousness signaling
A key problem with Caplan’s trinity is that most of it is easily replaceable. Getting good grades at college does signal intelligence and conscientiousness, but these could be signaled far more easily and cheaply. It’s very easy to signal intelligence via test scores: IQ is surprisingly predictive of many other desirable cognitive traits. This need not require literal IQ tests—standardized tests like the SAT or GRE are highly correlated with intelligence. In other cases, companies use IQ-like tests (e.g. tech companies’ coding interviews). These are also significantly harder to cheat on than college courses.
Caplan acknowledges that college grades are far from the best way to signal intelligence; what he doesn’t discuss is that they’re even further from the best way to signal conscientiousness. If you asked people why they don’t just learn college material independently without paying for college, I expect that a common response would simply be “oh, I don’t have the discipline for that”. College provides external frameworks, timetables, local incentives, and social pressure for people who aren’t conscientious enough to learn without that.
So although doing well at college signals more conscientiousness than lazing about, an even better signal of conscientiousness would be acquiring all the same knowledge without attending college at all! In fact, people who are capable of learning college-level material independently should be going out of their way to avoid college lest they be confused for those who can only do it within a motivating social structure. Again, this hinges on the existence of high-quality testing services—but if conscientiousness signaling drove a significant proportion of the value of a college diploma, then providing such testing would be very profitable.
I’ll digress briefly to clarify a point that sometimes confuses people (including my past self). It’s common to talk about “costly signaling”, which involves incurring costs that would be prohibitive for people who don’t possess desirable traits. But costly signaling is just one type of “credible signaling”, aka signaling that is difficult to fake. Other types of credible signaling need not be expensive—IQ tests are an example of a very cheap but very credible signal.
By basic economic logic, people should prefer to do credible signaling in cheaper rather than more expensive ways. So any explanation of behavior in terms of costly signalling needs to explain why the system doesn’t gradually shift towards using cheaper credible signals. In Caplan’s account, that’s where the “conformity” part plays a big role.
I’ll explore in more detail what his account of conformity signaling is in the next section, and why I don’t think it succeeds. But I first want to note that the arguments above should already update our view of Caplan’s theory. If I’m right about how replaceable the functions of intelligence and conscientiousness signaling are in justifying college degrees, then even calling it a “signaling theory” of education is misleading. Instead what Caplan is defending is more accurately summarized as the “conformity signaling theory” of education, because that’s the part that’s justifying almost all of the cost of college compared with other possible signaling strategies. Analogously: if product A costs $10 and lets you do tasks X and Y, and product B costs $100 and lets you do tasks X, Y, and Z, then a good explanation for why “rational” people keep buying B needs to focus on the value of doing Z.
Of course, it’s hard enough to write a book about how college is for signaling; describing college attendance as being driven by conformity would be even more controversial. I don’t want to criticize Caplan too harshly for this omission, since he’s been more honest than almost any other academic about the ways in which higher education is a waste of time and money. And I don’t think he’s being deliberately deceptive. But my guess is that he flinched away from summarizing his theory as the “conformity signaling theory” of education because it would have received even more pushback than his “signaling theory”. I wish he hadn’t, though, because trying to pin down what conformity signaling is, and why employers purportedly value it, makes the holes in this theory clear.
College attendance isn’t explained by conformity signaling
Conformity signaling is more complicated than intelligence or conscientiousness signaling. Caplan spends half a dozen pages explaining it in the first chapter of The Case Against Education. I’ll describe his position in my own words here, starting with a quick note on what he doesn’t mean. Firstly, he doesn’t mean that students are signaling a general tendency to conform:
For now I’ll call this trait “conformity to professional norms”. You might then think that employers want to hire college graduates because they’ve learned professional norms during their degrees. But this would be a human capital explanation, whereas Caplan is clear that he’s focusing on a signaling explanation.[1] So we can reconstruct Caplan’s signaling theory as instead claiming:
So far, this is a standard signaling explanation. We can debate how strong the correlation is between successful university attendance and workplace professionalism—I can see arguments in either direction. However, even if the former is a very good signal of the latter, there’s a more pressing issue: attending university is very costly compared with references or work trials or almost any other method of signaling professionalism. So Caplan needs to be able to explain why far cheaper methods of credibly signaling conformity to professional norms don’t develop.
This where his theory of conformity signaling becomes disanalogous to intelligence or conscientiousness signaling, by adding a third claim:
Because of this, Caplan argues that university degrees are now “locked in” as the key signal of conformity. Anyone who tries to signal conformity to professional norms in other ways is outing themselves as weird and nonconformist, making their new signal self-defeating.
It’s a clever move from Caplan, but ultimately I think it’s conceptually confused. The core issue is that, even if “professionalism” requires some amount of “conformity”, they’re still distinct concepts. There are plenty of ways that rational employers should want their employees to be nonconformist—e.g. spotting new market opportunities before others do. There are also plenty of ways in which college students don’t mind signaling nonconformity with the business world: their avant-garde politics, their idiosyncratic hair and clothes, and often their nontraditional majors. If students were really spending years of their lives and hundreds of thousands of dollars primarily to signal conformity, shouldn’t they be picking much lower-hanging fruit first?
Indeed, there’s something suspicious about Caplan’s use of the term “conformity” at all. Why not just say that employers are looking for professionalism, and students are trying to signal professionalism? Adding the word “conform” is a verbal trick which proves too much: by Caplan’s logic any example of a person signaling that they follow norm X could be redescribed as “signaling conformity to norm X”, and then used to explain why they’re “locked in” to irrational behavior.
Finally, as Hanson notes: even if the idea of lock-in explains why a practice continues, it can’t explain why it started. In the past, only a small percentage of the population attended college, and it was perfectly normal to get a prestigious job without a college degree. What drove the rise of college in the first place? Whatever it was, that seems like it should be our default hypothesis for what’s driving the college wage premium today.
Explaining college requires sociological theories
To be clear, I do think there’s something important going on related to conformity. It just can’t be captured as part of a signaling framework—or any other economic framework—for at least two reasons.
Firstly, signaling is a framework under which rational agents pay costs to demonstrate pre-existing traits. But conforming is best understood as a process of internalizing deference to other people, i.e. making oneself less rational. Conformists can’t turn their conformity off when it might profit them—think of how many people decided not to invest in bitcoin, or scoffed at the possibility of rapid AI progress, because it sounded weird. They even internalize conformity on an emotional level—e.g. they often get angry at nonconformists (something which I expect Caplan has experienced many times). This is hard to model in economic terms.
A second problem with the idea of students signaling to employers is that employers are also better modeled as conforming rather than making rational choices. For example, Caplan claims that students don’t signal intelligence using standardized test scores because “putting high scores on your resume suggests you’re smart but socially inept. You’re doing something that’s 'simply not done.'” But firms could easily request standardized test scores from all applicants, alleviating each student’s fear of standing out.
More generally, when Caplan lists the traits that he thinks employers want, surprisingly few of them are directly related to employee productivity:
Traits like employees’ appearances, political correctness, and ability to intuit social norms don't help much with the object-level work involved in most jobs. What they are relevant for is managing the company’s image—whether in the eyes of other employees, potential customers, or even government regulators. But even if this makes sense in isolation, we’ve now hypothesized a labor “market” in which everyone is nervously looking around at everyone else to try to avoid appearing weird. This is no longer an economic equilibrium in any reasonable sense. Instead, it’s a social equilibrium—albeit one with major economic implications—and we’ll need new concepts to model it.
In a follow-up post I’ll discuss some sociological theories of college attendance—most notably Bourdieu’s theory of higher education as a consecration of cultural elites. Unfortunately such theories have not been specified very rigorously. So I’ll also attempt to bridge the gap between economics and sociology by describing the formation of an elite class in game-theoretic terms.
As a human capital explanation, the “learning professional norms” hypothesis also suffers from many of the issues of the “learning academic knowledge” hypothesis—e.g. the sheepskin effect. Additionally, there’s the question of who students are learning professional norms from. Academics are notoriously unbusinesslike in many ways; and if it’s other students, that raises the question of why the already-professional students they’re learning from don’t just go straight into the workforce.