You seem to be using the word "principles" when you mean "principals" at a few points in this post.
This is fascinating in various ways.
First, how USA already had the correct way to teach reading... then switched to the incorrect one... and now is slowly switching back. It's nice that people can update towards doing the right thing, but also weird that it took so much time.
Second, yeah, curriculum matters, sometimes more than teachers and money. Well, you need some minimum intelligent teachers, and some minimum budget to hire them, but beyond that, it's what they do that is important. And textbooks scale better than humans. Which suggests that maybe even better textbooks could improve education even more... assuming that someone will actually use them.
Which is the third fascinating thing, how teachers sometimes just refuse to do the right thing. When you give them the phonics textbooks, you still have to check whether they are actually using them. This is not specific for phonics or USA. (Or even education -- many software companies proudly announce that they use Agile or Scrum, and when you get hired, you typically find out that they do neither, but instead do the classical "deadlines and micromanagement" approach, only renaming the deadlines to sprints, and the managers to scrum masters.) Seems like teachers (and people in general) are ready to adopt the right keywords without changing anything about what they actually do. You really need to check whether people saying that they do X are actually doing X -- and then of course people will accuse you of making the "true X has never been tried" excuse.
One could ask, what about fancy private schools? Again, do they win by providing better educations, or by playing social games that attract wealthy and high-status students?
Absolutely. Taught at a private school, can confirm. You can easily fake good education by grade inflation. Plus you tell teachers to give students lots of printed materials (that the students often throw away without reading) so that the parents are impressed about teachers walking the extra mile every day. Then you focus on the things that actually impress the parents, such as fancy school uniforms, or the golf course in the schoolyard.
How would a parent get the schools to care about the right things for real?
I think that about 2/3 parents do not actually care, so the 1/3 who care would need to go against the wishes of the remaining parents, or choose a different school.
One answer that comes to my mind is standardized testing, with publishing results for all schools. The problem is that this only compares the output, while what we want to maximize is the delta. (Schools can easily increase the output by selective admissions, and getting rid of the worst students.)
With some social engineering I could imagine the following -- first, independent testing sorts students into various categories (such as gifted, average, dyslectic, etc.). Then each school declares what kind of students they want to admit. Then the students from given category are randomly assigned to them; or they simply choose, and the school can't reject them, and if too many choose the same school it is decided by a lottery. Then, we could compare schools in the same category against each other, by testing their students. (So the schools couldn't be like "oh, that's just because we admit students with problems", because they would be compared with other schools that do the same thing.)
Reading is the most fundamental thing in education. If you can read, you can do and learn everything else. If you can’t read, well, you’re screwed.
We know how to teach reading to children. Phonics. The weird thing is we often choose to not do that, and instead to use methods that are known not to work. Principles often want to not do phonics. Teachers often heavily resist phonics. But yes, you can absolutely overcome this, as Mississippi and other Southern states have done, by insisting upon it and actually enforcing that insistence. You see huge gains.
Not all those gains persist into later grades, but a lot of the gains do persist.
No, that won’t get the children invested in reading lots of books on their own time. But given their alternatives and what we inflict on them, can you blame ‘em?
Table of Contents
Mississippi Can Read Now
The surge in reading is bigger than it looks. Illiteracy has been proven a policy choice, and all the extra money we spend on other things has proven wasted.
It’s not that they’ve become a normal state, it’s that they’re wildly outperforming now.
What Mississippi and Louisiana Did
Again, what did they do to achieve this? It’s not as simple as ‘phonics’ but the full playbook wasn’t complicated.
PBS looked into what they did and reached similar conclusions.
I note that such investments do not need to involve on net spending a lot more money.
Some of this does involve extra time and money spent. A lot of it doesn’t. A lot of this is as simple as requiring replacement of curricula with ‘high-quality’ curricula. When you see failure cases, like how Karen Vaites describes Wisconsin, they reliably involve not ‘we cut the funding’ but rather ‘we used three-cueing or otherwise not phonics.’
I’d consider retention in third grade a fourth pillar. Essentially the playbook is:
That’s it. I realize, again, easier said than done, this requires a bunch of political will and also funding, so for example California’s approach of saying hey approve of phonics and expecting the rest to magically happen won’t work.
The actual implementation seems like a solved problem now, we simply copy it? And how hard is it to at least insist that everyone use this very clearly superior technique?
Spies In Every Classroom
People like to make life a little tougher than it is.
Oh, come on. You already have ‘spies in every classroom,’ they are called the students. It is trivial to pick a random student periodically, ask them what teaching methods are being used, and if it isn’t phonics you deal with it. You think teachers can just ‘go rogue’ and use an entirely different curriculum and you won’t know? In many schools we already dictate the lessons on a per-day basis in minute detail, and that is not obviously a good idea but you can very obviously do it if you want to.
Similarly, New York has support for this from the teachers’ union, and the principles are throwing a fit, but yeah you just do it anyway and if the principles don’t like it they can quit and if they refuse you can presumably demote or fire them.
So again, no it’s not quite this switch…
…but it’s close.
Mississippi Results Are Not Due To Retention
A viral article from Wainer, Grabovsky and Robinson argued that the results are mostly the result of the third-grade retention policy. The frame presented is ‘this is an education miracle, and almost all education miracles are selection effects or worse.’
There’s a remarkable arrogance here, a continuous assertion that all of this is obvious and overdetermined, similar to that of Michael Green’s viral claims about poverty, talking about those who fell for the whole thing as ‘duped.’
In both cases, we not only then see factual errors, we see entirely invalid methodology.
Here we go.
Last place among states versus 16th is a rather extreme factual error, although that particular error is irrelevant to results in reading.
More to the point, if you look at the percentiles, Piper notes, ‘we cut off the bottom decile’ is clearly not what is primarily happening:
Plus the timing doesn’t work, again see the graph, also retention declined from 9.6% to 7.2% from 2018-2022:
And the average age in the 4th grade did not substantially increase:
At which point, if the retention policy is the secret sauce, good, let’s copy that policy.
It’s not crazy to think that retention could be doing a lot of the work, via the additional mechanism of providing strong incentives to everyone involved.
Is Retention Helpful In General?
Does holding marginal students back help them or harm them?
One has to think on the margin. The correct amount of retention is obviously not zero.
Note that these students are in deep trouble either way, as the average for age 26 people in Texas is on the order of $45,000.
I note, before examining the paper, my willingness to defy the data. There is simply no way that holding a struggling student back for one year reduces earnings by 19% at age 26. That’s way too big an effect. It would be one of the biggest effects in the history of education.
This is only significant at the 10% level ($1338 difference in earnings by cohort with SE of $795), so it could simply be noise. All six graphs above are the same groups.
Another reason to defy the data is that redshirting, or holding kids back on purpose when they are near the age cutoff so they’ll be older within a grade, if anything helps them on net.
Actual retention reduces high school graduation by 9%, but on the margin there’s no difference in graduation between non-retained students who fall short on the test versus those who pass, both are 58%. That’s suspicious, since you’d expect a selection effect based on who manages to avoid retention.
Looking at the paper, a lot of the gap in earnings is intensive margin of work. Another issue is that the cutoff is not clean. The paper assumes that the 65% who fail the cutoff but get promoted anyway are not impacted by failing the cutoff. We can’t assume that, and indeed the 58%s matching implies that being ‘almost retained’ is itself damaging, as something has to cancel out the selection effects, which would drive down the average impact here. And the age 26 number happens to be the largest measured impact.
If the effect is real, I’d actually propose a very different mechanism as the only thing that makes sense to me: School is actively bad for these kids. The system already failed them. An extra year won’t save them academically, and this postpones their ability to go out into the world, get jobs and learn real skills they can use. These kids don’t need retention, they need either intensive tutoring or they need apprenticeships.
At Eighth Grade A Lot Of This Improvement Remains
That still leaves one important counterargument. The 8th grade reading and other scores did not much improve. We shouldn’t care so much about 4th grade reading that doesn’t result in that many gains in 8th grade. It did go from 50th to 41st, that’s nothing to sneeze at, but it’s not 49th to 9th.
Kelsey’s response to that is in a previous dedebunking post, where she measures the gap between Mississippi and the average state on the 8th grade test, and notices it shrunk by two thirds, while their 25th percentile scores had drawn even with the national average.
That degree of fade out is disappointing, but not obviously surprising, and the efforts still seem worthwhile.
Richard Innes also points out that if you look at the NAEP data, the argument that gains are fake because they are about holding kids back clearly falls apart.
England Reforms Its Schools
Another similarly wealthy place was also struggling to educate its people, and also managed to turn it around?
The problem with fixing that many things at once, and doing it across a unique nation, is that you don’t actually know which parts mattered. But the lists of successful interventions do seem to all start to look the same, starting with reading is always phonics.
Mastery Learning
You can generalize from phonics into mastery learning. Even Arnold Kling, official spokesperson for The Null Hypothesis that no educational interventions ever work, strongly suspects mastery learning and other similar techniques work.
Mastery Learning is where you focus on, learn and drill key foundational skills or knowledge, such as multiplications tables, and don’t move on until you nail them. Phonics and Direction Instruction are related.
Despite all the evidence it works where many alternatives flat out do not work, schools moved away from phonics, and similarly many schools no longer teach multiplication tables. This does appear to be madness.
The obvious response is that mastery learning is not a $20 bill lying on the sidewalk because providing a better education to our students does not result in the educators and ‘education experts’ pushing their agendas making an additional $20 or rising in status. They have skin in the wrong game, their game involves joining the war on education and not on the side of education. There’s nothing suspicious there.
One could ask, what about fancy private schools? Again, do they win by providing better educations, or by playing social games that attract wealthy and high-status students? How would a parent get the schools to care about the right things for real? Who is looking down at the sidewalk, seeing a $20 bill, and not picking it up?
The War Against Reading
One can add a fifth pillar to the four used in Mississippi, which is don’t actively stop kids from reading? You don’t actively sabotage any child who is doing well?
While several southern states teach children to read, blue areas take aim at the opposite goal, ensuring that the kids stop, which includes ending all gifted and talented programs, and then ruthlessly attacking those kids until they stop trying to be gifted or talented to ensure classroom equality.
Don’t fall for those saying they ‘only want to phase it out for kindergarten’ or anything like that. That would be bad enough, and also they’re definitely lying, and lying in wait for the chance to finish the job. Every time.
Is Our Children Reading
Not in their spare time for leisure in the form of books, but then why should they?
We force a ton of reading upon them and they have phones and computers, on which they are constantly also reading. Dedicated additional reading that ‘counts as reading,’ especially books, seems like a rather hard sell.
No One Reads Anymore
Kevin Roose reports back from liberal arts college that reading is indeed dead.
What is the point is of majoring in English if you’re unable to read books? Or even if you do not especially want to be reading a lot of books?
Here is a claim from Alden Jones that current college students have lost all capacity to read much of anything, and that we desperately need to bring back reading physical books and writing with pencils or pens. I believe the first half, and that Covid ‘broke the seal’ in ways that are not getting undone. I’m not sure about physical reading or especially writing, except that it is the only practical way to get off of one’s device. That does seem like a good enough reason for many, even if I can handle it now?
And yes, I believe students (as reported here) went from asking permission to miss classes to announcing they’ll miss classes and even tests, and that does sound like it went too far. But also colleges were also sometimes kind of insane about ‘we will ruin your life plan if your competition means you can’t get back by Monday at 1pm that one time’? There has to be a middle ground between the students and classes where attendance doesn’t matter at all, and the ones where they care way, way too much.