Is School Reform Failing?

We are inundated every day with pundits talking about how our school reforms will improve our results, yet after years of more and more testing and more and more accountability based on public reporting or test scores, our schools appear to remain problematic. Two recent articles exemplify the ideas of researchers who offer insights on changing the direction of the reform movement.

David Berliner, in “Effects of Inequality and Poverty vs. Teachers and Schooling on America’s Youth,” provides a strong argument that economic inequality and poverty are the issues that must be addressed to see any wide-spread improvement in student achievement.  Go to www.tcrecord.org, look under Articles, and search for Berliner to find an executive summary.

His content derives from his own and other research on how socio-economic issues are the driving forces that work against student achievement. He provides analysis of American student test scores broken out by levels of poverty in schools, and makes a clear case showing that our scores, when comparing like levels of student poverty, rise to the top, or very near the top on the international tests that are regularly used to claim our schools are failing. He makes it clear that our social support systems have failed, and our international competitors have done a far better job of providing supports to families and children in need. So, our schools are not failing upper and middle class students, but our society is failing lower-income families and schools.

What I find encouraging in his work (and he has a long history of debunking the critics of American education, which you might want to examine separately) is his willingness to identify sloppy reasoning and utter nonsense found in the media and in the arguments of reformers with political agendas. He recognizes there are examples of “occasional” (the emphasis is Berliner’s) success stories from individual schools and families who are successful and rise from poverty, or the “occasional” teacher who breaks through with low-income children, but he points out that these are exceptions, not the norms. Americans want to believe in this idealized version of the American Dream, but as policy, it simply doesn’t work. He point out that while we have long-living overweight smokers, no one seriously suggests building public health policy by examining these exceptions—these exceptions don’t drive public health policy, except in education, where reformers hold on to the unrealistic notion that finding only exceptional teachers for low performing schools will render poverty irrelevant, and testing to find great teachers will cure educational ills.

Taking a different, more traditional view on reform, David L. Kirp, a public policy professor at the University of California, Berkley, wrote “The Secret to Fixing Bad Schools” on February 10, 2013, in the New York Times. Kirp talks about the “striking achievement” of Union City, N.J. schools, an urban district that has done school reform successfully. They enroll almost every 3 and 4 year old in prekindergarten, work on character, focus on the individual needs of children, “figuring out what’s best for each child, rather than batch-processing them.” Strong principals encourage teachers to raise expectations, and teachers have responded. In Kirp’s words, “What makes Union City remarkable is, paradoxically, the absence of pizazz. It hasn’t followed the herd by closing ‘underperforming’ schools or giving the boot to hordes of teachers. No Teach for America recruits toil in its classrooms, and there are no charter schools.”

They started transforming their schools years ago when poor performance threatened them with a state take-over. The district designed an evidence based curriculum where “learning by doing replaced learning by rote.” Teachers were encouraged to work together and coaching and mentoring supported staff who struggled. Principals became education leaders.

Now folks from all over are visiting to see what Union City has done. Frankly, the research on what works in education has been rather clear for many years–Union City simply read it and implemented it in their school improvement work. So, here’s an interesting example of a school district that is one of the “occasional” examples of success that Berliner talks about.

Where do these two articles overlap? While at first they seem to reflect opposite approaches, I find them more complementary than not. These researches are not in the testing to find and fire weak teachers camp. They both want to see schools address root causes of academic failure with responsible strategies–Union City brings in high expectations, parent involvement, support for weak teachers, and a cultural shift that reflects a long-term strategy of continuous improvement. They both reject the current direction of school reformers who want to reinvent education with unproved quick fixes.

Kirp’s recent book is Improbable Scholars: The Rebirth of a Great American School System and a Strategy for America’s Schools, a more detailed look at the Union City Schools and what they represent as a legitimate model for school reform. Google him –his vitae lists lots of articles he’s written–many for Huffington Post–on education policy issues.

Value Added and Teacher Evaluation

Now that value added measures are commonplace throughout the country, what can schools do to effectively incorporate them into teacher evaluation?  This is the central question that classroom teachers and building principals must answer as they meet requirements for federal funding that is driving this model.  I’m enthusiastic about using data for school improvement, and it’s been central to the last 15 years of my career as data warehouses and analysis tools for classroom teachers have emerged.  But the way states have adopted the use of VA assessments varies greatly, and the impact of a single round of testing on teacher evaluations also varies.  This variance is problematic at several levels.

The critics of VA point out that student scores can vary from year to year–one source of variance.  If you read teacher blogs or blogs from assessment critics about how VA assessments are used, or you read some progressive school improvement bloggers, you’ll read many examples of students who scored highly one year and were significantly lower in scores the next–changes that could not be conveniently explained by the effects of teachers or schools.  Scores of individual teachers also vary across classes in the same year and from year to year, and examples of this variance fill the pages of critical analyses of VA methodology.  In such scenarios, a given teacher of a single subject in the same year can show significant variance between students across multiple sections of the same course.  A teacher might also score highly for a year or two and then plummet the following year.  Such variance is not explainable or accounted for particularly well in the statistical models.  I’ve identified several research analyses on these topics in the Research section of this site.

The concept of Student Growth Percentiles, which is a variant of VA analysis, compares similar student scores and ranks students according to their growth.  When the student scores are aggregated into teacher classes, the teacher can then be given a growth score that is intended to fairly account for the population in the teacher’s class.  This system weighs the aggregated class groupings to similar students so that teacher X, with 10 ESL students and 20 regular students has the scores of the ESL students compared to other ESL students in the state.  This is intended to lessen the impact of second language students on the teacher’s VA score.  However, an informed Internet reader will still find examples of teachers in New York (which is using Student Growth Percentiles for the first time this year) who are rated by principals and parents and colleagues as outstanding who have a mediocre VA score.  So rating teachers on VA scores, even with Student Growth Percentiles, is fraught with problems.

The widely adopted but simplistic solution is to use a VA score (or any other assessment score) as only a part of a teacher evaluation.  Using a summary test score in a subject area for only part of a teacher evaluation while adding classroom observations as a large, or largest component of evaluation is a commonly proposed means to lessen the impact of assessments, and a tacit recognition that there’s a problem with this unproven system.  States have jumped into this complex process without any national research on what works, without agreement on how to use student test results to evaluate teachers, and without any real analysis of whether this has affected the quality of student learning where the programs have been implemented.  We are dealing with a core shift that is virtually ungrounded in research.  Were we to try this in other fields, we would be stopped by regulators and common sense at every level.

ASCD’s November 2012 edition of Educational Leadership is themed: Teacher Evaluation: What’s Fair? What’s Effective?  This edition presents a generic overview of the current state of teacher evaluation, and particularly discusses value added assessment measures.  The range of articles reflect all the concerns I’ve mentioned.  I particularly like several articles that are offering recommendations about what to do with the results of all the testing and teacher evaluation that is going on.  The threads in common here are very clear–lessen the impact of summative tests and devise a means to use more formative testing throughout the year in a feedback loop centered on teachers identifying what kids need to learn.  Use teacher observations as a means to coach teachers toward improving their instruction.  This sounds easy, but in general principals are both untrained to do so and have no time to spend in classrooms anyway.  Those who have never been principals or building level administrators with responsibilities for day to day operations and teacher evaluation simply don’t have a clue about how problematic new teacher evaluation requirements are.

Educational Leadership isn’t exactly educational research per se, but a few of the articles come from folks with solid research backgrounds, and in the references at the end of the articles are a few meaty morsels worthy of further reading if you have access to a decent library where you can find the books and journals.

My favorite article is “How to Use Value-Added Measures Right,” by Matthew Di Carlo.  He offers suggestions on how VA can be an appropriate element of teacher evaluation.  The importance of getting this right is summarized by his comments in the first few paragraphs.  He writes:  “….there is virtually no empirical evidence as to whether using value-added or other growth models–they types of models being used vary from state to state–in high-stakes evaluation can improve teacher performance or student outcomes  The reason is simple:It has never really been tried before.

Your health insurance is unlikely to pay for experimental treatments.  We have mandates all over America to implement a diverse range of experimental treatments for teacher evaluation.  It would have made sense to try such programs in small scale pilots across several states in multiple district contexts.  Instead, we are demoralizing the profession by using unproven and unreliable means to evaluate performance, and then often publishing the results and destroying individual teachers.

You can find these articles on the ASCD website, though if you are not an ASCD member you may only be able to read abstracts.  If you are a member, you’ll have the journal in your mailboxes.  Share your copies with colleagues, check it out online.  If you’re interested in or affected by VA assessments, Di Carlo’s bibliography is a good one–I’ll be adding some of the reference he lists to my own research page here at k12edtalk.

Won’t Back Down – The Attacks Keep Coming

This new Hollywood anti-union propaganda film will be stirring up lots of commentary as it spreads throughout the nation.  Rather than comment on it’s distortions, I’ll offer two links to other sites that do a great job of identify the problems with the film.

The first comes from Professor Mark Phillips, who writes for Edutopia.  His article Won’t Back Down: An Engaging and Misleading Film includes a few additional links to expand on his thesis.

One of those links is worthy of a direct mention on it’s own.  From the newly formed and still struggling Save our Schools organization, this posting illuminates the agendas and funders who are promoting the anti-union, anti-public school movement in considerable detail.  They are also the funders behind Waiting for Superman, which was a similar distortion of educational reality.  Articles On “Won’t Back Down” The Film and “Teachers Rock” Concert

These are good reads, and shed light on some of the behind the curtain groups who are most influential among those who constantly attack public education and public educators.

On Critical Thinking

While I don’t agree with many critics of public education, my critique would be that schools are failing to produce critical thinkers.  Within schools, the older generation of teachers will often be heard saying the expectations for critical essays in English or History found on state exam questions has declined over the years.  Proof that we don’t value critical thinking is all around us—we reelect politicians who don’t govern for the common good; we uncritically devour the vitriol of the Internet and broadcast media; we too often believe that all sides of an issue have to be reported or respected or given equal time even when one side is objectively or scientifically unfounded. We accept news stories without fact checking.

How would we recognize if renewed efforts to teach critical thinking work?  The next generation would demand truth in advertising, news that’s more than thinly disguised editorializing, and government of the people, by the people, and for the people rather than government by the biggest pocketbook.  We would see decisions based on evidence rather than emotions.  (Isn’t this what reformers are suggesting with changes in the way they propose to evaluate teachers–use test data, not the opinion of administrators?)  The Common Core, if done well, expects critical thinking to be deeply embedded in all that is done in classrooms.  If that actually happens, we are on our way back to the reasoned ideals on which America was built.

A good example of Common Core efforts to improve our critical thinking skills is a model lesson reading Martin Luther King’s Letter from Birmingham Jail.  Students reading this should come to understand Dr. King’s indictment of Southern white ministerial leaders for their lack of support for the civil rights of minorities. This content will make some parents and teachers uncomfortable.  So teaching critical thinking can be controversial.  Societal discomfort with teaching critical thinking is illustrated by the Texas GOP party platform passed in the early summer.  (Google ‘Texas GOP platform’ for several links, or check out Valerie Strauss’s blog on the topic.) Their platform positions exemplify the occasional local opposition to any instruction that questions authority figures and traditional societal norms.  Teaching children to think for themselves is anathema to some critics of the Common Core, and rote, uncritical classroom instruction is a highlight of some voucher programs and charter schools across the nation.

As students begin to practice critical thinking skills, teachers and parents must be open to those who reach informed and reasoned conclusions that are different than their own. I think good educational practice inevitably challenges traditional authority–we have to teach for the future, and teaching critical thinking will certainly challenge the old ways of doing almost everything. We need young people to learn the skills to pursue ideas in a critical fashion and use that skill to become our future leaders. The Common Core’s emphasis on deep reading and critical thinking is a step in the right direction.