Pencils Down

“Finally we have a book that demystifies and challenges the madness of the “almighty” testing craze! At a time when the most vulnerable students are further victimized and made to feel even more marginal, Wayne Au and Melissa Bollow Tempel have compiled a document that should be read by anyone who thinks there is something fundamentally wrong with the current emphasis on testing over quality education.”

—David Stovall, associate professor, Educational Policy Studies and African-American Studies, University of Illinois at Chicago

“Here, in one place, is a collection that looks at standardized testing and its alternatives in exactly the ways useful to teachers, parents, and teachers of teachers! What an enormous contribution to us all. It can change what you do at your school—tomorrow.”

—Debbie Meier, author of The Power of Their Ideas and Save Our Schools steering committee member

“Wayne Au and Melissa Bollow Tempel bring to us a complete exposure of the damages of high-stakes testing and sensible suggestions of alternatives with compelling stories, insightful analyses, and clear action plans. This book is a wake-up call, a must read for everyone concerned about our children’s education.”

—Yong Zhao, presidential chair and associate dean, College of Education, University of Oregon, and author of Catching Up or Leading the Way: American Education in the Age of Globalization

Introduction—1

by Wayne Au and Melissa Bollow Tempel

Part 1:  Testing, Testing, 1, 2, 3 …

Failing Our Kids—9

Why the testing craze won’t fix our schools

by Kathy Williams and Barbara Miner

Common Questions about Standardized Tests—12

by Asa Hilliard

A Child Is Not A Test Score—21

Assessment is a civil rights issue

by Monty Neill

The Straightjacket of Standardized Tests—31

Where is the standardized test that can measure passion for learning, respect for others, and human empathy?

by Tom McKenna

The Racist History of Testing—34

High-stakes testing and tracking have origins in the eugenics movement

by Alan Stoskopf

Part 2: Testing Kids

Testing Kindergarten—43

You may not believe how many tests kindergartners take–and what they are missing as a result

by Kelly McMahon

Testing Lang—46

by Amy Gutowski

All Work and No Play—47

How educational reforms are hurting our preschoolers

by Sharna Olfman

A Dark Cloud on the U.S. Horizon—51

A teacher’s experience in England is a cautionary tale

by Melissa Schieble

Testing Our Sanity—55

A 4th-grade bilingual teacher shares her story of preparing students for mandated tests

by Kelley Dawson Salas

Edwina Left Behind—59

by Soren Wuerth

The Scripted Prescription—62

A cure for childhood

by Peter Campbell

Testing Our Limits—66

by Melissa Bollow Tempel

Part 3: Testing Teaching

Teaching in Dystopia—73

by Wayne Au

Fighting for Electives—78

by Melissa Bollow Tempel

Standards and Testing Attack Multiculturalism—83

by Bill Bigelow

Thinkless Benchmarks—90

by Amy Gutowski

About Those Tests I Gave You—94

by Ruth Ann Dandrea

A Teacher Pushed to the Edge—96

by Sara Knopp

Playing Smart—101

by Wayne Au

Support That Can’t Support—106

My Induction Program Experience

by Elaine Engel Keswick

Coming Soon to Your Favorite Credential Program: National Exit Exams—110

by Ann Berlak

Responses to ‘Coming Soon to Your Favorite Credential Program: National Exit Exams’—117

Part 4: Testing the Tests

Neither Fair nor Accurate—127

by Wayne Au

A Test Scorer’s Lament—132

Scenes from the mad, mad, mad world of testing companies

by Todd Farley

The Loneliness of the Long-Distance Test Scorer—135

by Dan Dimaggio

Fuzzy Math—145

by Meredith Jacks

Apologies to Sandra Cisneros—148

How ETS’ computer-based writing assignment misses the mark

by Maja Wilson

On White Preference—156

by Jay Rosner

Testing What Matters Least—158

What we learned when we took the Praxis Reading Specialist Test

by Maika Yeigh, Andie Cunningham, and Ruth Shagoury

Part 5: Resisting and Responding to High-Stakes Testing

Responding to Test-Driven Reform—167

by Barbara Miner

High-Stakes Harm—169

by Linda Christensen and Wayne Au

An Untold Story of Resistance—175

African American educators and IQ testing in the 1920s and 1930s

by Alan Stoskopf

Teaching Is Not Testing—183

A community-led struggle to find an alternative to California’s graduation exam

by Tina (aka Lisa) Gray-Garcia

None of the Above—189

Defiant teachers show they have had enough of high-stakes testing

by Amalia Oulahan

Taking a Stand for Learning—194

Chicago teachers speak out against a “really bad test”

by Gregorie Michie

Testing, Tracking, and Toeing the Line—197

by Bill Bigelow

United Opt Out—210

by Peggy Robertson

Opt-Out Template—213

Part 6: Beyond High-Stakes Standardized Testing

Hallmarks of Good Assessment—217

by The Editors of Rethinking Schools

Alternatives to Standardized Tests—218

by Monty Neill and Bob Peterson

A Better System for Evaluating Schools and Students—229

by FairTest: National Center for Fair & Open Testing

Multiple Measures—231

A definition and examples from the United States and other nations

by Monty Neill

Their Report Card—and Ours—235

How do we know if schools are doing a good job? And how can we make them better?

by Portland Area Rethinking Schools

Portfolios and Basketball—241

by Linda Christensen

Another Path is Possible—248

by Gregory Michie

Steady Work—255

Finland builds a strong teaching and learning system

by Linda Darling-Hammond

Teaching in Dangerous Times—263

Culturally relevant ways to assess teachers

by Gloria Ladson-Billings

Teachers Teaching Teachers—271

by Linda Christensen

A Collaborative Approach to Teacher Evaluation—278

by Stan Karp

 

Author Bios—285

 

Index—289

Pencils Down: Introduction

Why We Need to Rethink High-Stakes Assessment and Accountability

by Wayne Au and Melissa Bollow Tempel

In 2000, Rethinking Schools published Failing Our Kids: Why the Testing Craze Won’t Fix Our Schools. In that volume, editors Kathy Williams (then Swope) and Barbara Miner pulled together a groundbreaking collection of essays, letters, articles, and analyses that challenged the juggernaut of high-stakes testing and accountability in public education policy.

And we thought things were bad then…

We now live in a world after the bipartisan passage of NCLB. The tsunami of high-stakes testing and accountability has crashed on our educational shores with full force-threatening the foundations of teaching and learning, as well as the democratic aspirations of public education.

Those of us who held even the slimmest hope that changes in presidential administrations might stem or perhaps turn back the tide have had those hopes dashed as waves of corporate-backed reforms pushed by Republicans, Democrats, and billionaire philanthropists continue to batter kids, teachers, parents, and schools.

Now, despite duplicitous official rhetoric that speaks of the importance of multiple measures to assess learning and teaching, high-stakes test scores are being used to quantify, rank, and judge everything in public schools. Schools are charged with overcoming every aspect of socioeconomic inequality to show test score gains. District administrators and their “clipboard police” enforce a strict, scripted curriculum focused on little beyond reading, writing, and math. Teachers and their unions are the new enemies of achievement because, despite decades of persistent inequality in education, they can’t raise the test scores. Despite an economic crisis that has resulted in the massive defunding of public education, schools are expected to raise test scores.

Now, charter schools are being used to dismantle public schools, based on the false promise that charters can raise test scores. Teach for America is being used to attack unions and teacher preparation programs by placing under-trained and unqualified teachers in “high-need” schools, where need is determined by test scores. Following corporate hierarchies, district superintendents are rebranded as “Chief Executive Officers” and use test scores to competitively rate and rank students, teachers, and schools within the new “free market” of education. Teachers and teaching are now reduced to being inaccurately described by measures of how much “value” they can add to their students’ test scores.

Now, students = test scores.

Now, teachers = test scores.

Now, teaching = test scores.

Now, learning = test scores.

Now, education = test scores.

The entire package of corporate-like educational reforms hinges on the use of high-stakes, standardized tests. These tests form the justification for charter schools, union busting, merit pay, value-added teacher evaluations, school closures, turnarounds, reconstitutions, and just about any other way free-market competition manifests in education policy today. Without the test scores, there is no basis for comparing students, teachers, principals, schools, districts, cities, states, and countries. And without an ability to make comparisons, the entire system of competition simply collapses on itself.

Democratic, Authentic Assessment

We want to be clear: We are not opposed to assessment or accountability. We take seriously the real concerns that parents—especially working-class parents and parents of color—have about the quality of their children’s education. Opposition to testing does not mean opposition to accountability and documenting educational outcomes.

We firmly believe that assessment is critical to good, effective teaching, and that teachers and schools have a responsibility to their students and to the communities in which they teach. But the current systems of high-stakes testing and accountability are top-down models of reform that are fundamentally undemocratic: High-stakes tests and the policymakers who want to use them to hold educators accountable have no interest in the voices of students, teachers, parents, or administrators. Instead, they have to reduce us to numbers in order to fit all of us into their system.

But we know that students, learning, and teaching are more complicated than numbers. Education is a human endeavor, full of hope, struggle, and creativity; it involves failures and victories. We believe our systems of assessment and accountability need the flexibility and capability to capture all of that human messiness (in all of its beauty and power) if they are to provide fair and accurate measures of any aspect of education.

We need assessment that recognizes that learning and development happen unevenly, in spurts, with both backward and forward motion.

We need assessment that embraces the different learning styles of all children and also values the richness of cultural and community experience all children bring to the classroom.

We need teacher evaluation that acknowledges that teachers are both trained professionals and learners themselves. Such assessment would, by extension, recognize that good teaching not only requires training and practice, but also opportunities for self-reflection, growth, and improvement (and yes, the chance to learn from mistakes).

We need systems of accountability that honor our responsibilities to children and their communities. This accountability has to be based upon a shared commitment among teachers, students, parents, and administrators. It needs to be democratic and bottom-up, instead of the current crop of top-down, corporate-style reforms. This includes holding policymakers and administrators accountable for providing adequate and equitable resources to all children and schools.

Public education is not an island, but rather part of an interconnected and integrated network of social services and socioeconomic relations. We need systems of assessment and accountability that hold leaders accountable for providing resources such as health care, dental care, affordable housing, and other social supports.

We need systems of assessment and accountability that effectively and accurately identify sources of educational inequalities, particularly those related to race, economic class, gender, sexuality, home language, and immigration status.

Testing and Inequality

The impacts of systemic racism and other forms of injustice are real. They need to be exposed and fixed. Some have argued that test scores are one effective way to create such exposure. However, researchers have found that:

• Mandated high-stakes testing since the passing of the No Child Left Behind Act has not improved educational outcomes or closed any test-defined achievement gaps. So, high-stakes testing has not resulted in increased learning or equality.
• The ill effects of high-stakes testing-like narrowing learning environments to focus solely on reading, writing, and math, as well as the test-induced increase of high school dropouts—have had a disproportionately negative impact on low-income students and students of color.
• The construction and grading of standardized, high-stakes tests contain high levels of inaccuracy. The results, more often than not, are misinterpreted, misunderstood, and misused by policymakers and the general public.
• Racial, cultural, and economic class-based biases are embedded in many high-stakes, standardized tests. Although these biases have persisted for more than 100 years, test scores are still misperceived as accurate measures of intelligence.

Given these facts, we can only conclude that testing is the wrong way to expose educational inequality, and that the tests themselves are interfering with the accurate measurement of learning, teaching, and achievement.

This confirms what social scientist Donald T. Campbell identified in 1976 as Campbell’s Law:

The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor. … [W]hen test scores become the goal of the teaching process, they both lose their value as indicators of educational status and distort the educational process in undesirable ways.

Based on the evidence, high-stakes testing is exacerbating the inequality it is supposed to be measuring. Much of that evidence is highlighted in the pages of Pencils Down.

Time To Put the Pencils Down

Because high-stakes testing is so central to the entire apparatus of the corporate educational reforms that are being forced upon us—and because of the overwhelming evidence of the invalidity and injustice of using the tests as they are presently being used—we are publishing Pencils Down: Rethinking High-Stakes Testing and Accountability in Public Schools. We are in the midst of a war on public education, and high-stakes, standardized tests are the enemies’ weapon of choice. Pencils Down is one attempt to expose the fallacy of high-stakes testing to the general public: We wanted to put together a collection of articles that provide thoughtful, emotional, and classroom- and research-based critiques of high-stakes tests-one we could put in the hands of students and teachers (future, present, and past), and also pass around to parents at PTA meetings, potlucks, and picnics.

In Pencils Down we take the high-stakes tests to task, deconstruct the damage they cause to our education system, highlight their inaccuracy as tools of measurement, and offer visionary forms of assessment that are more authentic, democratic, fair, and accurate.

The first section, “Testing, Testing, 1, 2, 3…” covers the nuts and bolts of standardized testing, and presents an overview of the enduring problems with the tests. Section two, “Testing Kids,” offers views from the classroom of just what high-stakes testing is doing to the quality of education. The third section, “Testing Teaching,” highlights the ways high-stakes testing stifles instruction and de-professionalizes teaching, as well as examining efforts to bring standardized assessment to the process of teacher credentialing.

The fourth section of Pencils Down, “Testing the Tests,” provides analyses of some lesser-known problems with the tests: their validity as a form of measurement, and the inconsistency found in their results and grading. This section is fundamental to any critique of high-stakes testing because the numbers produced by the tests carry an air of objectivity. (And pundits, policymakers, and philanthropists assert that such objectivity exists.) However, on closer examination, the numbers are far from objective.

One of the critical questions facing education activists today is, “What can we do?” From refusal and opting out to protests and organizing letter-writing campaigns, section five, “Resisting and Responding to High-Stakes Testing,” takes a look at a wide range of efforts teachers, students, and communities have employed to oppose the testing regime.

But critique, while important and necessary, can only take us so far. We need real, concrete visions of what “alternative,” non-high-stakes, standardized testing and accountability can look like. Many teachers, who have been hemmed in by the tests for years now, also need to learn (or relearn) how to provide quality assessment. That is why the sixth and final section of Pencils Down, “Beyond High-Stakes, Standardized Testing,” focuses on authentic forms of assessment, including portfolios and ongoing teacher and student self-reflection based on classroom evidence. Effective methods of assessing teaching and learning exist: They are just messier, more intensive, more democratic, and less punitive. And they require a bigger commitment to public education than the test-pushers are willing to make.

***

The powers that be continue to force high-stakes testing and accountability upon students, teachers, and parents. As a result, we are feeling … tested. Despite the infatuation for tests shared by policymakers, philanthropists, and corporate education reformers on both sides of the aisle, resistance continues to build. The struggle is far from over, however. As of this writing, the U.S. federal government has announced intentions not only to ratchet up the use of high-stakes tests to measure student learning and teacher effectiveness, but also to measure the effectiveness of teacher education programs by the test scores of the students of the teachers who graduate from the programs. This proposal sounds convoluted and ludicrous, but it is just another entry in a long list of examples of test abuse and misuse in education policy, and our kids are paying the price. It’s time to stop the testing. It’s time to put the pencils down.