This powerful collection from the groundbreaking Rethinking Schools magazine takes high-stakes standardized tests to task.
Despite overwhelming evidence that the tests are invalid ways to measure teaching and learning — and continuing signs of their unjust effects on students and teachers — “reformers” and policymakers continue to force high-stakes tests into the public schools.
Through articles that provide thoughtful and emotional critiques from the frontlines of education, Pencils Down deconstructs the damage that standardized tests wreak on our education system and the human beings that populate it. Better yet, it offers visionary forms of assessment that are not only more authentic, but also more democratic, fair, and accurate.
“No questions asked, Pencils Down is one of the most comprehensive, scholarly (and yet eminently readable) take-downs of the nation’s testing craze ever produced. Combining a just-right mix of quantitative analysis, with the compelling personal narratives of educators trying to reach children in ways a test can never measure, this volume is a must read for teachers, administrators, parents and policy makers.”
—Tim Wise, author, White Like Me: Reflections on Race from a Privileged Son, and Dear White America: Letter to a New Minority
“Finally we have a book that demystifies and challenges the madness of the “almighty” testing craze! At a time when the most vulnerable students are further victimized and made to feel even more marginal, Wayne Au and Melissa Bollow Tempel have compiled a document that should be read by anyone who thinks there is something fundamentally wrong with the current emphasis on testing over quality education.”
—David Stovall, associate professor, Educational Policy Studies and African-American Studies, University of Illinois at Chicago
“Here, in one place, is a collection that looks at standardized testing and its alternatives in exactly the ways useful to teachers, parents, and teachers of teachers! What an enormous contribution to us all. It can change what you do at your school—tomorrow.”
—Debbie Meier, author of The Power of Their Ideas and Save Our Schools steering committee member
“Wayne Au and Melissa Bollow Tempel bring to us a complete exposure of the damages of high-stakes testing and sensible suggestions of alternatives with compelling stories, insightful analyses, and clear action plans. This book is a wake-up call, a must read for everyone concerned about our children’s education.”
—Yong Zhao, presidential chair and associate dean, College of Education, University of Oregon, and author of Catching Up or Leading the Way: American Education in the Age of Globalization
by Wayne Au and Melissa Bollow Tempel
Part 1: Testing, Testing, 1, 2, 3 …
Failing Our Kids—9
Why the testing craze won’t fix our schools
by Kathy Williams and Barbara Miner
Common Questions about Standardized Tests—12
by Asa Hilliard
A Child Is Not A Test Score—21
Assessment is a civil rights issue
by Monty Neill
The Straightjacket of Standardized Tests—31
Where is the standardized test that can measure passion for learning, respect for others, and human empathy?
by Tom McKenna
The Racist History of Testing—34
High-stakes testing and tracking have origins in the eugenics movement
by Alan Stoskopf
Part 2: Testing Kids
You may not believe how many tests kindergartners take–and what they are missing as a result
by Kelly McMahon
by Amy Gutowski
All Work and No Play—47
How educational reforms are hurting our preschoolers
by Sharna Olfman
A Dark Cloud on the U.S. Horizon—51
A teacher’s experience in England is a cautionary tale
by Melissa Schieble
Testing Our Sanity—55
A 4th-grade bilingual teacher shares her story of preparing students for mandated tests
by Kelley Dawson Salas
Edwina Left Behind—59
by Soren Wuerth
The Scripted Prescription—62
A cure for childhood
by Peter Campbell
Testing Our Limits—66
by Melissa Bollow Tempel
Part 3: Testing Teaching
Teaching in Dystopia—73
by Wayne Au
Fighting for Electives—78
by Melissa Bollow Tempel
Standards and Testing Attack Multiculturalism—83
by Bill Bigelow
by Amy Gutowski
About Those Tests I Gave You—94
by Ruth Ann Dandrea
A Teacher Pushed to the Edge—96
by Sara Knopp
by Wayne Au
Support That Can’t Support—106
My Induction Program Experience
by Elaine Engel Keswick
Coming Soon to Your Favorite Credential Program: National Exit Exams—110
by Ann Berlak
Responses to ‘Coming Soon to Your Favorite Credential Program: National Exit Exams’—117
Part 4: Testing the Tests
Neither Fair nor Accurate—127
by Wayne Au
A Test Scorer’s Lament—132
Scenes from the mad, mad, mad world of testing companies
by Todd Farley
The Loneliness of the Long-Distance Test Scorer—135
by Dan Dimaggio
by Meredith Jacks
Apologies to Sandra Cisneros—148
How ETS’ computer-based writing assignment misses the mark
by Maja Wilson
On White Preference—156
by Jay Rosner
Testing What Matters Least—158
What we learned when we took the Praxis Reading Specialist Test
by Maika Yeigh, Andie Cunningham, and Ruth Shagoury
Part 5: Resisting and Responding to High-Stakes Testing
Responding to Test-Driven Reform—167
by Barbara Miner
by Linda Christensen and Wayne Au
An Untold Story of Resistance—175
African American educators and IQ testing in the 1920s and 1930s
by Alan Stoskopf
Teaching Is Not Testing—183
A community-led struggle to find an alternative to California’s graduation exam
by Tina (aka Lisa) Gray-Garcia
None of the Above—189
Defiant teachers show they have had enough of high-stakes testing
by Amalia Oulahan
Taking a Stand for Learning—194
Chicago teachers speak out against a “really bad test”
by Gregorie Michie
Testing, Tracking, and Toeing the Line—197
by Bill Bigelow
United Opt Out—210
by Peggy Robertson
Part 6: Beyond High-Stakes Standardized Testing
Hallmarks of Good Assessment—217
by The Editors of Rethinking Schools
Alternatives to Standardized Tests—218
by Monty Neill and Bob Peterson
A Better System for Evaluating Schools and Students—229
by FairTest: National Center for Fair & Open Testing
A definition and examples from the United States and other nations
by Monty Neill
Their Report Card—and Ours—235
How do we know if schools are doing a good job? And how can we make them better?
by Portland Area Rethinking Schools
Portfolios and Basketball—241
by Linda Christensen
Another Path is Possible—248
by Gregory Michie
Finland builds a strong teaching and learning system
by Linda Darling-Hammond
Teaching in Dangerous Times—263
Culturally relevant ways to assess teachers
by Gloria Ladson-Billings
Teachers Teaching Teachers—271
by Linda Christensen
A Collaborative Approach to Teacher Evaluation—278
by Stan Karp
Pencils Down: Introduction
Why We Need to Rethink High-Stakes Assessment and Accountability
by Wayne Au and Melissa Bollow Tempel
In 2000, Rethinking Schools published Failing Our Kids: Why the Testing Craze Won’t Fix Our Schools. In that volume, editors Kathy Williams (then Swope) and Barbara Miner pulled together a groundbreaking collection of essays, letters, articles, and analyses that challenged the juggernaut of high-stakes testing and accountability in public education policy.
And we thought things were bad then…
We now live in a world after the bipartisan passage of NCLB. The tsunami of high-stakes testing and accountability has crashed on our educational shores with full force-threatening the foundations of teaching and learning, as well as the democratic aspirations of public education.
Those of us who held even the slimmest hope that changes in presidential administrations might stem or perhaps turn back the tide have had those hopes dashed as waves of corporate-backed reforms pushed by Republicans, Democrats, and billionaire philanthropists continue to batter kids, teachers, parents, and schools.
Now, despite duplicitous official rhetoric that speaks of the importance of multiple measures to assess learning and teaching, high-stakes test scores are being used to quantify, rank, and judge everything in public schools. Schools are charged with overcoming every aspect of socioeconomic inequality to show test score gains. District administrators and their “clipboard police” enforce a strict, scripted curriculum focused on little beyond reading, writing, and math. Teachers and their unions are the new enemies of achievement because, despite decades of persistent inequality in education, they can’t raise the test scores. Despite an economic crisis that has resulted in the massive defunding of public education, schools are expected to raise test scores.
Now, charter schools are being used to dismantle public schools, based on the false promise that charters can raise test scores. Teach for America is being used to attack unions and teacher preparation programs by placing under-trained and unqualified teachers in “high-need” schools, where need is determined by test scores. Following corporate hierarchies, district superintendents are rebranded as “Chief Executive Officers” and use test scores to competitively rate and rank students, teachers, and schools within the new “free market” of education. Teachers and teaching are now reduced to being inaccurately described by measures of how much “value” they can add to their students’ test scores.
Now, students = test scores.
Now, teachers = test scores.
Now, teaching = test scores.
Now, learning = test scores.
Now, education = test scores.
The entire package of corporate-like educational reforms hinges on the use of high-stakes, standardized tests. These tests form the justification for charter schools, union busting, merit pay, value-added teacher evaluations, school closures, turnarounds, reconstitutions, and just about any other way free-market competition manifests in education policy today. Without the test scores, there is no basis for comparing students, teachers, principals, schools, districts, cities, states, and countries. And without an ability to make comparisons, the entire system of competition simply collapses on itself.
Democratic, Authentic Assessment
We want to be clear: We are not opposed to assessment or accountability. We take seriously the real concerns that parents—especially working-class parents and parents of color—have about the quality of their children’s education. Opposition to testing does not mean opposition to accountability and documenting educational outcomes.
We firmly believe that assessment is critical to good, effective teaching, and that teachers and schools have a responsibility to their students and to the communities in which they teach. But the current systems of high-stakes testing and accountability are top-down models of reform that are fundamentally undemocratic: High-stakes tests and the policymakers who want to use them to hold educators accountable have no interest in the voices of students, teachers, parents, or administrators. Instead, they have to reduce us to numbers in order to fit all of us into their system.
But we know that students, learning, and teaching are more complicated than numbers. Education is a human endeavor, full of hope, struggle, and creativity; it involves failures and victories. We believe our systems of assessment and accountability need the flexibility and capability to capture all of that human messiness (in all of its beauty and power) if they are to provide fair and accurate measures of any aspect of education.
We need assessment that recognizes that learning and development happen unevenly, in spurts, with both backward and forward motion.
We need assessment that embraces the different learning styles of all children and also values the richness of cultural and community experience all children bring to the classroom.
We need teacher evaluation that acknowledges that teachers are both trained professionals and learners themselves. Such assessment would, by extension, recognize that good teaching not only requires training and practice, but also opportunities for self-reflection, growth, and improvement (and yes, the chance to learn from mistakes).
We need systems of accountability that honor our responsibilities to children and their communities. This accountability has to be based upon a shared commitment among teachers, students, parents, and administrators. It needs to be democratic and bottom-up, instead of the current crop of top-down, corporate-style reforms. This includes holding policymakers and administrators accountable for providing adequate and equitable resources to all children and schools.
Public education is not an island, but rather part of an interconnected and integrated network of social services and socioeconomic relations. We need systems of assessment and accountability that hold leaders accountable for providing resources such as health care, dental care, affordable housing, and other social supports.
We need systems of assessment and accountability that effectively and accurately identify sources of educational inequalities, particularly those related to race, economic class, gender, sexuality, home language, and immigration status.
Testing and Inequality
The impacts of systemic racism and other forms of injustice are real. They need to be exposed and fixed. Some have argued that test scores are one effective way to create such exposure. However, researchers have found that:
- Mandated high-stakes testing since the passing of the No Child Left Behind Act has not improved educational outcomes or closed any test-defined achievement gaps. So, high-stakes testing has not resulted in increased learning or equality.
- The ill effects of high-stakes testing-like narrowing learning environments to focus solely on reading, writing, and math, as well as the test-induced increase of high school dropouts—have had a disproportionately negative impact on low-income students and students of color.
- The construction and grading of standardized, high-stakes tests contain high levels of inaccuracy. The results, more often than not, are misinterpreted, misunderstood, and misused by policymakers and the general public.
- Racial, cultural, and economic class-based biases are embedded in many high-stakes, standardized tests. Although these biases have persisted for more than 100 years, test scores are still misperceived as accurate measures of intelligence.
Given these facts, we can only conclude that testing is the wrong way to expose educational inequality, and that the tests themselves are interfering with the accurate measurement of learning, teaching, and achievement.
This confirms what social scientist Donald T. Campbell identified in 1976 as Campbell’s Law:
The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor. … [W]hen test scores become the goal of the teaching process, they both lose their value as indicators of educational status and distort the educational process in undesirable ways.
Based on the evidence, high-stakes testing is exacerbating the inequality it is supposed to be measuring. Much of that evidence is highlighted in the pages of Pencils Down.
Time To Put the Pencils Down
Because high-stakes testing is so central to the entire apparatus of the corporate educational reforms that are being forced upon us—and because of the overwhelming evidence of the invalidity and injustice of using the tests as they are presently being used—we are publishing Pencils Down: Rethinking High-Stakes Testing and Accountability in Public Schools. We are in the midst of a war on public education, and high-stakes, standardized tests are the enemies’ weapon of choice. Pencils Down is one attempt to expose the fallacy of high-stakes testing to the general public: We wanted to put together a collection of articles that provide thoughtful, emotional, and classroom- and research-based critiques of high-stakes tests-one we could put in the hands of students and teachers (future, present, and past), and also pass around to parents at PTA meetings, potlucks, and picnics.
In Pencils Down we take the high-stakes tests to task, deconstruct the damage they cause to our education system, highlight their inaccuracy as tools of measurement, and offer visionary forms of assessment that are more authentic, democratic, fair, and accurate.
The first section, “Testing, Testing, 1, 2, 3…” covers the nuts and bolts of standardized testing, and presents an overview of the enduring problems with the tests. Section two, “Testing Kids,” offers views from the classroom of just what high-stakes testing is doing to the quality of education. The third section, “Testing Teaching,” highlights the ways high-stakes testing stifles instruction and de-professionalizes teaching, as well as examining efforts to bring standardized assessment to the process of teacher credentialing.
The fourth section of Pencils Down, “Testing the Tests,” provides analyses of some lesser-known problems with the tests: their validity as a form of measurement, and the inconsistency found in their results and grading. This section is fundamental to any critique of high-stakes testing because the numbers produced by the tests carry an air of objectivity. (And pundits, policymakers, and philanthropists assert that such objectivity exists.) However, on closer examination, the numbers are far from objective.
One of the critical questions facing education activists today is, “What can we do?” From refusal and opting out to protests and organizing letter-writing campaigns, section five, “Resisting and Responding to High-Stakes Testing,” takes a look at a wide range of efforts teachers, students, and communities have employed to oppose the testing regime.
But critique, while important and necessary, can only take us so far. We need real, concrete visions of what “alternative,” non-high-stakes, standardized testing and accountability can look like. Many teachers, who have been hemmed in by the tests for years now, also need to learn (or relearn) how to provide quality assessment. That is why the sixth and final section of Pencils Down, “Beyond High-Stakes, Standardized Testing,” focuses on authentic forms of assessment, including portfolios and ongoing teacher and student self-reflection based on classroom evidence. Effective methods of assessing teaching and learning exist: They are just messier, more intensive, more democratic, and less punitive. And they require a bigger commitment to public education than the test-pushers are willing to make.
The powers that be continue to force high-stakes testing and accountability upon students, teachers, and parents. As a result, we are feeling … tested. Despite the infatuation for tests shared by policymakers, philanthropists, and corporate education reformers on both sides of the aisle, resistance continues to build. The struggle is far from over, however. As of this writing, the U.S. federal government has announced intentions not only to ratchet up the use of high-stakes tests to measure student learning and teacher effectiveness, but also to measure the effectiveness of teacher education programs by the test scores of the students of the teachers who graduate from the programs. This proposal sounds convoluted and ludicrous, but it is just another entry in a long list of examples of test abuse and misuse in education policy, and our kids are paying the price. It’s time to stop the testing. It’s time to put the pencils down.