Yes, that’s Rod Serling‘s shadow, and that’s the “Twilight Zone” music you hear.
Consider the curious case of Carolyn Abbott in New York City (links added):
Carolyn Abbott was, in one respect, a victim of her own success. After a year in her classroom, her seventh-grade students scored at the 98th percentile of New York City students on the 2009 state test. As eighth-graders, they were predicted to score at the 97th percentile on the 2010 state test. However, their actual performance was at the 89th percentile of students across the city. That shortfall—the difference between the 97th percentile and the 89th percentile—placed Abbott near the very bottom of the 1,300 eighth-grade mathematics teachers in New York City.
How could this happen? Anderson is an unusual school, as the students are often several years ahead of their nominal grade level. The material covered on the state eighth-grade math exam is taught in the fifth or sixth grade at Anderson. “I don’t teach the curriculum they’re being tested on,” Abbott explained. “It feels like I’m being graded on somebody else’s work.”
The math that she teaches is more advanced, culminating in high-school level algebra and a different and more challenging test, New York State’s Regents exam in Integrated Algebra. To receive a high school diploma in the state of New York, students must demonstrate mastery of the New York State learning standards in mathematics by receiving a score of 65 or higher on the Regents exam. In 2010-11, nearly 300,000 students across the state of New York took the Integrated Algebra Regents exam; most of the 73 percent who passed the exam with a score of 65 or higher were tenth-graders.
Because student performance on the state ELA and math tests is used to calculate scores on the Teacher Data Reports, the tests are high-stakes for teachers; and because New York City uses a similar statistical strategy to rank schools, they are high-stakes for schools as well. But the tests are not high-stakes for the eighth-graders at Anderson.
By the time they take the eighth-grade tests in the spring of the year, they already know which high school they will be attending, and their scores on the test have no consequences. “The eighth-graders don’t care; they rush through the exam, and they don’t check their work,” Abbott said. “The test has no effect on them. I can’t make an argument that it counts for kids. The seventh-graders, they care a bit more.”
The state tests, she believes, are poorly equipped to assess real mathematical knowledge, especially for high-performing students. “They’re so basic; they ask you to explain things that are obvious if you’re three years ahead,” she says. The Anderson students “understand it at a different level. They want to explain with equations, not words.” But the scoring of the free-response items on the tests emphasizes a formulaic response, with the scoring instructions often looking for a single keyword in a response to garner credit.
“They’re not accepting answers that are mathematically correct,” Abbott notes, “and accepting answers that aren’t mathematically correct.” And the multiple-choice questions? “Multiple-choice questions don’t test thinking,” she declares. Knowing how to answer them is “just an art.”
Ms. Abbott? Oh, yes. She is ranked the worst math teacher in New York City.
Read more of this fascinating, troubling case* at Aaron Palas’s blog at the Hechinger Report.
_____________
* Working hard to avoid using the term “colossal cluster f***.”
Related articles
- The Worst 8th Grade Math Teacher in NYC? (dianeravitch.net)
- Cram. Memorize. Regurgitate. Forget. (everydaysociologyblog.com)
- In New York Teacher Ratings, Good Test Scores Aren’t Always Good Enough (nytimes.com)
Posted by Ed Darrell 
Millard Fillmore's Bathtub 