Showing posts with label cheating. Show all posts
Showing posts with label cheating. Show all posts

Monday, January 7, 2013

Our parent report card for Michelle Rhee and StudentsFirst

credit:  Education Week
Michelle Rhee, former DC Chancellor and founder of the organization StudentsFirst, has come out with a new state by state report card, grading states on how well they adhere to the corporate reform agenda of privatization and “choice” (i.e. expanding charters and vouchers) , merit pay, and rigid evaluation systems based on test scores. 

Her grading scheme actually punishes states that have policies to reduce class size above grade three, or offer incentives to keep classes small – even though class size reduction is one of the top priorities of parents, and one of the few education reforms that have proven to work.  At the same time she gives points to states that either have mayoral control, support the “Parent trigger” or provide other ways to supersede the authority of democratically-elected school boards.
Even as Rhee often claims that student outcomes and achievement are what matters most, the two states with the highest student achievement in the nation, Massachusetts and New Jersey, received a “D-” and a “D.” California got an "F" for refusing to sign onto the provisions of "Race to the Top", including test-based evaluations of teachers; Richard Zeiger, the state's deputy superintendent, called the state's failing grade a “badge of honor.”
I thought it was a good time to reprint the Parents Across America report card for Rhee, where she received failing grades in categories important to parents.  See below.
Since our report card was produced, there has been more attention paid to the Rhee’s checkered past and recent failings :
  • ·         Evidence of widespread cheating in DC schools when she ran them, and her failure to investigate these allegations properly -- a special focus of a Frontline program due to air tonight [Correction: tomorrow night];
  • ·        The voluminous research pointing out that evaluating teachers on the basis of test scores through value-added models, as she pushed for in DC and now in her state report cards, is unstable,  unreliable and unfair.  (See the most recent analysis from a group of statistical experts, concluding that “We cannot at this time encourage anyone to use VAM in a high stakes endeavor.”)
  • The way she inflated the number of supporters of StudentsFirst, counting as members anyone who signed deceptively-phrased online petitions, calling for unobjectionable policies like paying good teachers more or stopping bullying in schools.
  • ·        How the teacher evaluation system she relied upon, called IMPACT, was altered after she left by her successor to diminish its reliance on test scores, dropping that component from 50 to 35 percent.
  • ·        How a recent report from the organization she used to run, TNTP, though predictably positive in its spin, revealed  that the IMPACT teacher evaluation system was  one of the top reasons that even “top performing” teachers plan to leave DC schools.  The report also cast further doubt on the system, saying that there may be a “flaw in the design or implementation of IMPACT [that] makes it easier for teachers working in low-need schools to earn top ratings.”
  • ·         The documented predilection of StudentsFirst to fund right-wing Republican candidates, despite claims of bipartisanship.
  • ·         Most recently, Rhee made a tone-deaf statement on the mass shootings in Newtown CT, calling such children “our most valuable assets”.
  • ·         Finally, her refusal to oppose a bill in Michigan that would allow concealed weapons in schools, until the legislation had already been vetoed by the Governor. 
If we were updating the report card today, we would certainly give her an “F” for her position on school safety as well.  
Here are some of our comments below:  Michelle Rhee has said that “cooperation, collaboration and consensus-building are way overrated.” She has an overriding belief in test scores despite numerous documented problems with standardized testing: People say, ‘Well, you know, test scores don’t take into account creativity and the love of learning.’...I’m like, ‘You know what? I don’t give a crap.’”   
We recommended remedial education for Rhee, to spend more time studying what parents want for their children, and what research shows works to improve education.  The report she put out today only reinforces our conviction that she needs to go back to school.

Michelle Rhee Report Card

Sunday, September 23, 2012

Michelle Rhee finally gets a real debate on BBC

Michelle Rhee gets blasted on the BBC by the UK teacher union leader on the unfairness of her teacher evaluation system, the cheating scandal in DC schools, and her decision to fire a principal on TV.

This is the sort of real debate sadly absent from NBC's Education Nation and US television in general, which treats Rhee with kid gloves. 


Get Adobe Flash player

Sunday, August 7, 2011

Protections against institutional cheating in NYC schools

Spurred by reports of widespread cheating on standardized tests in Atlanta; Washington, DC; Los Angeles; Pennsylvania; and elsewhere, New York State Education Commissioner John King announced last week the creation of a “high level working group” to address "the integrity of our testing system.” The Bloomberg administration responded that this was "a knee-jerk reaction to cheating scandals in other states."

Unfortunately, the announcement was marred by the state’s failure to reveal who was appointed to this task force. As the NY Post noted,
Oddly, the announcement came two weeks after the formation of the group, and department officials couldn't say who or how many people were on it other than Executive Deputy Commissioner Valerie Grey."
Indeed, there is a crying need for more systematic protections against cheating, which were eliminated when Bloomberg and Klein took office, as pointed out in our book, NYC Schools Under Bloomberg and Klein. Here is an excerpt from the chapter on "Institutional Cheating" by Sol Stern and Andy Wolf, showing how multiple procedures were in place previously – even before there was such huge emphasis placed on test scores:
Before test documents were destroyed, the Board [of Education] routinely conducted several levels of analyses to detect cheating. Robert Tobias, former director of testing and assessment for the BOE, provided us with the following summary of the board’s actions to screen for possible cheating:
“One was an erasure analysis that identified classes and schools with a high incidence of answers that were erased and changed from wrong to right. A second was a gains analysis that identified schools where students showed extremely high increases in test scores over the previous year. The third was an item analysis that detected unusual scoring patterns, such as large numbers of students who answered difficult questions correctly but easy questions incorrectly. In addition to these forensic analyses, we collected information on allegations of cheating from District Assessment Liaisons and other informants.
“When this information raised credible suspicion, we placed the respective test answer documents in secure storage, referred the matter to the Office of Special Investigations, and did not destroy the test documents until the investigation was completed. In other instances, we were directed to send the test documents to the State Education Department or the Special Investigator for the NYC Public Schools to facilitate investigations of cheating allegations referred directly to them. These procedures were in place when I retired from the public schools in Nov. 2001.”
It was also the practice of the old Board of Education to dispatch district administrators to each school on test days to oversee procedures. They would check on whether the tests were stored in a secure place in unopened cartons, observe the opening of the cartons and removal of the shrink wrap on the exams, and monitor the distribution and collection of the test materials. Finally they would oversee the delivery of the completed test papers to the district office.
All this was eliminated when Bloomberg and Klein took office. In a 2009 audit, the NYC Comptroller’s office concluded that the city Department of Education had “engaged in sloppy and unprofessional practices that encourage cheating and data manipulation.”

As to this new, rather mysterious state task force, one can hope that it will propose meaningful reforms, though there are many reasons to be doubtful. The NY State Education Department (NYSED) has in the past been known as the murky graveyard of whistleblower complaints, as ineffective as the endlessly inconclusive investigations of the NYC Department of Education, which tend to trail on for years, like a replay of “Waiting for Godot,” with little or no results.

Indeed, one might argue that having NYSED rely on an internal working group to guard against cheating is a little like Rupert Murdoch putting Joel Klein in charge of News Corp’s internal investigation into the phone hacking scandal: neither can be fully trusted to pursue this issue aggressively since they are fatally compromised by their institutional desire to look good; in this case, to show that schools are improving when there may be no actual gains.

Note the way in which NYSED and the Regents have just acceded to DOE’s demands to deregulate virtual (online) learning, with no attempt to provide any sort of oversight or quality control, and no requirement that students even attend classes to graduate.

Instead, the new regulations are a blank check, enabling DOE to continue and expand its fraudulent use of online credit recovery – deregulated by NYSED in 2009 --except that now, high school students won’t have to fail courses initially to gain enough credits to graduate through this substandard educational delivery system.

Jackie Bennett has analyzed how credit accumulation has soared in in recent years, just as it became one of the central components of DOE’s high-stakes accountability system, determining which schools will remain open and which will be closed:
In this city, the number of credits awarded to students in high schools truly is high stakes. It counts as nearly one third of each high school’s Progress Report grade, and the Progress Report counts for just about everything, including the removal of principals and the closing of schools. Since the Progress Reports were introduced in 2006-2007, the percent of students earning 10 or more credits each year has leapt a (truly) incredible 16 percentage points citywide. For schools with the highest concentration of high need students (the schools most likely to be threatened with closure) the jump is 18 points.
At the same time as credit accumulation and graduation rates have risen, the number of NYC high school graduates needing triple remediation (in reading, writing and math) at CUNY community colleges has doubled.

On this blog, we recently featured a post by a teacher revealing how credit recovery was used -- or misused -- in her school, after DOE coached her principal on how to implement it. See also here, and here, for even more cases of fraudulent online credit recovery -- which  flourish with the open encouragement of the educrats at Tweed.

Yet rather than attempt to put the brakes on this growing scam, last month the Regents and the NY State Education Department agreed to eliminate all controls on online learning, including any attendance requirements, allowing schools to give credits to students whether they come to school or not. There are no longer any class size limits as long as the course of study is undertaken under the general “supervision” of a teacher, who can “oversee” any number of students, according to the new regulations.

In the end, however, even if the state was really committed to preventing cheating, nothing is likely to work as long as our high-stakes accountability system remains in force. Campbell’s Law (which Steve Koss wrote about in our book, and as far back as 2007 on our blog) predicts that the more high-stakes testing is used for decision-making, the more cheating and gaming of the system is inevitable. As Bob Tobias pointed out in a recent interview,
the current emphasis on high-stakes accountability …encourages some people to do the wrong thing. So as you kick the stakes up, people are going to focus on the metrics that will be used to determine their fate. They’ll be looking for ways to elevate those metrics, and some people will try to take a short route.”
Yong Zhao, eminent professor at the University of Oregon, has explored the numerous ways in which the growing overemphasis on standardized exams is undermining our public schools. He used the proliferation of school cheating scandals as the jumping-off point for a brilliant five-part series on his blog, concluding that the nation’s public schools must “ditch testing.” In an interview with Education Week, he suggested that as an alternative, the country should move to a portfolio-based assessment system:
“You can’t fix this by changing internal security,” Mr. Zhao said. “If the stakes are so high that the teachers don’t even believe the measurement itself, they’re going to try to cheat.”

Tuesday, June 15, 2010

Did Alex Russo really say this?


In his discussion of the recent article in the NY Times about the reported increase in cheating in tests, the likely result of the intense pressure placed on teachers to improve scores, he wrote:

So: more coverage, but not necessarily more actual cheating. And no real case for causality, either, since so many of the tests kids take have little or no effect on their lives (or, I would argue, the lives and careers of most teachers and educators).

One really has to wonder what universe he's living in...




Tuesday, November 17, 2009

Grade inflation and lower standards at the DOE: what else is new?


Today, there were lots of articles about the inflated high school grades (the so-called “progress reports”) which turned out to be almost as inflated as those for elementary and middle schools. 75 percent of NYC high schools got As or Bs, and only one school got an F.
Yet as I pointed out to WNYC radio, more than half of our high schools are extremely overcrowded, with the largest class sizes in the state, and among the lowest graduation rates anywhere. According to the Daily News, at more than half of the schools that received the highest scores, less than half of the kids graduate with a Regents diploma.

Moreover, there seems to be a double standard and favoritism at Tweed. DOE says they will close down large high schools that did not do well, but the one high school that got an “F”, Peace and Diversity, will be provided with more help and resources. Is that because it happens to be a small school, founded in 2004? And the DOE has a vested interest in promoting the new small schools they helped start over our large high schools, those schools that in fact, their own policies have helped destabilize?

See the response in the Post by the Michael Mulgrew, UFT head: “Mulgrew also bristled at a chart produced by the city showing that the smaller high schools opened under Bloomberg since 2002 were faring better than others, even as several of the newer schools rated D's and the lone F.
"I don't like when you try to draw distinctions when you're responsible for all of the schools but you have a vested interest in trying to tell people that the schools you created are doing well," he said.”

Unfortunately, none of the articles make the connections between these grades, the threat of school closure, and all the cheating and grade tampering scandals that have erupted in high schools in recent years. And none make the point that the cut scores are arbitrarily decided upon by the administration – so in essence, the Chancellor and his minions decide ahead of time exactly how many grades there will be in each category, easily providing the DOE with yet another way to congratulate themselves while closing down certain schools to grab their real estate.

Most interesting is the following finding, from the NY Times: “The school environment grades, which are based on attendance and results of student, parent and teacher surveys, and make up 15 percent of the grade, showed the steepest decline. This year, 55 high schools received a D or an F in school environment, compared with 12 last year.”

What’s going on here? Are the pressures of the high stakes accountability system tearing our high schools apart? If so, it wouldn’t be altogether surprising.

Sunday, July 6, 2008

ELA and Math Test Scores -- Experts Question Increases

State test scores for 2008 can be found here (Math) and here (ELA)

An expert who serves as the State's top technical adviser on testing is concerned about grade inflation and has called for an independent study of this year's unusual and unprecedented rise in test scores across the state. Writing in the NY Sun, Elizabeth Green has the story here.

Elizabeth also has a disturbing story about cheating on the state tests here. An excerpt:

A sixth-grader at M.S. 201. said that a teacher once looked over his shoulder and said, "Ooh, is that right? Is that the right answer?" encouraging him to erase and try again.

Meanwhile, 11 of 12 P.S. 48 graduates interviewed last week said they were coached during the state tests.

They said that teachers would look over their shoulders and instruct them to try again and again until they got answers right.

"They'd be like, 'Is that the right answer?' — until they make sure it's right," a sixth-grader said.

"When I was at 48, I never went to class, and I still passed the test," a seventh-grader said. "If you go to graduation, you pass."

Higher test scores could pay off for M.S. 201's teachers this year. The school is one of about 200 participating in a trial project to give teachers bonuses if their students perform well on state tests.

The bonuses average $3,000 a teacher.


Under the Bloomberg administration, test results have been woven into a complex system of carrots and sticks where principal bonuses, teacher merit pay, school ratings, school budget bonuses, principal dismissals and school closings all hinge on test scores. It is not surprising that pressure to score high has lead to a culture of test prep, grade inflation and cheating.

Update: see the NY Sun for a properly skeptical oped about the sharp rise in NY State test scores.

Friday, October 26, 2007

Merit pay contagion strikes Tweed

Merit pay based on test scores, an even faster growing contagion in our school system than the drug resistant staph infection called MRSA, has now struck the Tweed building itself.

After offering more money to students, principals and teachers for good test results, according to NY Sun, the Chancellor has now asked
"a group of about 100 of his closest aides to draft performance goals they aim to meet by the end of the year. The goals will be monitored quarterly throughout this school year, in some cases by Mr. Klein himself. The conversations are preliminary thus far, but positive results could mean bonuses come June, the city official running the new program, Laura Smith, said yesterday.”

For some of these top executives, their goals are supposed to be based on more holistic measures – like principal satisfaction --but for some like Eric Nadelstern, head of the empowerment zone, they will be based on test scores and graduation rates alone.

So let me get this straight: if test scores improve enough in our schools, even if this leads to a ridiculous amount of test prep and/or cheating, and if graduation rates improve, even if this causes increasing numbers of students to be suspended, transferred or discharged from our schools, then the already overpaid officials at Tweed will get even more of our taxpayer money for being able to further degrade the conditions for authentic learning at our schools.

Now that’s accountability!