Showing posts with label NAEP scores. Show all posts
Showing posts with label NAEP scores. Show all posts

Monday, October 24, 2022

Surprisingly little change in NAEP scores for NYC students compared to NYS & nation; & NCES finds no link between school closures and scores

The NAEP results were released today for every state and many large urban districts.  Unsurprisingly, given the disruptions to learning due to the pandemic,  most states saw significantly declines in all four areas tested:  4th and 8th grade reading and math.  The declines in math were especially large.  

In NYC, 4th grade math scores dropped but so did 22 other districts; and somewhat surprisingly, there was no significant change in NYC scores in the three other categories: 8th grade math, 4th grade reading or 8th grade reading.

NYC scores declined less  than many other districts and better than NY state as a whole, which showed significant drops in all four areas, including 4th grade math and reading, as well as 4th & 8th grade math.

You can check out the data for reading and math.  

Especially given the bitter and ongoing controversy over school closures and remote learning, here is the quote of the day from NCES Commissioner Peggy Carr: 

 “There’s nothing in this data that tells us that there is a measurable difference in the performance between states and districts based solely on how long schools were closed."

 Below is a pdf copy of screenshots captured off today's NCES online webinar, with titles I've added focusing on NY State and NYC results.  Comments welcome. 

Tuesday, April 10, 2018

Latest NAEP scores reveal a "lost decade" of corporate reform with no improvements for NY or NYC

Image result for NAEPs 


The 2017 results of the low-stakes national exams called the NAEPs were released late last night --- showing that across the country, student achievement has stalled over the past decade, except for a slight increase in 8th grade reading, while test score gaps between low and high performing students have widened.  As the Wall Street Journal reported, "American students had nearly flat results in math and reading on a national exam, continuing a pattern of stagnation over most of the past decade, as some of the lowest performers fell further behind."

The results are a huge rebuke to wrongheaded corporate reform agenda of high stakes testing, charter expansion and Common Core standards that prevailed over this period and that was supposed to lift all boats, lead to more equity and more learning.

Over the last four years, in New York state and NYC, the story is much the same. There have been no significant increases in any subject or grade since 2013, except for a sharp decline in 4th grade math of five points in NY State and seven points in NYC. You can check the NAEP data yourself here, or a summary here.

All this goes to show that my 2016 blog post was correct that the increase in state and city test scores over this period was illusory and that we had entered a new era of state test score inflation. Let's hope this puts an end to the endless Groundhog days of state and city officials holding self-congratulatory press conferences, and articles that assume the rise in test scores is real and could be due to charter school expansion or the Common Core. But I wouldn't count on it. It's too easy for educrats to manufacture signs of improvement when there are none.

Sunday, September 19, 2010

My unvideotaped debate with DOE's Suransky re NCLB, testing, and NYC's dismal results

On Wednesday, September 15, I was invited to New York Law School to debate Shael Suransky, NYC's Deputy Chancellor for Accountability, about NCLB and the negative effects of high stakes accountability systems.

I also took the opportunity to rebut the claims of impressive progress in student achievement in NYC that DOE continues to make, even after the state test score bubble has burst, and to point out the many errors in Chancellor Klein's written statements concerning this issue.

Unfortunately, NY Law School did not allow Lindsey Christ of NY1 or Norm Scott of Education Notes to videotape the event, reportedly because of pressure from DOE.

Lindsey was quite annoyed, and said she had never been barred from taping any such forum, either at NYU, Columbia, the New School, CUNY or SUNY.

For more on what transpired, you can see Norm Scott's accounts here and here, and the email exchange between Lindsey, the very testy VP for PR at NY Law School, and me.

As many people have asked for it, I am posting my powerpoint here, part 1 and part II. If you would like me to present it to your organization, please email me at classsizematters@gmail.com


-- Leonie Haimson, Executive Director, Class Size Matters


Wednesday, December 16, 2009

NAEP 2009 Math Results Show Little Progress for NYC Schools

Last week, math scores for 2009 were released for the eighteen cities now participating in the NAEP Grade 4 and 8 Trial Urban District Assessment (TUDA) component, released bi-annually as “The Nation’s Report Card.” Operated under the aegis of the U.S. Department of Education and reported by their National Center for Educational Statistics, the NAEP’s are the only math and reading exams administered across the fifty states (reading test results are expected in Spring 2010). Given on a statistical sampling basis without high stakes consequences, these exams are generally considered the single best measure of national educational progress.

The Math results for 2009 were not the best of news for NYC. Among the eleven large cities who participated in 2007, only Boston and D.C. showed statistically significant gains in Grade 4 and only Austin and San Diego in Grade 8. No city declined, but the rest, including NYC, showed either no gains or gains sufficiently modest that they couldn’t reliably be attributed to real gains (as opposed to random chance). For NYC, these results stand in sharp contrast to the rather sizable gains in Grade 4 and 8 Math reported over the last two years via the NYS Grade 3-8 annual exams (on which School Progress Reports, grade retention, principals’ bonuses, and the Mayor’s political persona are based).

As reported in the local media (Jennifer Medina in the NY Times, Rachel Monohan and Meredith Kolodner in the NY Daily News, Yoav Gonen in the NY Post, and Beth Fertig at WNYC.org), NYC showed a one-point gain in average exam score in Grade 4 (from 236 in 2007 to 237 in 2009) and a three-point gain (from 270 to 273) in Grade 8. In addition, the percentage of Grade 4 students judged Proficient or better on the NAEP exam rose from 34% in 2007 to 35% in 2009; for Grade 8, the numbers were 22% in 2007 to 26% this year. By comparison, the NYS exams showed NYC Grade 4 proficiency or better increasing from 74.1% to 84.9% and Grade 8 moving up an astonishing 25 percentage points, from 45.6% to 71.3%. Comparable numbers since 2003 are shown below.

Grade 4 - % Proficient or Higher (Level 3+4 for NYS exams, Proficient + Advanced for NAEP)

2003 --- NYS 66.7% --- NAEP 21%

2005 --- NYS 77.4% --- NAEP 26%

2007 --- NYS 74.1% --- NAEP 34%

2009 --- NYS 84.9% --- NAEP 35%

Grade 8 - & Proficient or Higher (Level 3+4 for NYS exams, Proficient + Advanced for NAEP)

2003 --- NYS 34.4% --- NAEP 21%

2005 --- NYS 40.8% --- NAEP 21%

2007 --- NYS 45.6% --- NAEP 22%

2009 --- NYS 71.3% --- NAEP 26%

The inflation in all the NYS-based numbers naturally suggests that NYS/NYC students’ mathematical knowledge is nowhere near what is claimed by NYSED and NYCDOE.

This hardly comes as a surprise to most; it largely reflects the inherent fallacy of the NYSED’s testing regime, whose high stakes under NCLB have been substantially amplified under mayoral control of NYC schools until test prep and teaching to a specific test have come to dominate math teaching in the city. Nevertheless, measuring NYC’ students’ mathematical progress against the NAEP’s does suggest that, at least at Grade 4, both sets of scores are moving upward in some degree of encouraging lockstop. The picture in Grade 8 is far different and far more gloomy, particularly viewed within the framework of the huge reported gains in 2008 (14 percentage points, to 59.6%) and 2009 (another 11.7 percentage points, to 71.3% as shown in the table above).

These latest NAEP results offer a highly reliable reality check on the claimed math gains of NYC public school students. At Grade 4, the NAEPs suggest that the NYS test results have a degree of validity with regard to progress, although the 50-percentage-point gap on achievement is a major contradictory indicator of mastery level. At Grade 8, the NAEP’s paint a truly worrisome picture of a 45-percentage-point achievement gap and almost no measured progress in six years on the NAEPs during a period when NYC results on State exams signal gains bordering suspiciously on miraculous.

More disconcerting still is the realization that the 2009-year Grade 8 students who took these latest NAEPs are the first "pre-high-school end products" of the NYC public school system under Joel Klein and mayoral control during the six-year period (2003 - 2009) since the TUDAs and mayoral control both began.

Michael Bloomberg’s campaign for his third mayoral term was predicated in no small part on his claims to be NYC’s “education mayor” as justified by NYS exam scores and a host of other DOE self-generated statistical measures. In my next posting, I will delve much more deeply into the NAEP’s raw data to compare NYC’s progress since 2003 against the nine other large cities who have participated in TUDA since that time and also reveal how many of the DOE’s (and Mayor’s) claims are simply not supported by the only truly independent measure of NYC public school education currently available.

Tuesday, November 10, 2009

More blatant charter school propaganda

The hype around the charter school, Harlem Village Academies, has been extraordinary.

The school has been featured on NBC Nightly News and many other media venues. The CEO, Deborah Kenny, spouts all the usual cliches: the school's success is based on running it “like a business”, the school supports “great teaching” and has a “culture of accountability.” She also calls Bloomberg a “godsend” for education. One thing is for sure, Kenny is paid like a corporate executive, according to the the blog Schools Matters.

Be sure to check out the hugely deceptive video below from an Oct. 15 segment of the MSNBC show, Morning Joe. Joe Scarborough begins by showing headlines from that morning's NY Times about NY State's lack of progress on the math NAEP exams, also called the Nation's report card, which called into question the validity of the sharp increases of NY students on the state math exams.

But then Joe goes on to say “However, but its not all bad news: for example 100% of the eighth graders at NYC’s Harlem Village Academies are proficient in their math skills."

At the same time, a graphic is displayed with the name of the charter school, stating that 100% of its students scored proficient in math, compared to 34% in the nation. At the top of the blackboard the words “the Nation’s Report Card” are featured, implying that both sets of results are from NAEP.

Yet the 100% figure for this charter school were from the NY state exams – which the NAEP results had just revealed to be hugely inflated! And the 34% is the national average for proficiency on the NAEPs – whose results are far more reliable and whose standards are much higher.

Whether this deception was promulgated by Kenny or was just sloppy reporting on the part of MSNBC, who knows. But at no time did Deborah Kenny try to correct the misimpression created by Joe Scarborough’s remarks or the visual displayed on the screen. I guess she earned her 420K salary that day.

Monday, October 13, 2008

Broad Prize: Politics and PR or actual achievement?

The Broad Prize will be awarded on Tuesday, which NYC won last year, despite protests from parents and others that this award was undeserved.

See, for example, the statement from Dave Quintana last year. Dave was one of four parents selected by DOE to give input to representatives from the Broad foundation beforehand:

As one of the four (4) parent participants in a focus group held at Tweed for researchers from the Broad Foundation, I am disappointed in the fact that NYC received the Broad Foundation prize today.

This group of parents, handpicked by Martine Guerrier of the Department of Education (DOE), expressed uniform disappointment with the various changes put into place by DOE, the lack of transparency and accountability, and the lack of consideration given the views of parents about what their children really need to succeed.

Clearly the Broad Foundation did not take parents views into consideration when awarding this prize to NYC today.

See also the letter of protest signed by fifty one parents and teachers, sent to the Broad Foundation before the award was announced.

Since that time, Steve Koss has analyzed NAEP scores between 2003-2007 showing that NYC came in 11th out of 12 urban school districts in terms of gains.

There was also no closing of the achievement gap in NYC in the NAEP scores over this period, either in math or in ELA, for any grade level tested.

The NAEPs are considered the “gold standard” of assessments in terms of reliability.

As for the NY state scores, there was no narrowing of the achievement gap if scale scores are considered.

According to its website, the Broad Prize is awarded each year "to honor urban school districts that demonstrate the greatest overall performance and improvement in student achievement while reducing achievement gaps among low-income and minority students."

How can anyone be assured that the decision to award the Broad Prize is not determined more by politics and PR than actual improvements, and that this year’s winner deserves it more than NYC did last year?

Update: Brownsville won the Broad award, though it has been on the NCLB failing list for two years. Of course, NYC is on the NCLB failing list as well, as are most of the urban school district in the nation. Yet another reason to get rid of NCLB -- and the Broad awards as well.

Wednesday, January 23, 2008

Is holding back kids really the solution to our middle school problems, or is the Mayor running out of even bad ideas?

Last week, in his State of the City address, the Mayor announced that the Department of Education will now extend the policy of holding back students on the basis of their test scores to 8th graders, in addition to the third, fifth, and seventh graders who already face this prospect. This could mean the retention of an additional 18,000 students next year. Clearly, in terms of their educational policies, the administration has run out of even bad ideas.

As research and experience show, holding back kids doesn’t work. More than one hundred leading academics, researchers, and national experts on testing signed our letter opposing the administration’s proposal to retain third graders back in 2004, saying that basing promotional decisions on standardized tests is not only unfair, given the unreliability of a single exam, but also leads to lower achievement and higher drop out rates. (Check out a copy of this letter.)

Among those who signed our letter to the Mayor included Dr. T. Berry Brazelton, Dr. Ernest House, who did the independent evaluation of New York City’s failed retention program in the 1980’s, four past presidents of the American Education Research Association, the chair of the National Academy of Sciences Committee on the Appropriate Use of Educational Testing, and several members of the Board on Testing and Assessment of the National Research Council. Even the two largest testing companies are on record that the decision to hold back a child should never be based upon test scores alone. Indeed, the professional consensus is so clear about the negative effects of this policy on students’ academic and emotional health that it amounts to educational malpractice, according to Prof. Shane Jimerson of the University of California.

Nothing has changed since then.In fact, if this policy had worked, the administration’s policy of holding back third, fifth and especially seventh graders would have caused a rise in eighth grade achievement. Instead, as revealed by city’s results on the national assessments called the NAEPs, test scores in these grades have been stagnant or declining.

See for example, these dynamite charts, prepared by the Annenberg Institute for a new report called "Our Children Can't Wait" about the problems of our middle schools. (Click on the graphs to enlarge them). The one below shows that NYC had the largest decline in 8th grade ELA scores of any urban school district tested. The one above shows that NYC is the only city where this decline occurred among both black and Latino students over the last four years.

In reality, nearly every parent (or teacher) who's looked seriously at NYC middle schools realizes that their number one problem is huge class sizes.

In these grades, we expect a lot from our students. We expect them to learn how to read and analyze complex literature, to write essays and research papers, to master computational skills and begin algebra. All this, when their bodies, their relationships, and their sense of self are in rapid transition. Yet our schools offer none of the intellectual or emotional support that students need during this crucial time.

Instead, our middle schoolers are crammed into the largest classes in the state, and some of the largest in the entire industrialized world. Class sizes average 26-27, and one fourth of students are in classes of 31 or more – even in many failing schools. As a result, teachers are simply unable to provide these students with the support and attention they need, either in class or with their homework.

Even those who were thriving and motivated up to this point begin to become disengaged, disillusioned and fall behind. Here are the words of one parent:

“For both her elementary and middle school years, my daughter had wonderful and dedicated public school teachers. At one of the better middle schools in the city, she had 38 kids in her class. Each teacher taught four classes. With almost 150 students, how can one teacher be expected to prepare lessons, teach class, grade papers and have time left to focus on the individual child? My daughter's grades weren't the highest or the lowest. She fell into the vast middle, as do the majority of kids.”

“At her middle school, my daughter was utterly lost and very unhappy. She was forgotten. No not forgotten, never known. It is a crime that at this crucial turning point, when adolescents are searching for an identity to call their own, they are tossed into huge classes with no one who has the time to see them as individuals.”

Yet this administration refuses to take affirmative steps to make sure that our middle schoolers are better known to their teachers, even in the face of a new state mandate to reduce class size. Instead, the new policy to hold back more 8th graders will likely cause classes in this grade to grow even larger, as students are increasingly stalled at this level, prevented from moving on into high school. Frustrated by their lack of progress, and by their inability to get the help that they need, many will eventually drop out.

It’s a shame that this administration won't act to improve the opportunities for our children to succeed, but rather insists on increasing the chances that they will fail.