Showing posts with label targeted support. Show all posts
Showing posts with label targeted support. Show all posts

Tuesday, February 5, 2019

Many questions remain as to the reliability of the state’s new list of struggling schools and why some schools were taken off the list and others not

On January 17, 2019, Commissioner Elia released a new list of “struggling” schools under the new accountability system created by the state to comply with the Every Student Succeeds Act, that replaced NCLB in 2016.  As an article in Chalkbeat explained,

Eighty-four of the city’s schools are on the lowest rung — known as “Comprehensive Support and Improvement Schools” — and will be required to craft improvement plans approved by the state. The remaining 40 schools are only in need of “targeted” support and will face less intense oversight.

Yet the state formula used to develop this list of struggling or CSI schools is complex, confusing, and unreliable. Moreover, the Commissioner exempted certain schools that would otherwise have been identified as CSI schools through a decision-making process that is opaque.

Thirty-eight in NYC and 84 statewide were designated as “good standing #”, meaning according to the spreadsheet that their “Accountability status is based on a finding by the Commissioner of extenuating or extraordinary circumstances”. Why certain schools were taking off the list of struggling schools by the Commissioner due to “extenuating circumstances” and others were not is nowhere explained.

There were at least two very controversial issues that repeatedly were raised by parents, teachers and advocates during the hearings and comment period that preceded the adoption of the ESSA state plan. First was how opt out students would be counted, which is an especially critical issue since about 20% of the state’s eligible students in grades 3-8 have opted out of the state exams every year since 2015.

NYSAPE, Class Size Matters and other groups opposed the state plan to count these students as having failed on the state exams – and instead proposed a different system, called Opportunity Learn index, which would measure whether schools provided their students with the conditions for success.
If test scores had to be used, as the federal law required, then we recommended that the scores of opt out student scores should be assumed as average for that school and their subgroup.

The state rejected our proposals, however,  and instead adopted a complex formula that incorporates two variables – one called the Weighted Average Achievement Index, which counts opt out students as having failed in terms of test score proficiency, and another called the Core Subject Performance Index, which removes them from the formula entirely.  These two variables are combined to create a Composite Performance Level, in a mathematical process that is difficult to understand. [See this memo that attempts to explain how the two variables will be combined.]

Sure enough, at least two highly regarded NYC schools, Brooklyn School for Collaborative Studies (BCS) and Central Park East One (CPE1) both designated by InsideSchools as “staff picks".  A letter sent by BCS school leaders to parents pointed at that "for the first time, New York State used a formula for calculating proficiency on the state tests where students who did not take the exam counted at the lowest level for schoolwide accountability to generate a Composite Performance Index.  At BCS last year, …76% of parents opted their children out of the Middle school exams.”

They added that BCS serves 36% students with special needs, much higher than the city average, and that while “incoming students have, on average, lower 5th grade Math and Reading levels than the city …  Our internal data shows that all students make progress every year at our school, even if they are not yet at grade level standards.”

Similarly, CPE 1 is well-respected as the oldest public progressive school in NYC. About 80 percent of its students boycotted the state’s English and math exams last year – which makes any attempt to evaluate the school’s quality on the basis of its test scores untenable.  In fact, both these two school earned above average “impact” scores from DOE of  0.55 and 0.51 respectively, which attempts to adjust for the racial, ethnic, disability and poverty level of its students.

An op-ed by Tish Doggett and Kaliris Salas-Ramirez, parents with children attending these two schools, argued that the NY State Education Department privileged narrow indicators such as scores on state exams while ignoring factors such as their students’ racial and socioeconomic background, which affect test scores and absenteeism  and these measures that profoundly affect the accountability status of a school. They proposed a more holistic alternative for assessing schools: “When will we measure whether a school meets state mandates for art and music? How small (or large) class sizes are? The number of guidance counselors and sports teams available? Whether there is a library?”

NYC schools were not the only ones to protest their CSI designations.  In a letter sent to Associate Commissioner Ira Schwartz, Michael J. Hynes, the superintendent of the Patchogue-Medford School District on Long Island, called the CSI list an "abomination" and demanded answers to why five of his district’s elementary schools were on the list, despite his appeal and the fact that only 10-20% of students at these schools took the state exams.  “I have several questions that need to be answered before we possibly move forward with any next steps.  I also need answers about what happens if, as a school district, we choose NOT to move forward with the nonsensical requirements associate with this false designation.”

In a statement to the community, Hynes related that he appealed to “SED a few weeks ago when we found out our schools were potentially going to have this ridiculous designation. Earlier this week we heard our appeal was denied. I’d like to know why our appeal wasn’t accepted…and I’m just finding out that several others were approved. I’m thankful other schools were approved based on “extenuating or extraordinary circumstances”. I believe ours should as well.  It should be public knowledge since this list is.”

Another controversial aspect of NY State’s accountability formula relates to how high schools with four-year graduation rates lower than 67% would be rated—especially in the case of transfer schools, which enroll students who are already overage and under-credited by the time they enter these schools.

Many parents, teachers and students from the transfer schools flooded the state hearings, to beg the Commissioner to give their schools special credit for having saved them from dropping out altogether, by offering them small classes and the personal attention and close support that they had been unable to receive in their previous high schools. [See the account of the Brooklyn hearings here, and Manhattan hearings here.]

In a joint letter written to Commissioner Elia and Chancellor Rosa on July 10, 2017, state and city officials maintained that applying the same standard to transfer schools would be harmful and unfair:
We are deeply troubled by the New York State Education Department’s (NYSED) intention to designate all transfer schools that have a 6-year graduation rate below 67% as failing schools. We believe that the State’s proposed plan will greatly limit the ability of transfer schools to carry out their mission of supporting NYC’s most vulnerable students.

So we took a closer look at how the new accountability standards assessed NYC transfer schools and found that these schools were nearly four times more likely than non-transfer schools statewide and citywide to be designated as needing comprehensive support.

They were also five times more likely to receive “good standing #”, meaning they were removed from the struggling schools list based on the Commissioner’s decision that there were of “extenuating circumstances.” It is still unclear what those specific circumstances were, and why some transfer schools were taken off the list and others not.

In the table below, we outline the accountability status and the percent of schools statewide, citywide, and NYC transfer schools that received each type of designation.

Table 1. Accountability Status for Schools Statewide, Citywide, and NYC Transfer Schools

18-19 Accountability Status for School

% of schools statewide
(4280 schools)

% of all NYC schools
(1492 schools)

% of all NYC transfer schools
(50 schools)

CSI
(Comprehensive Support and Improvement)
5.6%
5.4%
20.0%
GS
(Good Standing)
89.5%
89.5%
68.0%
GS#
(Good Standing #)
2.0%
2.5%
10.0%
TSI
(Targeted Support and Improvement)
2.7%
2.1%
2.0%
TSI#
(Targeted Support and Improvement#)
0.2%
0.5%
0.0%
Closing
0.1%
0.0%
0.0%
# - Accountability status is based on a finding by the Commissioner of extenuating or extraordinary circumstances. Data drawn from 2018-2019 Accountability Status Report. Charter schools not included in analysis. Data available here: http://www.p12.nysed.gov/accountability/essa/documents/AccountabilityStatus2018-19.xlsx

Commissioner Elia had promised last year that she would take the special status of transfer schools into account when considering whether to put them into Receivership, which can involve radical changes in governance and staffing:

“As a result of this adjustment, schools that have been identified as being among the lowest performing for more than three consecutive years are placed under Receivership. Alternative schools (e.g., Transfer high schools and Special Act schools) will not be automatically placed into Receivership; instead, the Commissioner will work with the district, should any alternative school be identified as among the lowest-performing for more than three consecutive years, to determine the most appropriate interventions for that school. " (page 111)

However, the disproportionate number of NYC transfer schools on the CSI list questions Commissioner Elia’s commitment to acknowledge and respect the special nature of these schools. Without more transparency, it is impossible to know why certain transfer schools were given special dispensation and others were not, as listed below.


NYC transfer schools that received “CSI”:


  • Bronx Arena High School
  • Bronx Regional High School
  • Brooklyn High School for Leadership and Community
  • Jill Chaifetz Transfer High School
  • New Directions Secondary School
  • North Queens Community High School
  • Olympus Academy
  • Providing Urban Leaders Success in Education High School
  • South Brooklyn Community High School
  • West Brooklyn Community High School

NYC transfer schools that received “Good Standing #."
  • Bronx Haven High School
  • Brooklyn Frontiers High School
  • English Language Learners and International Support
  • Liberation Diploma Plus
  • Research and Service High School

Friday, January 18, 2019

NYSED releases a new list of supposedly struggling schools in need of support - including those removed from this designation by the commissioner


Last evening, Commissioner Elia released a new list of schools and whether they are in good standing, or identified for Comprehensive support (supposed to be applied to the lowest 5% of schools, according to the formula used in NYS ESSA plan) or targeted support (supposed to be applied to the lowest 10% of schools.) 
The full list and more info is available here.  Schools identified for comprehensive support will receive an unspecified amount of  extra money from the state to self-evaluate and implement their choice of  “evidence-based” improvements from a list of options supplied to by NYSED, as explained in Chalkbeat here:
Eighty-four of the city’s schools are on the lowest rung — known as “Comprehensive Support and Improvement Schools” — and will be required to craft improvement plans approved by the state. The remaining 40 schools are only in need of “targeted” support and will face less intense oversight.
The lowest-performing schools were identified partly because they were in the bottom 10 percent of schools across the state on a combined measure of growth and proficiency on state tests — the biggest factor that went into their rating. For the first time, state officials also took into account science exams, progress on a test taken by English learners, and rates of chronic absenteeism.
At the high school level, graduation played a big role, and any school that did not graduate 67 percent of its students within six years was automatically identified. New measures of college and career readiness were also factored in.

Five of the NYC schools identified as needing comprehensive support (CSI) schools are charters: New Visions Charter High School For Humanities II, New Visions Aim Charter High School II, New Dawn Charter HS, Opportunity Charter School, and New Visions Charter High School For Humanities II.
How schools’ opt out rates figure into their identification is unclear, according to the official account offered by Ira Schwartz of NYSED.
One measure of achievement, called the Weighted Average Achievement Index, assumes opt out students were level ones, another called the Core Subject Performance Index excludes opt out students from the calculation altogether.  Then the two measures are combined to make a Composite performance level in a manner that is so confusing way I cannot understand it.  [If you can, please explain below.]

112 schools statewide that might have been identified as either CSI or TSI schools were moved into the “good standing” category are designated as GS# - meaning  Accountability status is based on a finding by the Commissioner of extenuating or extraordinary circumstances.” 
  
Forty-one of the schools moved into good standing are in NYC, including three charter schools -- Urban Dove, Lindsay Wildcat Academy and New Visions Aim Charter 1.  One district --  District 22 --  was also moved into the good standing category by the Commissioner, presumably after an appeal by the Chancellor.  (Someone should ask the Chancellor about this.)  

To the right and above are the only NYC districts in Good standing  - meaning they have no schools needing comprehensive support. The list of struggling schools and districts is surprising in many ways.  Several schools are identified as needing Comprehensive support despite the fact that all their student subgroups are listed as in good standing, which I don't understand either.

Comments welcome below.