Wednesday, April 13, 2011

L.A. UNIFIED RELEASES SCHOOL RATINGS USING ‘VALUE-ADDED’ METHOD

The approach focuses on how much progress students make year to year rather than measuring solely their achievement level. Parents are likely to be surprised.

By Jason Song and Jason Felch, Los Angeles Times | http://lat.ms/f8fslp

Supt. Deasy

Los Angeles Unified School District Supt. John Deasy at Quincy Jones Elementary School in January. (Irfan Khan / Los Angeles Times)

April 12, 2011, 7:23 p.m. - In a dramatic turn for the country's second-largest school district, Los Angeles Unified released school ratings based on a new approach that measures a school's success at raising student performance — the first in a series of high-stakes moves that will thrust the district into the center of the national debate over education reform.

Next month, the district will take the more controversial step of providing thousands of teachers with confidential ratings of their performance using the same approach, known as value-added. The district is also negotiating with the teachers union to include such measures in teachers' formal performance reviews, an effort the union bitterly opposes.

The new measure of academic success has been a top priority for incoming Supt. John Deasy, who formally takes over Friday. It comes as districts throughout the country are wrestling with the reliability and the proper use of the value-added approach, which estimates school and teacher performance by analyzing students' improvement on standardized tests in math and English.

The district has had the data to conduct its own analysis for years but had never done so. Officials have said their adoption of the approach was hastened by a Times series and database released in August that rated elementary schools and about 6,000 elementary school teachers according to their value-added scores. The paper will release an updated database with the scores of 11,500 elementary teachers in the coming weeks, and later this year plans to expand it to include middle schools.

» Teacher Response

If you have taught third through fifth grades in the Los Angeles Unified School District, you may be in our database, and we invite you to comment on your value-added score. To get started, please type your first and last names in the box below. To ensure that comments are included when the scores are published, please respond by April 14.

The Los Angeles Unified School District's new school performance measure is likely to surprise many parents, who have traditionally compared schools — and at times purchased homes — based on the state's Academic Performance Index, which rates schools on a 1,000-point index based mainly on their students' abilities on standardized tests.

The value-added approach focuses on how much progress students make year to year rather than measuring solely their achievement level, like the API, which is heavily influenced by factors outside a school's control, including poverty and parental involvement. Value-added analysis compares a student with his or her own prior performance, largely controlling for outside-of-school influences.

Because value-added is based on standardized test scores, most experts agree it should be one of several measures to determine school or teacher performance.

Some critics say the value-added approach is too volatile to be used for teacher evaluations, but most experts say it is more accurate for campuses because it is based on the performance of hundreds, if not thousands, of pupils.

The district's ratings, dubbed "Academic Growth Over Time," can send parents a very different signal about a school's performance. Take, for example, 3rd Street Elementary School in Hancock Park, which has an API score of 938, putting it among the highest-scoring schools in the district. Under the new growth measure, 3rd Street is one of the lowest-performing elementary schools in the district.

"We've got to do a better job and reexamine," said 3rd Street Principal Suzie Oh, adding that she was shocked by the results.

Parents can view the new school ratings Wednesday for elementary and middle schools in math and English, and ninth grade for English only, on the district's website. L.A. Unified officials have said they will use the school and confidential teacher ratings to determine if students are making expected progress and if teachers need help. The school score will be included in future campus report cards.

2cents smf: As of this posting (Wednesday 8 AM) the data is not yet online.

The link above – and the link from the District website – leads the reader not to information on the LAUSD website but to data from an organization called Battelle for Kids http://bit.ly/g1Pq2B– a Columbus Ohio based consulting/advocacy/public relations group funded by the Gates Foundation (among others) committed to Transforming American Education by the “Right” People, Practices, Measures and Messages. [The quotation marks around the adjective “right” is the Battelle corporate style]

Battelle Memorial Institute (Battelle) is a 501(c)(3) charitable trust headquartered in Columbus, Ohio.Battelle manages or co-manages seven national laboratores for the U.S. Department of Energy and the U.S. Department of Homeland Security and a nuclear energy lab in the United Kingdom.

No matter what the two Jasons write in the their self-promotional reporting, the Academic Growth over Time (AGT)  Value-Added assessment methodology  is substantially and fundamentally different from the Times’/Jason’s test-score-only methodology.

  • One is a measurement of progress/growth/improvement over time
  • The other is based on a single test taken on a single day.

Because AGT is skewed to measure improvement it unfairly makes the performance of currently high-performing schools – like 3rd street – look poor. 

But…. If public education is a beauty contest it is better to be the winner with the tiara than the “most improved” runner up. - smf

Deasy presented the approach to the Board of Education on Tuesday. It was greeted with some excitement, some confusion and some skepticism.

"How do we not get obsessed with testing and test scores?" asked board member Steve Zimmer.

Board member Richard Vladovic later said, "I think this is going to be a great tool to help parents."

Members of the teachers and administrators unions raised no objections at the meeting to the school-level ratings.

But A.J. Duffy, outgoing president of United Teachers Los Angeles, said in an interview that he suspects that administrators will use the new information punitively.

Duffy and other union leaders have said they will not agree to a new teacher evaluation system that includes student test score data because they believe it is unreliable and will narrow the curriculum.

The district scores are based on an analysis conducted by a nonprofit research group affiliated with the University of Wisconsin, which has a three-year, $1.5-million contract with L.A. Unified. The group has also worked with public school districts in New York City, Chicago and Milwaukee.

The district and The Times used a largely similar statistical approach to develop ratings but made some different decisions about which variables to include. The rankings are also presented differently. A Times analysis of the elementary school ratings under the two methods found a roughly 90% correlation between the results, and district officials agreed there was a large degree of overlap.

No comments: