Federal

L.A. and Ariz.: Will Data Conflicts Spur a Chill Effect?

By Sarah D. Sparks — September 03, 2010 9 min read
Tamara Garfio supervises her 4th and 5th graders at Maywood Elementary School, which leads the Los Angeles Unified School District in student progress on standardized tests.
  • Save to favorites
  • Print

Never has there been more federal money or pressure for education scientists to partner with practitioners—from the U.S. Department of Education’s Investing in Innovation grants to the Institute of Education Sciences’ push for more classroom-level relevance in research.

Yet recent high-profile data-confidentiality fights in Arizona and Los Angeles have researchers worried that access to educators may become a difficult path.

At first glance, the two cases don’t appear to have much in common. In the course of a decadelong federal lawsuit over English-language-learner programs in Arizona, lawyers for state schools chief Tom Horne last month subpoenaed the raw data from three studies commissioned by the Civil Rights Project at the University of California, Los Angeles. In gathering the data, researchers from the University of Arizona, in Tucson, and Arizona State University, in Tempe, collected comments on teachers’ and administrators’ experiences with the ELL programs—some of them critical—and promised that the names of teachers, schools, and districts would be kept confidential. Some researchers protested the request, but Judge Raner C. Collins of the U.S. District Court in Tucson ruled on Aug. 19 that the names of schools and districts could be released, but not those of individual study participants.

Next door in California, a Los Angeles Times team obtained from the Los Angeles Unified School District seven years of student test scores linked to unique teacher-identifier numbers. Richard Buddin, a senior economist with the RAND Corp., helped the reporting team apply a value-added analysis to gauge the effectiveness of individual teachers based on their students’ test scores, yet he did not participate in the newspaper’s decision to match the identifiers to actual teacher names, which it released in a series of articles and a matching database last week.

In both cases, the release of data thought to be confidential has sparked firestorms in the research community and the public at large. The Los Angeles teachers’ union, which is also raising questions about the research methodology the newspaper used, has called for members to boycott the Times. And experts for and against the series continue to weigh in, up to and including U.S. Secretary of Education Arne Duncan, who called for more public sharing of teacher-performance data but also stopped short of urging districts to do it in the same way the Times’ did. In Arizona, Gary Orfield and Patricia Gándara, the co-directors of the Civil Rights Project, which commissioned the ELL studies, wrote a letter protesting Mr. Horne’s data request, and Mr. Orfield said they have received “appalled” phone calls from other researchers.

“It’s certainly not good news for us in terms of the research environment,” said Martin Orland, the director of evaluation and policy research for WestEd, which conducts studies with school districts nationwide. “The biggest problem is the perception problem. We never have directly identifiable information for students and teachers, … [but] if I was on the other side, no matter what people were saying to me, I would be real careful. It does make our work harder.”

Outdated Procedures?

Working with districts has always been a tightrope walk for researchers, between protecting privacy and disseminating useful—but sometimes controversial—results.

Researchers agree that access—be it to student data, interviews with teachers, or classroom observations—is both the most vital and most difficult part of education studies.

Jane Hannaway, the principal research associate and director of the Urban Institute’s Education Policy Center, said researchers “bend over backwards to provide protection” to school sources when collecting data. Yet she and Felice J. Levine, the executive director of the American Educational Research Association, agreed that research participants have become more protective of information.

“Over the last decade, increasing awareness that one’s data is available in a number of places and can be used by advertisers [and]can be accessible to employers … creates more of an inhibition about where one puts information and could be a similar inhibition to whether one participates in research,” Ms. Levine said.

Current federal privacy law covers neither situation. The Code of Federal Regulations for the Protection of Human Subjects delegates confidentiality decisions to university institutional review boards, or IRBs, but in Arizona, the IRBs released the full data over the researchers’ opposition.

“I think it’s tragic and very dangerous,” Mr. Orfield said. “I was shocked at the way the Arizona people went after this data and that the universities just went along with it. It really calls into question not just the access to schools but the integrity of the IRB process.” Mr. Orfield, Ms. Hannaway, and other researchers suggested researchers may need a federal shield law similar to state laws that protect reporters from being compelled to name sources. “We thought the IRBs served that purpose for us, but we were wrong,” Mr. Orfield said.

Four-year-old Neena Trummell clings to her father's leg as they tour Wilbur Avenue Elementary School in Tarzana, Calif. “If test scores will be used to evaluate teachers, then teachers will work on test-taking skills and the limited content on standardized tests rather than teaching the child,” says one teacher at the school of value-added evaluations.

Moreover, Ms. Levine said that protection procedures for researchers have not always kept pace with the rapidly expanding statewide longitudinal-data systems and federal education reporting systems, which could make public data, similar to what happened in Los Angeles.

Indeed, John Q. Easton, the director of the IES, which is the primary research arm for the federal education department, said the institute’s national centers on education statistics and research perform intensive tests on their databases to ensure outsiders cannot backtrack through the information to find individuals. Recently, Marilyn Seastrom, the chief statistician for the IES, started doing the same tests on the data reported on state websites—and occasionally found less-than-secure information.

“She worked like a hacker, like someone would to figure out if there was a way to get things out of the data,” Mr. Easton recalled. “I think there’s acute attention paid to [confidentiality] because of the prevalence and the huge volume of data that has become available and is consequential to people. People at IES think about this all the time, every day.”

Era of ‘Transparency’

Separately, both the IES and the AERA are working on new guidance for researchers on ways to protect confidentiality in the process of using state data systems and information provided through accountability reporting. Still, some researchers argue the next generation of confidentiality guidance should make data more public, not less.

“When we went down the road for human-subject protection, the object of this was to protect human subjects from bad stuff— protect their privacy, protect their informed consent—and for me, a lot of that stuff has just gone way too far,” said Mark S. Schneider, a former commissioner of the Education Department’s National Center for Education Statistics.

The Family Educational Rights and Privacy Act, or FERPA, protects data for students, but not teachers or administrators, and Mr. Schneider argued the latter two groups should not be given the same deference as students when it comes to offering confidentiality.

“I think that we want to be in an era with greater transparency,” said Mr. Schneider, now a visiting scholar at the Washington-based American Enterprise Institute. “I still believe if you are a public employee delivering a public service, maybe the expectations regarding privacy in your performance domain is a totally different question than your right to get my records from CVS [on health care]. That, to me, is a totally different privacy question.”

Mr. Orfield and Ms. Levine disagree. They argue that private-sector employees don’t face the same sort of public scrutiny now given to Los Angeles teachers, and while a school district superintendent may count as a public official, a teacher does not.

“I think it would really have a crippling effect on all social science, education, and health enquiry if public employees in the sector couldn’t be guaranteed the same confidentiality as any other research participant,” Ms. Levine said. She added, “In this economy, people are feeling pressed in a number of ways, and being a participant in a voluntary study is probably lower on one’s list of priorities than is providing for oneself and one’s children.”

Eric A. Hanushek, a senior fellow at the Stanford University-based Hoover Institution, said that the high-profile data releases will “almost certainly” make it harder for researchers to get information from teachers and schools. “On the other hand, I think it also demonstrates that more discussions ought to be had about how this information should be made more public. [Teachers’] performance will be subject to more scrutiny, but ultimately, I believe parents should have more access to the data.”

So far, Secretary Duncan seems to agree with Mr. Hanushek. In a speech Aug. 25, he defended the Times’ decision to release teacher names.

“I am a strong advocate for transparency,” Mr. Duncan said, arguing if he had the power, he would make public not only data tying teachers to student performance but student-attendance data to “hold parents accountable.”

“Let’s put out data on dropouts, college enrollment, college completion, loan-default rates, and every other kind of data that can help us highlight our remarkable success and help us better understand why too many of our children are unprepared,” Mr. Duncan said. “The truth is always hard to swallow but it can only make us better, stronger, and smarter. That’s what accountability is all about—facing the truth and taking responsibility and then taking action.”

Yet Mr. Duncan said districts and teachers should work together to find an official way to release sensitive data, rather than having it released as the Times did. He also acknowledged concerns voiced by many researchers that the biggest privacy problems may come from education decisions made by parents and community members “with a limited understanding of what this information really means.”

Mr. Schneider said as research becomes a bigger part of public education debates and more database information becomes available to the public, researchers have a greater responsibility to educate the public.

“The more public and the more visible the analysis, the more responsibility falls on the researcher. If I’m doing something that five scholars care about, fine; I can talk to them [individually],” Mr. Schneider said. “If I’m doing something that affects however many school kids are in LAUSD, … then I believe the researcher has a responsibility not only to talk to the five other researchers who understand how beautiful this model is, but the hundreds of thousands of parents in LAUSD who might be affected by these findings.”

A version of this article appeared in the September 15, 2010 edition of Education Week

Events

Artificial Intelligence K-12 Essentials Forum Big AI Questions for Schools. How They Should Respond 
Join this free virtual event to unpack some of the big questions around the use of AI in K-12 education.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Harnessing AI to Address Chronic Absenteeism in Schools
Learn how AI can help your district improve student attendance and boost academic outcomes.
Content provided by Panorama Education
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Science Webinar
Spark Minds, Reignite Students & Teachers: STEM’s Role in Supporting Presence and Engagement
Is your district struggling with chronic absenteeism? Discover how STEM can reignite students' and teachers' passion for learning.
Content provided by Project Lead The Way

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal Jimmy Carter and Education: Highlights of a Long Record on School Policy
The 39th president oversaw the creation of the U.S. Department of Education.
5 min read
President Jimmy Carter gets a round applause as he passes out pens at the White House in Washington, Oct. 17, 1979 following the signing legislation establishing a Department of Education. From left are: Dr. Benjamin Mays former president of Morehouse College in Atlanta, Rep. Jack Brooke (D-Texas), Carter, Sen. Abraham Ribicoff (D-Connecticut).
President Jimmy Carter gets a round of applause as he passes out pens at the White House in Washington, Oct. 17, 1979, following the signing of legislation that established a federal department of education. From left are: Dr. Benjamin Mays, former president of Morehouse College in Atlanta; Rep. Jack Brooke, D-Texas; Carter; and Sen. Abraham Ribicoff, D-Conn. Carter died on Dec. 29, 2024, at age 100.
Charles Tasnadi/AP
Federal Jimmy Carter's Education Legacy Stretched From the School Board to the White House
The 39th president helped create the U.S. Department of Education. He had also been a school board member and an education-minded governor.
19 min read
Former U.S. President Jimmy Carter waves to the congregation after teaching Sunday school at Maranatha Baptist Church in his hometown of Plains, Georgia on April 28, 2019. Carter, 94, has taught Sunday school at the church on a regular basis since leaving the White House in 1981, drawing hundreds of visitors who arrive hours before the 10:00 am lesson in order to get a seat and have a photograph taken with the former President and former First Lady Rosalynn Carter.
Former President Jimmy Carter waves to the congregation after teaching Sunday school at Maranatha Baptist Church in his hometown of Plains, Ga., on April 28, 2019. He died Sunday, Dec. 29, 2024, at age 100.
Paul Hennessy/NurPhoto via ZUMA Press
Federal White House Starts Scrapping Pending Regulations on Transgender Athletes, Student Debt
The Biden administration plans to jettison pending regulations to prevent President-elect Trump from retooling them to achieve his own aims.
6 min read
President Joe Biden delivers remarks on lowering prices for American families during an event at the YMCA Allard Center on March 11, 2024, in Goffstown, N.H.
President Joe Biden delivers remarks on lowering prices for American families during an event at the YMCA Allard Center on March 11, 2024, in Goffstown, N.H. His administration is withdrawing proposed regulations that would provide some protections for transgender student<ins data-user-label="Matt Stone" data-time="12/26/2024 12:37:29 PM" data-user-id="00000185-c5a3-d6ff-a38d-d7a32f6d0001" data-target-id="">-</ins>athletes and cancel student loans for more than 38 million Americans.
Evan Vucci/AP
Federal Then & Now Will RFK Jr. Reheat the School Lunch Wars?
Trump's ally has said he wants to remove processed foods from school meals. That's not as easy as it sounds.
6 min read
Image of school lunch - Then and now
Liz Yap/Education Week with iStock/Getty and Canva