Opinion
Federal Opinion

Why the U.S. Results on PISA Matter

By Eric A. Hanushek — January 07, 2014 6 min read
  • Save to favorites
  • Print

In 2012, 65 nations and education systems participated in the Program for International Student Assessment. These tests, covering mathematics, science, and reading, provide direct international comparisons of skills. Sadly for our nation, the recently released results are sobering.

According to PISA, the United States placed significantly below the average for member-nations in the Organization for Economic Cooperation and Development for mathematics—and significantly worse than the OECD distribution at both ends of the assessment spectrum, with more low performers and fewer high performers.

The U.S. math performance is not statistically different from that of Norway, Portugal, Italy, Spain, the Russian Federation, the Slovak Republic, Lithuania, Sweden, and Hungary—not the most sought-after group of countries for comparison’s sake.

More disturbing, U.S. students’ scores have been stagnant for the past decade. Since 2003, the United States has made virtually no gains, even as a range of countries made substantial ones.

BRIC ARCHIVE

The most rapid PISA gains were made in very low-performing countries, such as Qatar and Kazakhstan. Yet some higher-performing nations also made substantial advances: Israel, Singapore, Italy, Poland, and Germany. Poland, for example, steadily improved over the past decade and now ranks eighth within the OECD (14th among all 65 participating countries or education systems).

In the simplest terms, even among high-performing countries, change for the better is possible.

A number of commentators have tried to counsel ignoring the results, and their misleading arguments—These test scores really do not matter—warrant correction.

See Also

Read Robert Weintraub and David Weintraub’s counter-argument on PISA,

Why Arne Duncan’s PISA Comments Miss the Mark

Criticism One: We have a strong economy; in other words, we are not being pulled down by our schools.

Indeed, we have had strong growth over the 30 years since A Nation at Risk first warned that schools were endangering our economy. But we also have the world’s best economic system and institutions, and this has protected us from the deficiencies of our schools. It is also likely that we will not be so sheltered in the future and will have to rely on our skills (human capital).

My analysis, with Paul E. Peterson and Ludger Woessmann, shows that long-term growth is closely related to the skills measured by assessments such as PISA. From historical experience, the differences in potential economic outcomes from improvements comparable to those seen in other countries are many multiples of the total cost of the 2008 recession until now. Moreover, the increased taxes and greater government intrusion necessarily implied by continuing U.S. deficits and long-term imbalances of Social Security and Medicare will weaken our economic institutions.

At the same time, other countries have emulated many of the features of our economic institutions while producing improved human capital, which implies we may no longer be the world’s leader in innovation in the future.

In simplest terms, both top and bottom American students do poorly when compared with students in other industrialized countries.”

Criticism Two: The U.S. ranking is completely explained by poverty; we should be fixing poverty, not our schools.

Various (poor-quality) analyses have suggested that, because the United States has a higher poverty rate than other industrialized countries, our low international-assessment scores can be explained by poverty.

Indeed, in response to the PISA 2012 scores, the American Association of School Administrators (now called AASA, the School Superintendents Association) issued the following statement: “The problem we find in American education isn’t that schools are ‘falling behind,’ it is that schools are ‘pulling apart.’ Poverty in America is the real issue behind today’s education gap, and it means students can experience different education trajectories because of where they live.” This is the association of school superintendents, arguing that it is poverty and not their schools to blame for poor achievement.

But if the superintendents’ group is correct, the United States would turn out the same share of high-performing students as other countries. To the contrary, only 9 percent of U.S. students perform at the highest proficiency levels in math (Levels 5 and 6), far below the 20 percent to 30 percent performing at that level in countries such as South Korea, Japan, Switzerland, and the Netherlands. Canada turns out almost twice as many high fliers as the United States.

Moreover, if an income gap makes the United States unique, the percentage of American students performing well below proficiency in math should be higher in this nation than in countries with comparable average test scores. But that’s not the case.

Since 2003, the United States has made virtually no gains, even as a range of countries made substantial ones.”

We have the same average scores as the Slovak Republic, Lithuania, and Hungary. (Hardly a group we want to be compared with.) And, like those countries, about a quarter of our students performed well below proficiency in math. In simplest terms, both top and bottom American students do poorly when compared with students in other industrialized countries.

Criticism Three: Other things, such as grit, determination, and teamwork skills, are more important than cognitive skills.

While these noncognitive skills probably are important, the empirical evidence on economic outcomes remains thin. At the same time, we know that measured achievement has very high economic returns to individuals.

Recent work shows that the United States rewards high-level skills (as measured by international math tests) with greater earnings in the labor market more than any of the 22 other countries surveyed by the OECD. And, there is no evidence that having higher cognitive skills detracts from noncognitive development or skills. In fact, there is some evidence that they complement each other.

Interestingly, in confidence, U.S. students have always thought that they were above average and more self-efficacious in doing math problems—perceptions that belie their performance.

Criticism Four. We don’t really need any more skilled workers because we already have enough unemployed or underemployed college graduates.

Clearly, there is always some transitory unemployment as workers move across jobs and as some workers (even college graduates) find that their skills built on old technologies are no longer needed. But over the long run, the nature of production adapts to the available workforce. With a highly skilled workforce, technology tends to expand in ways that employ these skills. With lower levels of skills, industry expands on dimensions that do not need as many skills. But these expansions are generally not at the forefront of technology and historically have not seen growth in wages matching that in more skill-using technologies. Moreover, the modest proportion of Levels 5 and 6 students suggests that the future development of U.S. scientists and engineers will be constrained—a fact now evident in the demand in Silicon Valley for highly skilled workers educated abroad.

Some conclusions: First, the United States is not doing well. While our low ranking has been seen on earlier international assessments, there are many reasons to believe that low cognitive skills (as assessed by PISA) will be increasingly important for our economic future.

Second, by historical patterns, improving our achievement—which identifies the human capital of our workforce in the future—has huge economic ramifications. Getting to Canadian achievement levels translates, by historical economic-growth patterns, into 20 percent higher paychecks for the average worker over the entire 21st century. Not only could this solve our current fiscal and distributional woes, but it also could establish our future economic and international leadership.

Third, other countries have shown that it is possible to improve. While changing achievement might be difficult, there is ample evidence that it is critical to the U.S. future.

Related Tags:

A version of this article appeared in the January 08, 2014 edition of Education Week as Why the U.S. Results on PISA Matter

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Recruitment & Retention Webinar
Hiring, Retention, and Fill Rates: A Data-Driven Sub Strategy
Explore what keeps substitutes coming back and hear how one district rebuilt its substitute hiring process and improved its fill rate.
Content provided by Frontline Education
Early Childhood K-12 Essentials Forum Early Childhood Education: Building Essential Skills for Success
Join this free virtual event to examine the biggest challenges in supporting young children, from preschool through elementary school. 
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Absenteeism Webinar
Attendance Isn't an Attendance Problem
Boost attendance by strengthening relationships, belonging, and support with practical strategies from Doug Fisher & Nancy Frey.
Content provided by Corwin

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal Opinion What’s Behind the Trump Administration's Push to Reform Head Start?
Assistant Secretary Alex Adams explains the Trump administration’s approach to the early-ed program.
7 min read
The United States Capitol building as a bookcase filled with red, white, and blue policy books in a Washington DC landscape.
Luca D'Urbino for Education Week
Federal Ed. Dept. Would Have More Power to Cut Off Grants Under New Rules
The agency last year ended in-progress grants worth more than $2 billion, with courts often objecting.
5 min read
Jeanette Vyhanek, a counselor at Wellstone Elementary, teaches a class of kindergarten students at the St. Paul school on Oct. 31, 2025 in Minnesota.
Jeanette Vyhanek, a counselor at Wellstone Elementary in St. Paul, Minn., teaches a class of kindergarten students on Oct. 31, 2025. Federal grants to expand the ranks of school counselors and other school mental health services were among hundreds terminated by the Trump administration in 2025. New rules from the U.S. Department of Education would give the federal agency greater latitude to end in-progress grants.
Alex Kormann/The Minnesota Star Tribune via TNS
Federal Q&A Education Data Collection Has Cratered Under Trump. Can It Be Rebuilt?
Ed. Dept.'s data-gathering agency is too unstable to adapt to changing needs, a new report claims.
6 min read
A student raises her hand to ask a question in her third grade classroom at Highland Elementary School in Columbus, Kan., on Oct. 17, 2022. The arm of the government that oversees education data which tracks educational outcomes for students, faces major challenges ahead due to financial cuts.
A student raises her hand to ask a question in her 3rd grade classroom at Highland Elementary School in Columbus, Kan., on Oct. 17, 2022. Federal education data-gathering, like the Condition of Education report, includes baseline information on students and schools. But cuts to the Education Department's statistics wings and mounting criticism of how it operates raise questions about how it can best fulfill its mission.
Charlie Riedel/AP
Federal Education Department Tells Schools Race Can’t Factor Into Student Discipline
A letter to educators follows up on last month's rescission of longstanding discrimination rules.
5 min read
Assistant Secretary for Civil Rights for the Department of Education nominee Kimberly Richey testifies before the Health, Education, Labor and Pensions committee about her nomination in Washington, D.C., on June 5, 2025.
Assistant Secretary for Civil Rights Kimberley Richey testifies before the Senate's Health, Education, Labor and Pensions committee at her nomination hearing in Washington on June 5, 2025. A new letter to educators from Richey instructs schools not to consider race at all in school discipline policies, following the Trump administration's rescission of longtime anti-discrimination rules.
Jason Andrew for Education Week