Why are school reforms ineffective? Findings from a global study

The international consulting company McKinsey presented a report entitled "Ignite and Sustain: How School Systems Around the World Can Improve Learning at Scale." The document analyzes the causes of failure in educational systems around the world and offers solutions for improving the situation. The main focus is on the factors affecting the quality of learning and strategies that can help to improve educational processes at scale. It is important to take into account that in order to effectively improve the level of education, it is necessary to implement innovative approaches and methods, as well as the active participation of all stakeholders, including government agencies, schools, and families.

What issues does the report cover?

The new McKinsey publication analyzes the state of school systems around the world, taking into account the impact of the pandemic on education. The paper draws on data from the international PISA and TIMSS studies, as well as UNESCO and OECD statistics and the results of various scientific studies. The report presents key facts and conclusions about the impact of Covid-19 on educational processes and student achievement.

Primary education has become almost universal worldwide: by 2018, 90% of children were attending school.
Yet, most schoolchildren worldwide do not master even the basic skills of reading, writing, and arithmetic. McKinsey cites World Bank data showing that seven out of every ten students in low- and middle-income countries are unable to read a simple sentence by the end of primary school. In sub-Saharan Africa, the number of such students is even higher: nine out of every ten. According to PISA (a study that examines the knowledge and skills of 15-year-olds), secondary school performance is also not doing well: even in the decade before the pandemic, results in 17 countries had worsened by ten points or more, which is roughly equivalent to six months of schooling. COVID-19 has only worsened the situation, including in education systems that were previously considered exemplary, such as New Zealand, Finland, the Netherlands, and South Korea. Technological advances are increasing the complexity of school preparation requirements (for example, digital literacy has become essential), while potential economic losses due to poor education quality are also growing. The report estimates that the world will lose $1.6 trillion annually by 2040 due to pandemic-related learning disruptions alone. The fact is that poor learning outcomes at the early stages of education will lead to low professional competence and productivity. Furthermore, education appears to be increasingly failing as a social elevator. Even in countries where average scores on international tests are rising, they may conceal a significant gap in the academic performance of students from rich and poor families. According to PISA 2018 data, the report states that in a number of countries—France, Germany, Hungary, Peru, and Israel—the gap between the most privileged and the poorest students is so wide that it would require approximately four additional years of schooling to close it. By the 2022 survey, the situation had not changed much.

Revised text:

Study additional materials:

PISA 2022 results revealed six key factors influencing the decline in academic achievement. These factors play a significant role in shaping educational outcomes and require the attention of educational institutions and parents. Analysis of PISA 2022 data demonstrates that the conditions of the learning environment, access to resources, the level of student engagement, and the influence of socioeconomic status can significantly affect academic performance. Understanding these factors will help develop more effective strategies to improve the quality of education and achieve better academic results.

How McKinsey analysts explain the problems of schools around the world

McKinsey analysts investigated the reasons for the decline in the effectiveness of school education, additionally analyzing data from international surveys. More than 400 experts participated in the survey, including heads of educational institutions, representatives of education authorities and specialized non-profit organizations. In-depth interviews were conducted with 200 of these experts to obtain more detailed information.

Analysts confirm that education is actively developing around the world. Curricula and teaching approaches are constantly being updated, and new strategies for training qualified teachers are being developed. Work is underway to improve management systems and change examination formats. However, despite the number and diversity of innovations, it is difficult to predict whether these changes will lead to success in the development of educational institutions or lead to failure.

A comparison of the number of school reforms implemented since 2000 in countries with positive student performance trends and in countries with less successful indicators showed that the average number of reforms does not differ significantly. This suggests that the number of reforms is not always directly related to improved educational outcomes.

For example, since 2000, virtually all countries that have historically demonstrated high educational results have carried out three reforms aimed at improving teaching materials and programs, and one reform concerning teacher training. But this had no effect on the dynamics of school systems: with similar approaches, in some countries the results improved, while in others they stagnated or worsened.
Among countries with an average level of school education development, the most effective systems carried out fewer reforms, that is, they simply did not change anything.
And among countries with weak school results, on the contrary, the more successful ones have experienced more innovations over 23 years.

6 Reasons Why Education Reforms Fail

McKinsey experts concluded that problems with educational reforms arise from the order of their implementation, planning, and implementation stages. Surveys and interviews with representatives of educational systems identified six key reasons why new approaches fail to achieve the expected results. These factors play a critical role in the success of educational initiatives and require careful analysis to improve their effectiveness.

According to McKinsey research, 61% of survey participants note that differences in perception of the goals and objectives of school education are the reason for the ineffectiveness of reforms. This emphasizes the importance of unity of opinion among all participants in the reform to achieve the desired results in the education system.

The manifestation of an educational problem can take various forms. In some countries, funding for educational programs and reforms is insufficient, negatively impacting the quality of education. In other countries, there is a significant discrepancy in the understanding of educational goals between government agencies and practitioners working directly in educational institutions. This discrepancy can hinder the implementation of effective educational strategies and the achievement of high learning outcomes.

There is a situation where all participants agree on the goals of reforms, but their number is too great, and it becomes unclear which ones are a priority. For the successful implementation of reforms, it is necessary to identify key goals in order to focus on their achievement and avoid the dispersion of resources. A clear understanding of priorities will allow for more effective planning and implementation of changes, which in turn will increase the chances of reform success.

Forty-six percent of respondents reported problems in the education system. The system suffers from a lack of resources at all levels, which includes a shortage of qualified managers capable of effectively managing complex projects and conducting their analysis. There is also a shortage of technical specialists needed to implement and support innovations in schools. Addressing these issues is critical to improving the quality of education and developing educational institutions.

In international projects, countries often turn to foreign consultants. However, after completing the active phase of reforms, they face a shortage of qualified specialists, as their own personnel have not been trained. This poses a challenge for sustainable development and the further implementation of reforms, as reliance on external experts can negatively impact the country's internal capacity. The need to develop domestic personnel is becoming critical for the successful implementation and maintenance of change.

According to surveys, 42% of respondents reported problems encountered during the implementation of their planned reforms. This means that although the idea may be promising, its implementation often proves difficult due to the lack of clear project roadmaps, detailed budgets, and designated responsible persons. This results in uncertainty regarding expected results and the timeframe for their achievement. Because there is no immediate and obvious impact, many programs are discontinued. Innovations in educational institutions are often implemented through carefully designed plans, but on a limited scale, for example, in pilot schools. Such small projects are typically overfunded, making them impossible to scale up. As a result, the findings of such experiments cannot be applied to the broader education system, limiting their effectiveness and opportunities for improvement. Thirty-one percent of respondents noted problems in the management of educational institutions. The main difficulty is a lack of understanding of how to adapt reforms to real-world conditions. In the worst cases, education system leaders make no effort to integrate new initiatives into existing practices. Reforms are often introduced without clear explanation, leading to resistance from schools and families. This creates obstacles to the successful implementation of changes in the educational sphere.

Photo: Pixel-Shot / Shutterstock

Inconsistency in project management is a common problem. Administrators launch initiatives that align with their political goals, but these projects often stall when leadership changes. New leaders can undo unfinished changes, replacing them with their own ideas and strategies. This wastes resources and hinders the achievement of the organization's long-term goals.

Reforms do not always mean progress, as shown by the survey results, in which 29% of respondents noted that planned reforms often remain unchanged, even in the face of significant external changes, such as fluctuations in the economy and changes in the labor market. This underscores the importance of flexibility and adaptability in the reform process to meet current conditions and societal needs.

Numerous reforms covering various aspects of school life make it difficult to determine the effectiveness of each one. In such conditions, endless pilot projects do not lead to clear results, and it is difficult to identify those initiatives that truly deserve widespread implementation. Systematization of reforms is necessary to identify the most successful practices and ensure their implementation in the educational process.

Researchers from McKinsey noted that 26% of respondents face problems tracking progress. These difficulties can manifest themselves in different ways: a lack of reliable information on student achievements or insufficient discussion of the collected data in the professional community. As a result, the reform process becomes opaque and makes it difficult to assess their effectiveness.

How Experts Suggest Coping with Challenges

The report's authors recommend taking into account the characteristics of countries and regions that have recently demonstrated improvement in school education, based on the results of international research. This applies not only to leading education systems, but also to countries such as Malawi and South Africa in Africa, as well as the Indian state of Punjab, where student skills are still significantly below the global average. However, these regions are showing positive dynamics, while many previously successful countries are showing declining educational indicators. McKinsey analysts have identified common approaches to school policy that can be observed in places as diverse as Singapore, Norway, London, Peru, and Malawi. These approaches can form the basis for further improvement of education systems and enhancement of school quality in various countries.

The authors highlight four key strategies that need to be considered in education policy for the successful implementation of reforms. While these suggestions may seem obvious, their implementation is critical to achieving effective change in the education system.

Relying on approaches that have been scientifically proven to be effective;
Building coalitions for change with professionals at all levels of education and with students' families;
Preparing teams and resources for each stage of innovation implementation;
Evaluating progress following reforms not by eye, but using data.

The report also presents less obvious recommendations, the implementation of which is critical to the successful implementation of reforms. Failure to follow these guidelines may result in failures in the reform process.

Please read the following materials:

What the doctor ordered: the effectiveness of EdTech in schools

In recent years, educational technologies, known as EdTech, have become increasingly popular in schools. However, the use of these technologies is not always justified. It is important to understand when EdTech is truly beneficial and when its implementation may be ineffective.

EdTech can significantly improve the educational process by providing access to a variety of resources, interactive materials, and opportunities for personalized learning. Online learning platforms, educational apps, and interactive whiteboards can make classes more engaging and promote better learning.

However, it is important to keep in mind that not all technologies are suitable for every educational environment. Sometimes, overreliance on digital tools can distract students from the core learning process. Furthermore, a lack of technical support and teacher training on new technologies can lead to ineffective use of EdTech.

Therefore, it is important to carefully analyze the school's needs and select those tools that will truly help achieve educational goals. Effective implementation of EdTech requires a balanced approach that considers both the benefits and potential drawbacks.

The report's authors note that reformers often initiate changes at the top levels of the system, such as reorganizing education ministries, launching new school models, and implementing digital technologies. While these measures can be helpful, they act only as supplementary elements. Without high-quality teacher performance in the classroom, such initiatives will not lead to significant results. Effective education reforms should be focused on the real needs of the educational process and support for teachers.

Experts believe that the order of reforms should be organized as follows:

First, we change what and how children learn — primarily this concerns the quality of educational programs and the level of teacher training;
Then, the school environment is reformed, along with the resources and support available to students and teachers;
And only if everything is in order with the first two points, is it worth introducing innovations at the systemic level, including technological and managerial ones.

McKinsey experts emphasize the importance of choosing scientifically based approaches that correspond to the current level of development of a specific educational system. At the same time, it is necessary to take into account the unique characteristics and needs of each system, which will allow for the most effective implementation of new methods and practices. The correct choice of strategy helps improve the quality of education and achieve sustainable results.

Support for the work of teachers can take various forms. In systems with high results, the autonomy of schools and teachers has proven to be effective. However, in contexts where educational institutions face resource constraints, large class sizes, and insufficient teacher qualifications, strict adherence to established curricula and the use of pre-defined lesson plans becomes more appropriate. In such situations, freedom to experiment may prove inappropriate.

The report presents an analysis of actions that can become key to attracting, supporting, and developing teachers at various levels of the system's development.

Experts warn of the importance of basic 21st-century skills. They emphasize the need for a foundation of literacy and numeracy, as well as subject-matter knowledge. The introduction of new technologies and advanced skills, such as digital literacy, should not come at the expense of these fundamentals. Without a strong foundation, it is impossible to effectively develop more complex competencies.

Soft skills, such as self-regulation, have a significant impact on the learning process. Experts recommend mastering them within the context of familiar school subjects, rather than studying them separately. For example, self-regulation recommendations can be integrated into regular lessons, indicating to students how much time to devote to self-study and how to optimally organize this process. This will help students not only develop essential skills but also improve their academic performance.

The authors of the McKinsey report warn of the need for a cautious approach to the use of technology in the educational process. By 2023, numerous examples of failed digital reforms have accumulated that did not produce the expected results. Experts emphasize that modern tools and technologies should not overshadow the importance of basic skills and also warn against isolating students, who risk being left alone with screens. It is important to find a balance between innovation and traditional learning to ensure effective student development.

To successfully integrate technology into the educational process, it is important to select it in accordance with the set goals. It is necessary to consider programs that will help not only with the educational process but also with solving the school's administrative tasks. Be sure to consider conditions such as the level of access to gadgets and the internet. Technology should complement, not replace, traditional in-person classes. Experts recommend using artificial intelligence for prompt consultations during lesson preparation, checking assignments, and generating content. However, it is important to remember the need for expert review of the created materials to ensure their quality and compliance with educational standards.

Why are school reforms ineffective? Findings from a global study

Contents:

What issues does the report cover?

How McKinsey analysts explain the problems of schools around the world

6 Reasons Why Education Reforms Fail

How Experts Suggest Coping with Challenges