Contents:

Course with employment: "The profession of a Methodologist from scratch to PRO"
Find out moreProblem-based learning is widely used in universities around the world, and Also in the system of continuing professional education (CPE). The effectiveness of this method, namely the ratio of expected and actual results, depends on regular monitoring of the educational process and its improvement. Constant monitoring of learning allows for the identification of weaknesses and the necessary adjustments, which ultimately contributes to a deeper assimilation of knowledge and the development of skills in students.
Professor of Learning and Teaching at Maastricht University, Jeroen van Merienboer, emphasized this important aspect in his speech at the "Higher Education Research Conference 2021," organized by the National Research University Higher School of Economics. In his presentation, he shared key ideas regarding modern methods and approaches in the educational process. The main points of his presentation emphasized the importance of innovative teaching strategies, as well as the need to adapt curricula to the demands of the times and the needs of students. It is important to note that the introduction of modern technologies and teaching methods can improve the quality of education and prepare students for the challenges of the future.

Learn more about related topics:
Problem-based learning (problem-based Problem-based learning (PBL) is an educational method in which students learn by solving real or simulated problems. This approach emphasizes active student participation in the learning process, which promotes the development of critical thinking and problem-solving skills.
With PBL, students work in groups to analyze situations, explore various aspects of a problem, and develop solutions. This learning method allows not only for the acquisition of knowledge but also for its practical application, making the process deeper and more meaningful.
Problem-based learning promotes the development of collaboration, communication, and self-management skills, which is especially important in today's world, where teamwork and innovative solutions are key. Integrating PBL into curricula helps create a more dynamic and interactive learning environment that promotes better learning and prepares students for real-world challenges.
Why Analytics and the LAB-ID Model Are Needed
Van Merienboer shared information about the LAB-ID model, developed for the continuous improvement of curricula. This model, which stands for Learning Analytics Based Instructional Design, is an instructional design based on the analysis of educational data. The specialist emphasized that this approach allows one to evaluate how effectively learning tasks influence the learning process and its outcomes by testing the hypotheses established by program designers. Using LAB-ID can significantly improve the quality of educational programs and adapt them to the needs of students.
The emergence of LAB-ID is a natural continuation of two key trends in professional education: the introduction of teaching methods focused on solving practical problems and the development of blended learning. These areas contribute to improving the quality of the educational process and adapting it to the current demands of the labor market. LAB-ID aims to integrate theoretical knowledge with practical skills, enabling students to effectively apply acquired knowledge in real-world settings. Problem-based learning has been the subject of active research over the past 30 years. This category includes project-based and problem-based learning, as well as team-based and challenge-based learning. These methods emphasize the practical application of knowledge and skills, promoting a deeper understanding of the material. Project-based learning allows students to work on real-world problems, developing critical thinking and collaboration skills. Problem-based learning focuses on analyzing and solving specific problems, which promotes the development of analytical skills. Team-based learning emphasizes group interaction, and challenge-based learning motivates students to seek innovative solutions. These approaches are becoming increasingly popular in educational institutions, ensuring a high degree of engagement and learning effectiveness.
Van Merienboer identifies three key stages of development. These stages help understand the evolution of concepts and practices in various fields. Each has its own characteristics and significance, allowing for a more in-depth analysis of ongoing changes and their impact on the modern world. Studying these stages contributes to a more complete understanding of current trends and helps in predicting future developments.
- 1990s–2000s — Research on the effectiveness of problem-based learning. “There are special skills, 21st-century skills. And teaching methods of this kind are becoming effective [because] they help students [develop] the necessary skills for teamwork and collective problem-solving. This is an important advantage of methods based on problem solving,” noted van Merienboer.
- 2005–2015 — Researchers examined the components of problem-based learning and determined why it is effective and what makes it so. At the same time, the expert believes, it was during this period that it became clear that problem-based learning is specific – it cannot be copied and applied in any university in the world. "It has become absolutely clear that an effective higher education system must operate within its own context, it must develop with the participation of students and everyone involved in this process," he said.
- 2015 - present - Researchers are faced with a new question: how to design a problem-based learning program in a specific context. The answer to this question was the emergence of a four-component model, that is, 4C/ID.

The four key components of this model include:
- Learning tasks — problems, projects, challenges, cases, professional tasks. These, in turn, are divided into many smaller subtasks and built on the principle of "from simple to complex."
- Supporting information — the main theoretical material that helps work on tasks. This can be lectures, textbooks, articles or research, useful examples.
- Timely information — material that students receive in the process of working on tasks.
- Partial practice — routine tasks that help bring skills to automaticity and develop skills.
The 4C/ID model, as noted by van Merienboer, is aimed at improving the quality of education and focuses not on the activities of the teacher, but on the actions performed by students. The effectiveness of this model is supported by research showing that its application significantly impacts learning outcomes, particularly in the context of higher education, as opposed to basic education, i.e., school.
The second trend in education is the introduction of blended learning methods that combine face-to-face and distance learning (blended learning). This concept has gained particular popularity during the pandemic, and universities have actively adapted to the new conditions. Van Merienboer emphasizes that, when properly organized, blended learning can achieve significant flexibility in educational programs, which allows for a better response to student needs and improves the quality of learning. Effective use of technology and interaction methods contributes to a more dynamic and adaptive educational environment.
The combination of a task-centered approach and a blended learning format contributes to its effectiveness. All the necessary prerequisites for the successful implementation of this method already exist. However, one issue remains that must be addressed to achieve the best learning outcomes.
We have deep expertise in the development and implementation of educational programs, as well as in improving their effectiveness and flexibility in higher education. Our goal is to use integrated teaching methods, combining various techniques to achieve the best results. We are constantly working to improve our training programs, but we currently do not effectively assess their quality, which hinders our ability to continuously improve.

Read also:
To higher educational institutions A new learning model, HyFlex, is being implemented. This format combines elements of traditional and online learning, offering students the flexibility to choose how they participate. HyFlex allows students to simultaneously attend lectures both in the classroom and remotely, which is especially relevant in today's educational environment.
Importantly, HyFlex meets students' needs by providing the opportunity to study in a format that is convenient for them. This approach helps increase accessibility to education, which is especially important during the pandemic and the spread of distance learning. The HyFlex model allows institutions to adapt to the changing demands of students and the labor market, ensuring high-quality education for all.
By implementing the HyFlex format, educational institutions can improve interactions between faculty and students and create a more inclusive educational environment. This is an important step towards modernizing education, opening up new horizons for effective learning and student development.
Why Traditional Quality Assessment Methods Don't Work
Assessing the quality of a course seems like a standard procedure. However, as van Merienboer notes, the data typically used for this purpose is not always effective and reliable. For adequate assessment, it is necessary to use more reliable criteria and methods that will provide an objective picture of the quality of the educational process.
As an example, he points out:
- Grading system. Scores are sometimes linked to specific learning objectives, but scores are difficult to define and fill with truly valuable information.
- Student assessment of learning. Students, the expert explains, sometimes don't know what is useful for them. Moreover, they are often focused on the teacher's behavior, can be biased, and therefore are often unable to assess the real quality of both the teaching itself and the knowledge acquired.
- Peer assessment. Although this is a valuable tool for assessing the quality of education, external expert groups do not always have sufficient information or a complete understanding of how a particular task affects the overall learning process and its outcomes.
Blended learning significantly simplifies the process of data collection for instructional designers. Now information on how students master a course and complete assignments is available in real time. This enables the use of dashboards—visualized data that demonstrates student progress, the development of their subject-specific skills and competencies, and their level of satisfaction with the learning process. Using such tools makes analysis more effective and helps improve the quality of the educational process. Course performance indicators can be useful for faculty and instructional design teams to optimize curriculum. This process is iterative and involves creating a continuous cycle of improvements to the learning materials. It is important to regularly analyze data in order to adapt the course to the needs of students and improve the quality of learning.
He noted that improvement indicators concern the overall course and are not intended to adapt the program to the needs of individualized learning, as envisaged in the ADDIE model.

Read also:
Designing higher education using the ADDIE model in accordance with Federal State Educational Standards (FSES) requires a careful approach. The ADDIE model, consisting of the stages of analysis, design, development, implementation, and evaluation, allows for the creation of high-quality educational programs that meet current requirements.
Analyzing students' educational needs and expectations is the first step in the process. It is necessary to take into account both general educational and professional standards. At the design stage, it is important to create a course structure, integrating elements stipulated by the FSES, which will ensure the educational program meets state requirements.
The development of educational materials should be based on modern teaching methods and technologies. Course implementation includes the use of active learning methods, which promotes deeper assimilation of the material and the development of critical thinking in students. Finally, during the evaluation phase, it is necessary to regularly check the quality of the educational process and its compliance with standards, which allows for timely implementation of necessary changes.
Thus, the application of the ADDIE model in the design of higher education ensures the creation of effective, modern educational programs that comply with the requirements of the Federal State Educational Standard.
How data is used at Maastricht University
Professor van Merienboer calls the deficiencies identified during training "indicators of improvement". Work on their identification continues at Maastricht, and several interesting examples can already be identified. Although they are related to medical education, their principles can be applied to other areas. It is important to understand that such indicators not only point out deficiencies, but also open up opportunities for further development and improvement of the quality of the educational process.
When completing complex and comprehensive tasks, it is important for students to apply a systematic approach to achieve effective results. For example, as part of a simulation, students may be faced with the task of quickly diagnosing a "virtual" patient suffering from a life-threatening illness. In this case, they must use the ABCDE method, known in medical practice for providing emergency care. This sequence of actions helps identify the problem and take measures to eliminate it. To evaluate the systems approach to solving such problems, a hidden Markov model can be used, which allows for a more accurate analysis and improves the quality of decisions.
An indicator of improvement in this context is the absence of a systems approach to assessing the patient's condition. This indicates that the process of diagnosis and health monitoring is becoming more flexible and adaptive, allowing for the individual characteristics of each patient to be taken into account. Improvement in patient assessment can be achieved through the implementation of new methods and technologies that facilitate more accurate and timely detection of changes in health.
If a student's level of systems thinking is low, this indicates the need to amend the course or assignment to facilitate the process of systems thinking. You can implement certain constraints that prevent the student from moving on to the next step until the previous step is completed. You can also increase the amount of instructional guidance during the task. For example, adding notifications or pop-ups can remind the student to complete the current part of the task before moving on to the next.
Students often use a common strategy for learning theory, which is to reread the text repeatedly. While this may create the illusion of comprehension, as van Merienboer notes, this approach does not promote active recall. Active recall involves the ability to retrieve the necessary information from memory at the right time. For effective learning, it is important to use more active methods, such as self-testing and discussing what is being studied with others, which actually helps to reinforce knowledge and improve understanding of the topic.
The effectiveness of self-checking in learning is confirmed by expert van Merienboer. He cites a study conducted at East Tennessee State University (USA), which involved first-year pharmacology students. They were asked to take an online quiz to test their knowledge; however, the quiz was not graded. Importantly, during the quiz, students were not allowed to copy information from their browser to find answers. Correct answers counted, but incorrect answers were only shown the question itself and all answer options, without a link to the correct one. The study's results showed a significant correlation between the number of self-check attempts and exam performance: students who took quizzes more often performed better on the final exams. This highlights the importance of regular self-assessment as a tool for improving learning effectiveness.
According to According to van Merienburg's research, successful students use self-checking more often than less successful students. This technique can serve as a predictor of the likelihood of achieving high exam results. Self-checking promotes deeper learning and improves the level of preparation, which in turn is reflected in final grades.
If students do not use self-checking frequently enough, it is necessary to look for ways to change the learning approach to motivate them to use this method. This can be done by making self-checking mandatory or by teaching students effective strategies. It is important to consider not only the frequency of self-checking but also its timing. Many students begin self-checking two days before an exam, whereas this process should begin from the very beginning of the course. Ideally, self-checking should be conducted regularly throughout the learning process.
Students often do not realize the benefits of self-checking, so van Merienburg and his colleagues began informing students about the benefits of this approach. In Maastricht, students were given the opportunity to develop exam questions for their peers, which became an important element of the self-assessment process. This collaborative work not only promotes better learning but also develops critical thinking and collaboration skills. The introduction of these methods allows students to approach their studies more consciously and improves their academic performance. Students often underestimate the importance of self-assessment and revision for achieving high academic results. Many do not believe that these methods are truly effective. However, in practice, they can significantly improve academic performance. The professor emphasizes the need to clearly demonstrate to students how regular self-assessment contributes to their improvement. This will change their perceptions and convince them of the importance of these learning strategies. Medical students are often faced with diagnostic tasks, and to successfully complete these tasks, they need to gather as much information about the patient as possible. However, students sometimes rush to conclusions, making decisions before collecting all the relevant information. This can lead to misinterpretation of data or the collection of irrelevant information. Effective diagnosis requires attentiveness and the ability to analyze information, which is a key skill for future physicians. Therefore, it is important to develop data collection and analysis skills to make informed decisions based on a complete picture of the patient's condition.
At Maastricht, students complete all assignments online, allowing instructors and supervisors to monitor progress and the data being considered. It is important to ensure complete data collection to prevent students from making decisions without all the necessary information. If a student has not collected all the relevant data but is close to completing an assignment, it is recommended to use various methods, such as mnemonic devices, to prevent premature termination. This will help ensure the quality of assignment completion and enhance retention.
Each course is unique, resulting in varying improvement indicators. However, self-assessment provides a universal tool for assessing progress. This method allows participants to self-assess their achievements and identify areas for improvement, which promotes deeper understanding of the material and increases learning effectiveness. Blended learning and task-centered learning methods are widely known approaches, but course evaluation remains a significant challenge, considered a weakness. There is an urgent need to link specific learning activities to expected learning outcomes and student performance. This information is essential for continuous course improvement. Learning analytics and the improvements based on them can significantly support the process of ongoing evaluation and refinement of curricula. It is important to pay attention to the quality of assessment to ensure the maximum effectiveness of educational activities.
Revised text:
Also study:
- 5 opportunities that big data opens up for higher education
- New competencies of teachers: how Russian universities are implementing pedagogical design
- How universities have stopped being afraid of distance learning and how this relates to the quality of education
- How to measure the quality of educational experience in EdTech

