Evidence-Based Education: How to Find Research

Contents:

• Briefly about the main thing: what to look for?
• Search
• Selection
• Implementation

In this article, we will take a detailed look at the key aspects of the topic, which will be useful for understanding and application. We will analyze the main points and provide useful information so that you can master the material in more depth. Stay with us to gain the maximum knowledge on this issue.

• What is evidence-based education;
• Where and how to look for scientific research;
• How to avoid falling for the bait of frankly bad scientific work;
• What to consider if you decide to implement a method from a scientific article in practice.

The evidence-based approach is becoming one of the key trends in the educational sphere, including in Russia. In modern pedagogical master's programs, the emphasis is shifting not only to teacher training, but also to the development of researchers. The Ministry of Education is actively increasing funding for scientific research in pedagogical universities, which contributes to the development of educational science and improves the quality of specialist training. This allows for the creation of more effective educational programs based on research results and evidence.

The term "evidence-based education" emerged in English-speaking countries in the 1990s. This approach is borrowed from the concept of evidence-based medicine, as both fields strive to apply methods whose effectiveness is confirmed by scientific research. Ideally, educational methods should demonstrate their effectiveness in multiple independent experiments. Thus, evidence-based education aims to implement practices that ensure the best learning outcomes, based on objective data and research.

Evidence-based education generates active debate among specialists. Proponents of this approach emphasize its importance for improving the quality of education. However, critics argue that the adaptation of medical methods in the educational field is carried out incorrectly. Unlike clinical trials, where unwanted side effects of new drugs are carefully monitored, in education, an analysis of the potential negative consequences of pedagogical innovations is often neglected. Some researchers even question the applicability of medical science methods, such as meta-analysis, in the context of educational practices. This necessitates a more in-depth study and adaptation of evidence-based approaches taking into account the specifics of the educational environment.

It is undeniable that educational practitioners need to be aware of scientific research in their field. EdTech developers, authors of new teaching methods, and specialized blogs strive to support their ideas with evidence-based citations. However, for this to be truly beneficial, it's important to be able to find research and separate valuable work from low-quality. The ability to critically evaluate sources of information and select reliable studies is key to ensuring the effectiveness of educational practices.

Briefly: What to Look For?

Research can be defined as the systematic study of a specific topic or problem with the goal of gaining new knowledge. In the modern scientific world, the primary format for presenting research results is the scientific article. This is a specialized text published in peer-reviewed scientific journals whose editors are experts in the relevant field. Before appearing on the pages of such publications, an article undergoes mandatory peer review, during which at least two independent specialists evaluate its content, methodology, and significance. This process ensures the high quality and reliability of scientific information, making peer-reviewed articles an important source of knowledge for researchers and practitioners.

The structure of a scientific article includes several key elements that help to effectively present the research. The introduction should clearly describe the topic, purpose, and significance of the study, and formulate the main hypotheses. The methodology is a detailed description of the methods used to collect and analyze data, which allows for the replication of the results. The main body of the article contains a discussion of the results, their interpretation, and comparison with existing research. The conclusion summarizes the results, highlighting the contribution of the work to the scientific community and possible directions for future research. Proper presentation of each element of the structure contributes to a better perception and evaluation of the scientific work.

A modern scientific article has a clearly structured form known as IMRaD, which stands for introduction, methods, results, and discussion. The introduction includes a review of previous research, highlighting the findings of other scientists on the topic. A separate section describes in detail the methods used in the study, which allows other researchers to replicate the experiment. The results of the study are also highlighted in a separate section, where the obtained data are presented. Finally, in the discussion section, the authors interpret the results, explaining their significance and impact on existing theories and practice. This structure promotes clarity and logical presentation of information, which facilitates the comprehension and analysis of scientific work.

The content of an article within the template structure varies depending on the scientific discipline, topic, and chosen research methods. Education covers a wide range of topics, which leads to a variety of styles and approaches in writing articles. This may be due to both the characteristics of a particular field of knowledge and the preferences of the authors. It is important to consider that each article should be adapted to the target audience and the objectives of the study in order to convey information as effectively as possible and attract the attention of readers.

• In quantitative research, the main thing is to analyze data using statistical methods. In education, quantitative research can be experiments (when scientists create an artificial situation, for example, in a laboratory), observations (data is collected from the real world), and various surveys.
• In qualitative research, the author focuses on a specific experience in all details. It is also conducted using various methods—a scientist can conduct in-depth interviews with a respondent or examine already published content.

Scientific articles form the foundation of scientific knowledge on a particular topic. Authors gradually summarize their research in books and dissertations, which contributes to a deeper understanding of the issue. Combining the work of different authors on a single topic, for example, in the format of a systematic review, makes the results more convincing. Such reviews provide interim results in the study of a topic, summarizing accumulated data and identifying key trends, which is an important step in the scientific process.

It's important to note that not all research meets rigorous scientific standards. Many digital platforms conduct surveys among their users, the results of which are used for PR purposes and appear in the news. Modern companies actively organize marketing research to achieve their own business goals, including analyzing consumer preferences and identifying their problems. If the results are interesting, they also become the subject of public discussion. In addition, some IT companies, having extensive data sets, share their analytics. Although all this is often labeled as "research" in news articles, in reality, it rarely has anything to do with a scientific approach.

Search

If you're interested in research confirming the effectiveness of spaced repetition for memorization, there are several approaches to starting your search. First, you can turn to scientific publications and articles on learning methods and cognitive psychology. Many studies show that spaced repetition significantly improves long-term retention and promotes deeper learning.

It's also helpful to study meta-analyses and systematic reviews, which summarize data from multiple studies and provide a more comprehensive understanding of the results. Look for studies that describe the use of spaced repetition in various educational contexts, such as language learning or test preparation.

Furthermore, studying expert opinions and applying their knowledge in practice can help you better understand how spaced repetition affects the memorization process and which methods are most effective.

Keyword searching in a regular search engine is one of the most effective methods of finding information on the internet. To achieve the best results, it is important to formulate queries correctly using relevant keywords. This can significantly reduce the time it takes to find the information you need and improve its quality. It is recommended to use combinations of words and qualifying terms to narrow your search. It is also worth considering the use of quotation marks for an exact match of a phrase and negative keywords to exclude unwanted results. This approach will help you quickly find the data you need and improve overall search efficiency.

Most links in search results lead to advertisements and media articles. However, specialized publications often offer links to specific studies. For example, an article on the forgetting curve may contain links to the results of spaced repetition experiments. If the information provided in the form of links to scientific publications is insufficient, consider alternative data retrieval methods.

To effectively formulate a search query in English, which is the international language of science, it is recommended to first check the translation of the term on Wikipedia or use tools such as Multitran and Reverso. Scientific terms in English may differ from literal translations of their Russian counterparts. For example, instead of a direct translation of "interval repetition", you should look for the established terminology "spaced repetition". This will help you get more accurate results and improve the quality of your information search.

A method for searching scientific news through aggregators

You can effectively search for current scientific news through aggregators. These platforms collect information from various sources and provide users with a wide selection of news on topics of interest. Aggregators allow you to quickly find recent studies, articles, and reviews, significantly simplifying the process of obtaining up-to-date information. Using such services saves time and helps you stay up-to-date with the latest scientific advances.

To narrow your search results to scientific studies, it's worth turning to specialized portals. Sites such as ScienceDaily and EurekAlert post press releases from universities and news from journalists about the latest research. Many scientific journals, including major publications such as Nature, Science, and PNAS, publish abstracts of articles in accessible language. In Russia, current research can be found on the Open Science aggregator and in specialized popular science media. Searching scientific literature databases is an effective method for obtaining up-to-date and reliable information. Using specialized databases such as Google Scholar, PubMed, or Scopus, researchers can find articles, dissertations, and other scientific publications that match their needs. These resources allow you to filter results by various criteria, such as publication date, author, or research field, greatly simplifying the search process. Furthermore, access to full-text articles and the ability to review reviews and citations make this method especially valuable for scientists and students. Proper use of scientific literature databases can significantly improve the quality of research and ensure the reliability of the data obtained. One of the most popular free databases is Google Scholar. For searching English-language scientific articles, you can use resources such as Dimensions and Microsoft Academic Search. When searching for Russian-language publications, it's worth paying attention to Google Scholar and the Russian Science Citation Index (RSCI), although access to the RSCI requires registration. These databases provide links only to scientific papers, which makes them indispensable for researchers and students.

The advantages of using specialized databases over aggregators are that you get more than just a single news item interpreted by the author A press release or journalist, but an entire network of scientific articles. You can open an author's profile and explore their other publications on a given topic, as well as see which scientists cited the article in their work and what they wrote. This approach allows you to find much more information than simply using keywords. However, it should be noted that such databases will not provide simplified summaries of articles.

Scientific publications are an important aspect of scholarly communication and come in various types, each with its own unique function. The main types of scientific publications include original research, reviews, brief communications, and methodological articles. Original research presents primary data and results obtained through experiments or observations. Review articles summarize existing research on a particular topic, providing readers with a holistic understanding of the current state of science. Brief communications contain compact research results that can be useful for quickly familiarizing themselves with new findings. Methodological articles propose new methods or improvements to existing ones, allowing scientists to improve the effectiveness of their research. Distinguishing between these types of publications facilitates a more accurate understanding of scientific information and helps researchers select appropriate sources for their work. It is important to remember that each publication must undergo peer review, which ensures the quality and reliability of the data presented. The proper use of scientific publications, as well as their competent interpretation, play a key role in the development of science and education.

A scientific article differs from other types of publications in several ways, and not just in its location. First and foremost, the authors of scientific articles are researchers with official academic degrees, as evidenced by their affiliation with scientific and educational institutions, information about which is always included in the article. Publication in a scientific journal requires not only standard editing but also peer review, which significantly reduces the likelihood of errors, although they cannot be completely eliminated. Other types of scientific publications, such as monographs, research reports, and conference abstracts, also undergo peer review. An exception are preprints—texts of unpublished scientific papers for which the authors alone are responsible. Thus, a scientific article is an important tool for communicating knowledge and research results, ensuring a high level of reliability and scientific rigor.

Let's say you've found several articles that interest you. However, at the beginning, you only see links to them, not the full texts. Most scientific articles are only available for a fee on journal websites. This closed nature of taxpayer-funded scientific publications has long raised criticism and legitimate questions about the accessibility of knowledge. Initiatives and movements exist that call for open data and free access to scientific information, which makes science more transparent and accessible to all interested parties. Publishers continue to face pressure from open access advocates, and legal methods for obtaining the full text of paid articles remain limited. The most accessible, copyright-compliant options include checking author profiles on scholarly networks such as ResearchGate and Academia, as well as on the websites of universities and research institutions where they work. These sources, as well as preprint archives in the fields of education and social sciences, offer preliminary or even final versions of articles of interest. Using these resources allows researchers and students to legally access scholarly publications. Connecting with scientists opens new horizons for the exchange of knowledge and ideas. Establishing contacts with experts in various fields of science allows for a deeper understanding of complex concepts and current research. Interacting with scientists helps develop critical thinking and foster a scientific approach to problem solving. Don't miss the opportunity to ask questions, participate in discussions, and receive valuable advice from professionals. This not only broadens your horizons but also strengthens the scientific community.

If the title and summary of the article interest you and seem useful, try contacting the primary author directly and requesting access to the text. While there is no guarantee of a response, there is a chance the author will share the article if your email is received well. Scientists are generally willing to share their knowledge and research.

Selection

Determining the reliability of scientific articles is not an easy task. If it were easy to distinguish high-quality research from an article with manipulated data, incorrect plagiarism, or poor methodology, scientific journals would not be faced with the need to apologize for previously published materials. In reality, there are many retracted scientific articles, leading to the creation of specialized databases to track them. Recognizing falsification in scientific publications is not easy, but there are certain tools and criteria for assessing their validity. It is important to consider these parameters to draw an informed conclusion about the quality of the research.

To evaluate a scientific publication, you can use the SCImago Journal Ranking or the open list on the Scopus website. These platforms rank journals based on the number of citations their articles receive from other researchers. The higher the number of citations to articles, the more significant and influential the journal that publishes them is considered. This allows researchers to select journals with a high level of scientific impact for publishing their work.

The eLibrary platform presents a variety of journals, mainly Russian publications, which are also included in the RINTS database. Each journal's rankings in prestigious international databases such as Web of Science and Scopus, as well as in the RSCI core, are listed. This allows users to assess the scientific significance and citation impact of each journal, an important aspect for researchers and authors. A journal's lack of inclusion in reputable databases does not necessarily indicate low quality. Take a look at the website and look for a few red flags.

• no publisher information;
• no editorial board information;
• false information about indexing in databases (for example, the journal is not listed in Scopus, but the publication's website states that it is);
• article abstracts, keywords, and author information are not posted;
• published articles show that the text has not been edited - for example, they contain many typos.

Unhealthy productivity is a warning sign. It may indicate physical or mental health issues, as well as ineffective work practices. Often, excessive productivity leads to burnout, reduced quality of work, and a deterioration in overall health. It is important to learn to find a balance between completing tasks and caring for your own well-being. Productivity must be sustainable and healthy to contribute to successful work and long-term development. Paying attention to your body's signals and finding harmony in your work will help avoid negative consequences.

Look out for obvious signs of a publication's indiscriminateness. If it publishes a large volume of materials—for example, 50 issues with 300 articles per year, where research in the field of pedagogy coexists with biotechnology—this should raise your suspicions. Although the development of the internet has given rise to large online journals covering a variety of topics, among them you can find both "predatory" journals—publications that publish any material for a fee without proper verification—and peer-reviewed journals such as PLOS One and Scientific Reports, which have a high reputation. However, most educational publications are not such mega-journals and often suffer from a lack of rigor in the selection of publications. Therefore, it is important to carefully evaluate the source of information and its authority, especially in the educational field.

To fully evaluate the methodology of scientific work, it is important to have a deep knowledge of the relevant field, although this is sometimes not enough. The average reader can only verify that the article's conclusions are well-founded and not arbitrary. It is recommended to pay attention to the following aspects:

• Any statement in a scientific paper must be substantiated. Therefore, even the introduction is always replete with references to previous studies. If you see a sweeping statement in an article without a clear indication of how and by whom this conclusion was reached, this is a reason to doubt the quality of the research.
• If the study is based on a survey or experiment, make sure that the participant selection appears adequate. A sample size that is too small (for example, conclusions about an entire university are made based on a group of 20 students) and its inconsistency with the study's purpose can be alarming. For example, the authors wanted to study young people's attitudes toward VR technology, but only second-year female students in the Psychology major participated in the experiment.
• Try to understand in general terms how the authors measure the parameters they evaluate in the study. For example, how do they determine whether students' understanding of the topic has improved after the introduction of a new method, and what exactly are they comparing the "after" result to. The authors' approach may not be the same as yours, but it's important that they explain it and justify why they chose the specific parameters for evaluation.
• Check whether the authors consider themselves omnipotent. Every study has limitations, because no experiment or survey reproduces all the complexity of the real world. A good article will indicate which situations and contexts the findings apply to, and which the study simply didn't cover.
• In general, openness is good form. If the author put forward three hypotheses at the beginning of the article, and only one of them was confirmed, while the others were neither yes nor no, this is an indicator of scientific integrity. A less scrupulous scientist would simply not write about unconfirmed hypotheses in the article. Some studies can also be pre-registered, in which case the scientists openly state what they intend to study and what hypotheses they put forward. Many also publish experimental datasets alongside their articles so that those interested can verify their calculations.

There are various factors that can reduce the credibility of an article published in a reputable journal, in addition to a non-representative sample. In an episode of the EdU.Radio podcast, Alexander Fenin, then head of the SberClass Product Research Center, proposed his approach to analyzing such publications. He noted that articles should be questioned if their authors:

1. Fail to cite data sources or use outdated studies.
2. Use manipulative methods of presenting information to attract attention.
3. Ignore the context of the study and do not consider alternative explanations.
4. Publish results that contradict generally accepted scientific findings without proper justification.

These aspects can significantly affect the quality and reliability of scientific articles, which is important to consider when assessing their reliability.

• are confident in the uniqueness of their research;
• devalue the work of opponents;
• make overly categorical conclusions and generalizations;
• overuse metaphors;
• intimidate the reader and make conspiracy theories;
• refer to works in support of their thoughts whose authors wrote nothing of the sort;
• uncritically refer to famous classic studies (for example, the Stanford Prison Experiment), the results of which are no longer considered reliable;
• reduce all social phenomena to biology or brain function.

If you need to compare your research findings with the opinion of an expert, but have no one to discuss them with, pay attention to who and How does the article you read cite? You can do this using Google Scholar and other scientific databases, where each article is listed with more recent publications that build on it. It is also helpful to study systematic reviews on related topics, available from resources such as the Campbell Collaboration or the What Works Clearinghouse. This will help deepen your knowledge and better understand the context of your research.

It is important to remember that everyone makes mistakes. Mistakes are a natural part of the learning and growth process. By acknowledging our mistakes, we open the door to improvement and development. The ability to accept criticism and revise your views contributes to personal and professional growth. Learn from your mistakes and use them as an opportunity for self-improvement.

Jane Bozarth, Director of Research at The Learning Guild, emphasizes the importance of being aware of your own biases in research. The vast scientific literature makes it easy to find articles that support your point of view, but any opposing views may be dismissed as low-quality or fictional, often with reference to predatory journals. This cognitive bias, known as confirmation bias, highlights how your intentions can influence search results and the evaluation of research articles. Be mindful of this to avoid misrepresentation and improve the quality of your research.

Implementation

If you like the method described in one study and want to implement it in your practice, it is important not only to ensure the quality of the research and the credibility of its results. You also need to evaluate how these results are applicable to the context of your work. Feasibility studies and tailoring the methodology to your specific context will help you effectively integrate new approaches and improve the results of your work.

The Australian Education Research Organisation (AERA) provides educators and policymakers with valuable guidance on analysing research evidence. Experts suggest paying attention to important questions that will help to better understand and evaluate the effectiveness of educational practices.

• what in the study is related to your practice, similar to your current conditions and tasks;
• what is different;
• what attracts you to the study;
• why the approach used in the study worked, what resources and conditions were key to success;
• what you will have to change in your practice to implement this approach, and will this be enough to achieve the effect;
• how you will adapt the innovation to your system and how will the adaptation affect the key elements that ensured the success of the approach in the study;
• how much will the changes cost and where will you get these funds and time;
• what will need to be removed from practice to introduce the new approach, and what will be the consequences of abandoning old, familiar forms of work for students.

If you believe that the benefits of implementing a new solution outweigh the possible costs, Ask yourself two more important questions:

• What resources will be needed during implementation, how will you obtain them, and how will you distribute them?
• How will you monitor the effectiveness of the innovation—what data will you collect, how will you ensure that the changes are related specifically to the new approach?

This extensive list emphasizes that evidence-based education is not a one-size-fits-all solution and is not limited to a list of medications prescribed by a doctor. Working with scientific research requires practitioners not only to apply knowledge but also to actively participate in research activities, making them partners with scientists. This approach promotes a deeper understanding and implementation of effective methods in practice, improving work results and enhancing the quality of services provided.

Also study:

• Why teachers need data analysis
• When you shouldn't implement EdTech in schools
• How to create innovations in education