Mayer's Theory of Multimedia Learning: Essence and Application

Contents:

• The Personality of Richard Meyer: The Founder of Multimedia Learning Theory
• Understanding Multimedia and Its Connection with Multimodality
• Basic Principles of Multimedia Learning
• Three Basic Principles of the Multimedia Educational Process
• Reasons for the Low Popularity of Meyer's Theory in Russia

In this article, you will gain information about the following:

• Multimedia learning theory focuses on how the use of different forms of media can enhance the learning process. This concept was developed by Richard Mayer, who explored how the combination of text, images, video, and sound elements can promote better understanding and retention of information.
• Multimedia is the integration of different forms of media, such as text, sound, images, and video, to create richer and more interactive content. This allows users to interact with information on different levels, using a variety of sensory channels.

  On the other hand, multimodality refers to the use of different modes of information delivery, including verbal and non-verbal means, which enriches communication. Multimedia and multimodality are closely intertwined, as both concepts focus on multiple formats and channels to help convey ideas and emotions more effectively. Thus, multimedia serves as an aspect of multimodality, emphasizing the blending of different media to achieve better perception and comprehension of information.

• Two key theories underpin multimedia learning: cognitive load theory and dual coding theory. These concepts help explain how information is perceived and processed in multimodal presentations.
• The essence of multimedia learning theory is that combining different information formats, such as text, images, audio, and video, promotes more effective perception and assimilation of knowledge. This concept is based on three key postulates.

  The first postulate states that using different information modalities helps activate different perceptual channels, which, in turn, increases the chances of memorizing and understanding the material. The second postulate concerns that the integration of visual and auditory elements creates a richer learning environment, allowing students to better connect new knowledge with existing knowledge. The third postulate emphasizes that multimedia materials can be adapted to individual student needs, making the learning process more personalized and effective.

• The reasons why this theory has not gained widespread popularity in Russia may be varied. Firstly, it may be due to limited access to information or its insufficient dissemination in scientific circles. Secondly, there may be competition from other, more established theories that are already entrenched in society. It is also worth considering that cultural and historical contexts can influence the perception and acceptance of new ideas. Finally, a lack of interest from researchers and educational institutions may contribute to this theory remaining in the shadows.

Today's educational process is unimaginable without the use of digital resources that combine a variety of media formats—audio and video recordings, text documents, photographs, illustrations, graphics, and animation. All of these resources are commonly referred to as multimedia.

The word "multimedia" began to be used in the 1990s, when new technological possibilities emerged. Richard Mayer, who developed the theory of multimedia learning, initially focused on asynchronous e-learning courses. However, today this concept has gained wider application: multimedia educational materials are found not only in such courses, but also in e-textbooks, VR simulators, and various educational applications.

Multimedia learning theory explores how to effectively combine various formats for presenting educational material, such as text messages, oral explanations, and visual elements.

Why is this important? On the one hand, when explanations of material are not limited to the teacher's oral speech, but are supplemented with visual diagrams, text accents, and other elements, this can significantly improve the perception and assimilation of information. However, on the other hand, the simultaneous influx of diverse information aimed at different sensory perceptions can lead to overload and distraction from key points.

How can we achieve harmony and create multimedia resources that will be truly useful for students? Multimedia learning theory provides the answers to these questions. Abroad, it is integrated into the field of pedagogical or didactic design, while in Russia its popularity leaves much to be desired.

The personality of Richard Mayer: the founder of the theory of multimedia learning

Richard Mayer is an outstanding American psychologist and scientist, who currently holds a professorship at the University of California. For many decades, he and his team have been researching how people perceive both verbal information based on words and visual information presented in images.

Richard Mayer, along with his team of researchers, believes that the combination of visual and textual elements is the key to creating effective educational material. It is important to adhere to principles based on the theory of cognitive load: it is necessary to avoid overloading working memory in order to facilitate the assimilation of new information. This is the main idea of ​​the cognitive theory of multimedia learning.

The theory developed by Mayer is the result of his extensive research. He drew not only on his own findings but also on the work of other scientists in psychology and physiology. Among these key studies is the ideas about human sensory systems put forward by Academician Ivan Pavlov. He also took into account more modern concepts, such as Allan Paivio's dual coding theory.

The theory developed by Mayer was presented in his book "Multimedia Learning", first published in 2001 in Cambridge. The second edition was published in 2012, and the third in 2020. This work has not yet been published in Russian. Mayer also prepared the "Handbook of Multimedia Learning", which has also been reprinted twice. In collaboration with other experts, he created a book entitled "E-Learning and the Science of Learning: Proven Guidelines for Consumers and Developers of Multimedia Learning". (E-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning).

Understanding Multimedia and Its Relationship to Multimodality

In the context of multimedia learning, the term multimodal learning is sometimes encountered, which is used synonymously. Interestingly, in 2023, the Institute of Educational Technology of the UK Open University included multimodal pedagogy in the list of the most promising innovations in the field of education.

How are these two terms related? To understand this, it is worth recalling what the words "media" and "modality" mean. The term "media" covers all forms of communication, that is, ways of transmitting information (the English word media comes from the Latin word medium, which translates as "intermediary"). In this regard, multimedia implies the integration of various means of transmitting information into a single whole.

The concept of multimedia initially emerged in the context of the media industry, and can be most clearly illustrated by the example of mass media. Previously, there was a clear distinction: in print publications, information was presented in written form and accompanied by images, while on the radio, it was only verbal. However, with the advent of television, it became possible to simultaneously perceive information through video, audio, and text scrolling. Thus, the television format combines both visual and verbal elements.

With the advent of the Internet, traditional media began to adapt to the electronic format. This led to a significant blending of various information transmission formats. For example, on a newspaper website, one can not only read the text of an article, but also view video reports, listen to podcasts, and browse photo galleries. Moreover, all of these multimedia materials often have interactive elements, making interaction with them even more engaging.

Multimedia has rapidly entered all areas related to information transfer, and education is no exception. For example, an online course where a student listens to a lecture by a teacher and simultaneously watches a presentation with text key points, as well as static and dynamic (animated) images and diagrams, is a prime example of a multimedia approach.

Modality, which comes from the Latin word "modus", which translates as "way", and multimodality are more complex concepts. Their complexity lies in the fact that in the context of the transmission and perception of information, these terms are used in various fields: physiology, psychology, linguistics, semiotics and communication theory, and in each of them they have their own unique characteristics. Within the framework of the theory of multimedia learning, modality is considered from a physiological perspective.

This concept is associated with the first human signaling system, and to understand it, it is worth briefly referring to the basics of school biology. Let us recall what this system is: information about the outside world comes to a person through various sensory systems, each of which functions with the help of specific sense organs. Signals that are processed by one specific sensory system and transformed into sensations are called modalities. These include sight, hearing, taste, smell, and touch. Simply put, modality is the physical way we perceive information through specific senses.

Thus, multimodality is a process in which an individual simultaneously processes incoming information using different modalities to "decode" external cues.

It is important to note that humans, unlike animals, have not only a primary signaling system, but also a secondary one, which complicates the understanding of the different modalities. The secondary signaling system represents the conditioned reflexes in our brain, which can be thought of as a thinking process. In this context, signals are words, symbols, and images. Thanks to this system, we interpret information received through visual and auditory channels, and first, as it were, "uncover" its meaning.

Why did we take the time to study such complex aspects? This is necessary in order to understand that the media serves as a channel for transmitting information, and modality determines how a person perceives it. A specialist in the creation of educational materials must correctly match various means of transmitting information with the ways in which they are perceived. Thus, multimedia and multimodality are, in essence, two interrelated aspects of the same process.

Basic Principles of Multimedia Learning

Earlier, we said that the basis of the theory of multimedia learning is another concept - the theory of cognitive load. In particular, we are interested in its aspects related to working memory. It should be noted that scientific ideas about the structure of human working memory, as well as what contributes to its effectiveness and what, conversely, leads to overload, are constantly evolving thanks to new research in this area. As a result, the theory of multimedia learning can be enriched with fresh findings and related practical methods. It is possible that over time, some of its principles will be subject to adjustments.

Multimedia learning theory is based on the concept of dual coding proposed by Allan Paivio. In its simplest form, the basic idea is that to enhance comprehension and retention of verbal information presented in words, it is useful to additionally visualize it, transforming it into images. Paivio describes this cognitive process as the interaction of two independent subsystems: the verbal subsystem, responsible for verbal information, and the nonverbal (imagery) subsystem, which processes non-linguistic elements, including images. Thus, we are talking about the functioning of the second signaling system.

When an individual perceives words, whether through reading or listening, or visual objects when observing them, they form an internal representation. Such a representation can be, for example, internal vocal images that arise during silent reading, or various visual images. In this case, word representations, or verbal images, activate not one, but several modalities at once - these can be visual, auditory, and also kinesthetic sensations, such as tactile or gustatory.

In other words, when we encounter a certain word, we have the option of either saying it silently or visualizing the associated image. This reflects the characteristics of language and the human thought process.

Allan Paivio expressed the opinion that the human cognitive process is based on the complex interaction of two systems—verbal and nonverbal. He believed that to achieve more effective assimilation of information, it is desirable to represent it simultaneously in both words and visual images, which implies the use of two "codes" simultaneously. This is especially important because visual images are easier to remember than verbal formulations.

Three Basic Principles of the Multimedia Educational Process

Based on all of the above data and numerous studies conducted by Richard Mayer and his team, the concept of multimodal learning is built on three key postulates:

By channels we mean precisely the modalities mentioned earlier. Mayer, like Paivio, the author of the dual coding concept, believes that the simultaneous use of visual and auditory channels does not lead to an overload of short-term memory (which is also called working or operative memory), but, on the contrary, facilitates the memorization process. When information is presented visually and accompanied by a coherent verbal explanation, it is more easily perceived, and the brain finds it easier to transfer it to long-term memory.

Mayer emphasizes that the perception of verbal information presented in written form occurs not only through the visual channels, but also partly through the auditory channels. When you read this article, you may not only see the words but also mentally hear them, especially if you have the habit of silently repeating the text. In this case, your auditory channel is engaged as much as your visual one. Therefore, it is not recommended to overload your hearing by adding additional auditory information. This means that audiovisual explanation is harmoniously combined with observing visual materials, such as pictures or animations, but not with reading text.

The brain, as well as short-term memory, have a limited capacity to process simultaneously incoming "cognitive units" or new information. Try, for example, to recall this short passage you are currently reading word for word in a few minutes. This presents quite a challenge for your brain.

When an individual encounters new educational information and it enters their short-term working memory, an active process begins in the brain. In this process, it filters important data from the general flow, structures it into visual and verbal mental models, and then connects it with existing knowledge in long-term memory, thereby creating new connections.

So, when someone sits and takes in information about a new topic, intensive work is taking place in their mind. Educational materials that use multimedia elements should support this process, not distract from it.

For example, when the information flow is saturated with redundant elements unrelated to the main topic (for example, a presentation contains many bright images added merely for visual effect, rather than to convey the essence), this can negatively impact the learning process. In this case, the brain will have to expend additional energy to separate important information from unimportant ones. This can lead to short-term memory overload, which in turn reduces the likelihood that the necessary information will be stored in long-term memory.

Reasons for the Low Popularity of Mayer's Theory in Russia

Scientific articles published in Russia touch upon the concept of multimedia learning. Examples of its application in various educational fields can also be found. For example, at Tver State University, methods developed by Mayer were used to select educational video materials for foreign language teaching. At the St. Petersburg State University of Architecture and Civil Engineering, these principles were used to create a foreign language presentation lesson.

In the field of informal online education (EdTech) and corporate training, Mayer's theory is more actively applied than in the development of educational materials for school, college, and university education. Alina Sandarova, Head of Educational Content at Skillbox, noted that multimedia learning principles formed the basis for developing content for versions 2.0 and 3.0 of the Skillbox platform, including various formats such as longreads and video tutorials. Elena Tikhomirova, CEO of E-learning Center, a company specializing in corporate training, also confirmed that their team adheres to Mayer's principles in their work and shares their experiences through the "Live Learning" blog. So why hasn't the concept of multimedia learning yet become widespread in Russia? This is most likely due to the fact that Richard Mayer's works are still unavailable in Russian, preventing their rapid dissemination. They are typically discovered only through the study of instructional design, for example, during courses for online learning methodologists and within professional methodological communities. If you're looking to learn more exciting things about education, join our Telegram channel! We look forward to welcoming you among our subscribers!

Read also:

• Effective cognitive load management during learning is an important aspect for optimizing information retention. Several strategies can be used to achieve this.

  First of all, it's important to consider the amount of information to be learned. Breaking material into smaller, more digestible chunks can significantly facilitate the learning process. This helps avoid overload and allows students to focus on specific aspects, gradually building up their knowledge base.

  In addition, various visualization techniques can be used. Graphs, charts, and other visual elements make information more accessible and understandable, which promotes better memorization. Visual images help create associations and simplify the process of processing complex concepts.

  It is also important to consider the individual characteristics of each student. Different people may perceive information differently and respond to different learning methods. Therefore, a variety of approaches, including interactive assignments, group discussions, and hands-on exercises, can significantly improve learning engagement and effectiveness.

  Creating a comfortable learning environment is equally important. Minimizing distractions and maintaining a highly motivating climate promotes improved concentration and material acquisition.

  Furthermore, regular breaks during learning help avoid fatigue and reduce stress. Short breaks can help restore attention and increase productivity.

  Finally, proper cognitive load management involves skillfully combining different teaching methods, adapting to individual needs, and creating favorable conditions for knowledge acquisition.

• Several factors influence the perception of a digital educational environment. Firstly, the level of accessibility of technology and internet resources directly affects student capabilities. Secondly, the quality of the content and the methodological approaches used in teaching play an important role. Educators' training in using digital tools is also crucial, as their experience and expertise can significantly impact the effectiveness of learning. Equally important is student motivation, which can vary depending on individual preferences and goals. Furthermore, the social and cultural contexts in which the educational system operates also shape attitudes toward digital learning formats. The reasons why students may struggle to master online learning are varied. Firstly, the lack of face-to-face interaction with teachers and classmates can lead to feelings of isolation and a lack of motivation. Secondly, technical issues, such as unstable internet or a lack of necessary equipment, can significantly hinder the learning process. Furthermore, many students struggle with time management, which can impact their ability to organize their own studies. Several steps can be taken to make online learning more comfortable and productive. Firstly, creating virtual group discussions will help, allowing students to interact and share ideas. Secondly, it's important to ensure access to high-quality technical resources so students can easily connect to classes. It is also useful to implement flexible schedules that allow students to better manage their time and find a balance between their studies and personal life.
• What do teachers expect from neuroscientists, and what hopes do neuroscientists place on educators?