What are references and how to create and use them in animation

Contents:

• A Brief Introduction to References in the Context of 3D Animation
• Why You Should Record Your Own References
• What You Need to Know Before Recording References
• Camera Setup
• Preparing for Filming
• Execution
• Further Processing of the Video
• Finally Recommendations

Creating visual content from scratch, including 3D animation, begins with a thorough search for references. Professionals in this field often use video recordings demonstrating the intended character movements. This can be either professionally filmed footage or self-created recordings. Analyzing such videos helps better understand the dynamics of movements and convey them in your own projects. It's important to consider details such as speed, smoothness, and expressiveness of movements to achieve high-quality animation and make the content more engaging for viewers.

At the Blender Conference 2023, Hjalti Hjalmarsson, a 3D animator from Blender Studio, presented examples from his practice and offered numerous recommendations for creating and using references in animation. Skillbox Media's Gamedev editorial team summarizes the key points of his presentation. These tips will help animators improve their efficiency in working with references, which, in turn, will improve the quality of their projects and speed up the creation process.

A quick reference is a concise summary of information that provides a general overview of a subject. It may include key facts, characteristics, and significance of the topic. Quick references are often used in scientific, educational, and business contexts to quickly review material. A well-written quick reference helps the reader quickly understand the essence of the issue and decide on further action. It is important that the text is clear, logical, and rich in keywords, which promotes better indexing in search engines and improves the visibility of information.

A 3D animator from Iceland, who has been working at the Blender Institute since 2014, is actively involved in the production of short animated films for Blender Studio. In addition to his primary work in 3D animation, he also performs the roles of director, screenwriter, editor, and layout artist, allowing him to bring variety to the animation process. His multifaceted experience and skills contribute to the high quality of animation projects and make him a valuable member of the Blender Studio team.

A Brief Introduction to References in 3D Animation

In 3D animation, references refer to live-action footage that 3D animators use to create more believable character movements. While Hjalti's talk is primarily aimed at those working with blocking techniques, many indie studios have begun to actively use motion capture-based animation in recent years. This material will also be useful for those using AI-powered mocap technologies, which allow the transformation of movements from pre-recorded videos into finished animation. The use of references and modern animation technologies significantly improves the quality and realism of 3D projects, which is especially important in the competitive animation and video game industries.

A note is an important element in any content, as it helps the reader better understand the information presented. In the context of documentation or articles, notes can be used to clarify certain points, provide additional information, or point to sources. Notes can also serve to highlight important aspects that might be missed on first reading. Effective use of notes can enhance the quality of content and make it more accessible to the audience. It is important to remember that notes should be concise and clear so as not to overload the text and distract the reader from the main topic.

Currently, the ability to directly derive animation from video fragments is available in several popular programs, such as Move AI, Rokoko Vision, Deepmotion Animate 3D, Plask Motion, and Cascadeur. It is important to note that these applications use artificial intelligence for motion recognition. This means that the finished animation may require manual refinement to achieve the best result.

Video references are an important tool in the arsenal of animation studios, although they are not always used as a basis for creating final animation. Nevertheless, such recordings can be useful for rethinking character performances. They provide an opportunity to explore new ideas that can then be discussed with the director. This practice is reminiscent of film production, where the crew conducts numerous rehearsals before filming, trying out different takes on the same scenes. Using video references helps improve the quality of animation and make characters more expressive and realistic.

Why You Should Record Your Own Reference

Animators are advised to avoid blindly copying, especially when using other people's footage. Hjalti emphasizes the importance of a conscious approach to working with references. Without careful analysis and understanding of the source, a rotoscoping effect can occur, which does not always correspond to the animator's intention. To create high-quality animation, it is necessary not only to borrow, but also to adapt ideas to your own style and concept. This will help avoid plagiarism and make the work more original.

Stylization is increasingly used in modern media formats, but it can hardly be called traditional rotoscoping. This effect is often achieved by applying special filters. Directly copying movements from a single source can lead to them not fitting organically into the surrounding scene. It is important to consider the context and features of the visual environment to achieve a harmonious combination of elements and preserve the aesthetic integrity of the work.

One of the main disadvantages of directly copying references is the risk of creating an unsuccessful copy of the original. This phenomenon is especially common in the artistic field. For example, if an artist finds inspiration in a particular image and decides to use it in their work, it's important to consider that the original likely included many additional elements. Without reinterpreting the reference, the result will be a derivative version lacking any uniqueness. The situation is aggravated if someone decides to copy an existing copy, which leads to further deterioration of the originality and artistic value of the work.

It is recommended to shoot reference footage yourself to ensure results that meet the requirements of a specific project. Hjalti has developed numerous recommendations for his colleagues to help optimize preparation, the shooting process, and subsequent editing of video recordings. These recommendations are organized into categories for ease of use.

What you need to know before recording reference footage

Consider the project's timeframe and budget. Most likely, you will only have one day to perfect the reference footage to the required level. There is no point in delaying the deadline, especially if the animation requires a quick change of shots. After recording and editing the reference footage, be sure to show the result to the director and discuss it together. If any flaws are discovered in the final version, it may be necessary to re-shoot the footage or cut some of it. This will help achieve high-quality animation and compliance with the original ideas.

Before recording references, it is recommended to study additional materials. For example, if you plan to animate an anthropomorphic cat, as in the short film "Wing it!", it is useful to watch cat videos on social media. This will help you capture the unique movements inherent in these animals and incorporate them into your animation. Schedule time to review such materials and avoid procrastination, as putting off tasks can lead to you not completing them in a timely manner.

A basic scene layout serves as the foundation for creating visual content. Its importance largely depends on the tasks facing the layout artist in a particular project. One specialist may include numerous elements in a scene, while another will focus on simply moving a character in a T-pose from one point to another. It's important to note that some shots may have multiple iterations, and the final version may not yet be approved. If an animator, based on the basic scene plan, suggests a new detail and presents it in video reference, this idea may interest the director and be used later in the production process. Creating a variety of options and being open to new ideas play a key role in the development of the project.

Adding a new bit of information, even if it adds dozens of frames to the animation, can significantly improve the final result. However, care should be taken not to apply this approach to all scenes, as this can double the screen time. Optimal use of this technique will result in higher-quality, more polished animation while maintaining viewer interest.

Pay attention to the consistency of shots. This means creating a harmonious transition between different shots. It's important to discuss this aspect with colleagues working on adjacent shots. If you're responsible for animating a specific sequence alone, carefully analyze each shot yourself. This will help ensure the smoothness and visual consistency of the entire project.

Relistening to the characters' dialogue in a scene is an important step in the pre-production process. While these lines can be irritating at the end of the process, analyzing the characters' lines remains essential. Paying attention to intonation and intensity is crucial, as this will significantly improve the quality of performance when recording reference. Carefully studying dialogue will help create more natural and expressive performances, which in turn will enhance the overall atmosphere of the scene.

Determine the sequence of actions in the shot. Once you have a clear idea of ​​the flow of events, write it down on paper. List all the actions in the correct order so you can easily update the list during filming. Some animators choose to create thumbnails of scenes, but a text format is often more understandable. This approach will help not only organize the process, but also improve the quality of the final product.

Video references are an important tool for creating Stylized cartoon animations. They help highlight key poses and facial expressions that can be used later in the animation process. The recorded fragments provide the opportunity to accurately recreate the dynamics and emotions of the characters, significantly improving the quality of the final product. Using video references allows animators to better understand movements and reactions, which ultimately makes the animation more expressive and engaging.

Camera Settings

Video quality doesn't have to be perfect. Remember that you're not creating content for a feature film, but to convey and analyze information related to future trends. Recording video on a smartphone is perfectly acceptable in this case. The key is clarity and informativeness of the presented material, which will allow viewers to effectively use the obtained data.

The frame rate when recording video should match the frame rate of the animation for optimal quality. In the film industry, 24 frames per second is the generally accepted norm, and CG animation is no exception. To change the frame rate in the video recording settings on a smartphone, you need to refer to the general camera settings. If your device does not support this feature, you can use specialized apps such as Filmic Pro. Another way is to convert the source video in a desktop video editor. It is important to set the correct saving settings that correspond to the desired frame rate.

Using a tripod is an important aspect when filming video, even if a professional cameraman is holding a smartphone. Without a tripod, image stabilization will be insufficient, which can negatively impact the quality of the final recording. For best results, it is recommended to always use a tripod to ensure a clear and professional look of your video. This is especially critical for content that requires high clarity and stability, such as interviews, tutorials, or commercials. Proper stabilization will help keep viewers' attention and enhance the perception of your material.

The choice between horizontal and vertical video format depends on the characteristics of the animation and its content. The correct format should capture all movements as much as possible to convey dynamism and atmosphere. Horizontal format is ideal for scenes where characters move from side to side, providing a wider view and better composition. Vertical format may be more suitable for scenes where the emphasis is on vertical movements or elements. Consider the specifics of your content to choose the optimal format that will highlight all the key points of the animation.

Preparing for Filming

Safety is a priority. Before engaging in strenuous activities like jumping, ensure there is sufficient clear space in the chosen filming location. It's also important to ensure there are no tripping hazards nearby. If there are furniture or devices with sharp corners, it's recommended to wrap protruding parts with soft materials to prevent injury. By being safe, you can focus on the process and avoid unnecessary incidents.

Create a setting from available materials that reflects the atmosphere of the intended scene. If your character interacts with an unusual structure, try recreating it from interior objects. For example, in the animation "Space Laundromat," the character emerges from a washing machine. Since Hjalti couldn't accurately recreate this scene, he built an alcove from a nightstand and a chair. This approach allows you to achieve the desired effect using creative solutions and available resources, which makes the animation process more fun and accessible.

To convey the movements in the animation "Going for Coffee," he had to balance himself on a structure made of a board and a hammer, which imitated a baby stroller. This process required a high level of concentration and skill to accurately convey the dynamics and emotions of the character.

It is recommended to wear Wear tight-fitting, brightly colored clothing that will stand out from the surrounding environment. Tight-fitting clothing allows for more accurate movement analysis, significantly simplifying the subsequent analysis process and improving the quality of the recordings. Choosing a contrasting color will help better distinguish details, which is important for high-quality movement assessment.

Clothing can play an important role in creating animation reference. If a character is wearing a jacket or coat, it's a good idea to record their movements while wearing similar clothing. This will make the body movements slightly more constrained, adding realism to the final animation. Correct interpretation of clothing in animation helps convey the character's personality and emotional state, which enhances the viewing experience.

Footwear, as well as the lack of it, significantly impacts physical activity and movement execution. Proper footwear provides adequate traction, which significantly improves body control and lends a specific character to movements. For example, walking on a slippery floor in shoes with poor traction can lead to comical situations. Thus, the choice of footwear plays an important role in the safety and efficiency of movements, and can also affect the perception of others.

Choose Props that match the shape, size, and weight of the objects in the animation, or create your own from readily available materials. Necessary items may not be available on set, especially when it comes to specialized props like weapons. In such cases, creativity and resourcefulness are essential.

For the "Space Laundromat" scene, Hjalti's team searched extensively for a cassette player as a prop. However, due to the device's age, it was impossible to find one even in thrift stores. As a result, the animator created his own unique design using an old hard drive and a case taped to simulate the desired effect.

For high-quality filming, it is recommended to use light sources with neutral, diffused light. Bright lighting is undesirable during filming, as it can create harsh shadows, which negatively impacts the perception of movement and the overall composition. Proper lighting plays a key role in ensuring the clarity and expressiveness of the depicted objects, which is especially important for video and photo shoots.

Set the camera at the same or similar angle. This will significantly save time when adjusting the animation later. Correct camera positioning at the shooting stage will help avoid unnecessary adjustments and simplify the process of working with animation elements.

When creating animation using a full body, it's important to ensure that the person serving as a reference for the motion capture is fully visible in the frame. If any body parts extend beyond the camera's field of view, this can create complications down the line. The director may not be able to zoom out, especially due to the lack of reference for the movements of the body parts that were cropped out. Ensuring the full figure is visible in the frame is crucial for the accuracy and quality of the animation.

A medium shot is optimal for facial animation. It allows for a more complete conveyance of emotions and facial expressions at a specific moment of action. The above fragment uses a medium close-up, which cuts off the image at chest level, as this shot size was predetermined and agreed upon.

Note: This text may be helpful in understanding the context and purpose of the document. It is important to remember that proper formatting and structure of information contribute to better perception and assimilation of the material. Notes may contain additional explanations, references to sources, or important recommendations. Ensure that all notes are clearly worded and correspond to the main content. This will help readers get a full understanding of the topic and avoid misunderstandings.

Facial animation is formed by capturing facial expressions, while the video is recorded in selfie format using specialized programs and add-ons.

Performance

Before filming, it is important to conduct test recordings of key poses to check the composition of the shots. When filming independently, a situation often arises where certain parts of the body are out of frame, which leads to the need to re-shoot the entire material. To avoid wasting time and effort, pay attention to pre-checking all elements in the frame. This will help ensure the quality and completeness of the footage and will significantly simplify the editing process. Don't worry about looking awkward if you're taking on an unusual role. Overcoming your awkwardness will open the door to creating high-quality video references. This will help you improve your skills and become a more professional video editor. Don't forget that every experience, even the strangest one, can be a valuable contribution to your development.

During When filming, it's important to exclude the presence of strangers. Exceptions include cases where the director is present to collaborate on a new version of a scene. However, in most cases, the presence of an audience is distracting and interferes with the creative process. Therefore, it is recommended to provide a closed filming space, which will help maintain concentration and improve the quality of the result.

Before filming, it's important to immerse yourself in the character. Try to imagine yourself in their place and understand their emotions. For example, if you need to convey extreme fatigue, do a physical exercise before filming, such as a few push-ups. If your character is thinking about something in a scene, try to focus on something so that it is reflected in your expression on camera. These simple techniques will help make characters more sincere and believable. Proper preparation and understanding of the role will significantly impact the quality of your performance and the audience's perception.

It is important to ensure that all planned movements are included in the recording. A single scene can contain more than 10 actions, and their sequence is critical. To avoid confusion, it is recommended to record the video in parts. This will help maintain clarity and order in the presentation of the material, which is especially important for viewers and further work with the content.

Don't imitate the process. In the script, an animated character lifts a heavy box. If the actor recording the reference simply pretends to lift the weight, the lower skeleton will look unnatural. When lifting heavy objects, not only the arms and core are actively involved, but also the leg muscles. This is important to consider for creating believable animation, as every movement must reflect real physics and dynamics. Correct transmission of forces and interactions between different parts of the body gives the animation realism and depth, which significantly improves the perception of the character.

This video shows an example of Hjalti's training practice. He was tasked with creating a scene in which an object is sawed. At first, he only imitated the process, which displeased his teacher. Ultimately, Hjalti had to carry out the task for real, sawing a wooden board. This brought significant improvements to the quality of the reference image.

Physical limitations do not become an obstacle to filming. There are certain movements, such as acrobatic stunts, that may be inaccessible to many people. In such cases, it is advisable to turn to professionals with high physical training. Collaboration with such specialists will significantly improve the quality of video footage and expand the creative possibilities of the project.

It is important to consider that your body proportions may differ from the proportions of the character. For example, due to height or other individual characteristics, some body parts may be larger or smaller. Therefore, poses used as reference may not always accurately match the character's pose. Keep this in mind and make any necessary adjustments as you work.

Pay attention to hand positioning when interacting with props. For example, when you pick up a broom, the position of your hands on the handle will change depending on your pose. At some point, you may even unconsciously let go of the handle and then grab it again. These manipulations can complicate the animation process. To minimize changes in hand position, it is recommended to use visual indicators. Mark the points where your hands touch the prop with brightly colored tape. This will help maintain stability and simplify the animation process, making it more natural and efficient.

When recording video, it's important to turn your body toward the camera. This principle is similar to theater, where one of the main rules is to avoid standing with your back to the viewer. By following this rule, you create more attractive and engaging content, allowing the audience to better perceive your message.

When creating the reference for "Space Laundromat," Hjalti emphasized his right leg. This allowed him to adopt a more open pose toward the camera, adding expressiveness and dynamism to the image. Using this technique in the composition helps to better convey the mood and atmosphere of the work.

If you need help, do not hesitate to contact support. If you have a colleague who you think is perfect for a certain character, invite them to participate in the filming.

Unexpected events in takes can be a real treasure for filmmakers. A striking example of this is the famous scene from the film "Midnight Cowboy," in which Dustin Hoffman's character is almost hit by a passing taxi driver. Many sources claim that the car entered the frame by accident, and the actor's genuine indignation at that moment was so natural that they decided not to reshoot the scene. The line "Here I come!" became iconic and has been remembered by audiences for years. Random moments like this highlight the unpredictability of cinema and its ability to create unforgettable images.

The Sound of Music features a powerful example of the unexpected when Julie Andrews' character confidently sings of her self-assurance and suddenly stumbles. This awkward moment was left in because it lends poetic irony to the sequence, highlighting the contrast between words and action. Moments like these humanize characters and create a deep emotional connection with the audience.

Although such situations more often occur on film shoots, emergency situations can also arise during reference recording. Hjalti recalls an incident on the set of "Space Laundromat," when actor Reino Scholten van Aschat, who voiced the character of Victor, got the sequence mixed up. Instead of closing the door of the washing machine, which the character had just emerged from, he reached for a cigarette. This unexpected action seemed natural enough to the animator, and he decided to combine the two moments during the subsequent reference recording process. In the final version of the short film, Victor emerges from the washing machine, closes the door with his foot, and simultaneously reaches for a cigarette. This approach to animation creation demonstrates how unexpected situations can enrich the creative process and make characters more alive and memorable.

After filming several takes, be sure to review the footage to avoid wasting time. Recording a large number of takes can make reviewing difficult, so it's recommended to limit the recording to one for wide shots and no more than three to five takes for other shots. This is because during filming, situations may arise where an actor accidentally leans the wrong way or a gesture chosen for a scene ends up awkwardly captured in the frame. Therefore, a reasonable number of takes will help you effectively monitor the quality of the footage and quickly find the right moments.

After filming, select the best recordings. It's recommended to delete all other files, as their excessive number can complicate the workflow. This will allow you to focus on the best shots and make it easier to organize your content.

Further processing

Before editing your footage, place a video sequence with a base plan of the 3D scene onto it. This will allow you to more accurately calculate the animation timing and improve the coordination between elements. This approach helps improve the quality of the final product and simplifies the animation creation process.

Apply a black and white filter to Video fragments that aren't part of the current frame's animation. This will create a clearer context for current references and clearly demonstrate the beginning and end of the action in the frame. Using this approach helps improve the perception of video material and focuses attention on key elements.

Create a unique collage including video reference and a 3D scene mockup to effectively present the footage to the director. Add a frame counter to the footage to serve as a useful reference during subsequent animation editing. Frame numbering will facilitate the workflow and help accurately synchronize animation elements.

In Blender, you can enable a frame counter through the Output Settings tab. To do this, select the Frame option. To display the data in renders and exported video, also enable the Overlay over image option. If you only want to display numbers, uncheck the Insert Labels option. These settings will help you effectively track and display frames in your projects.

Final Recommendations

Recording reference is an important part of the creative process, requiring active discussion with the director, fellow animators, and the editor. Even if the execution in the video seems flawless at first glance, inconsistencies with other frames of animation may subsequently arise. Therefore, it is important to pay attention to this experimental format and carefully analyze each element to achieve harmony in the final result.

Recording video with reference for animation can be useful, but not always necessary. In some projects, it is possible to get the necessary movement information simply by posing in front of a mirror or asking a colleague to take photos of the desired poses. In other cases, simple pencil sketches of the drawing may be enough. Every project is unique, and each frame has its own requirements. Determining the appropriate reference method depends on the specifics of the task and the personal preferences of the animator.

Practice is the key to success. Analyzing his work during his presentation, Hjalti noted significant progress in recent years. The main improvements are related to increased efficiency. Reducing task completion times is crucial, as is the accumulated experience. Regular training and continuous improvement contribute to skill growth and professional development.

Each project requires an individual approach. Therefore, it is not necessary to implement all of the recommendations mentioned. However, they are worth considering, testing, and evaluating their effectiveness in the context of your project. It is also important not to forget to enjoy the work process.