DLSS 3 and FSR 3: An Overview of the Technologies That Create Artificial Frames in Video Games

Contents:

• What is frame interpolation
• How DLSS 3 works
• Problems and disadvantages of DLSS 3
• How FSR 3 works

Today, developers are actively using artificial image resolution technologies to improve the performance of their games. Technologies such as DLSS and FSR allow for higher resolutions without significantly impacting the graphics card, making gaming smoother and more enjoyable. These solutions are becoming industry standards, allowing players to enjoy high-quality graphics even on less powerful systems. Using such technologies not only improves visual perception but also optimizes resources, an important aspect of modern game development.

Modern technologies continue to develop rapidly. Video cards are now capable of not only improving image quality based on existing data but also generating new frames. This has become possible thanks to new versions of well-known technologies – DLSS 3 from NVIDIA and FSR 3 from AMD. Engineers at these companies claim that their frame generation method doubles the frame rate in games without a noticeable loss in quality. This sounds quite impressive and opens up new horizons for gamers and developers.

Skillbox Media's Gamedev editorial team analyzes the DLSS 3 and FSR 3 frame generators. The article examines the key characteristics and operating principles of these technologies, as well as their impact on performance and graphics quality in modern games. NVIDIA's DLSS 3 and AMD's FSR 3 offer gamers the opportunity to improve visuals and the smoothness of gameplay. Understanding these technologies will help developers and players optimally utilize their advantages to achieve the best gaming experience.

Content is an important part of any text, as it helps readers quickly navigate the material. Properly formatted content improves comprehension and increases navigation ease. Including keywords in headings and subheadings not only helps users but also contributes to improving the page's SEO position. This allows search engines to better index the content, which in turn increases the visibility of the site. Content optimization also includes the use of meta tags, titles, and descriptions, which makes it more attractive to search engines. Thus, high-quality content with a clear structure is the foundation of successful web content that responds to user queries and meets the requirements of search engines.

• What is frame interpolation
• How DLSS 3 works
• Problems and disadvantages of DLSS 3
• How FSR 3 works

What is frame interpolation

Creating a non-existent frame may seem like a science fiction task, but in practice it is much simpler. Modern technologies are capable of generating objects and complex panoramas, taking into account the nuances of lighting. Using algorithms and artificial intelligence, specialists can create high-quality images that look realistic and attractive. These advances open new horizons in visual art and design, enabling the realization of concepts previously only imaginable. Frame interpolation doesn't generate images from scratch. Instead, it analyzes two adjacent frames and attempts to determine what might lie between them. This is achieved using optical flow methods that track the movement of pixels between frames. If a prominent object moves from the left side of the first frame to the right side of the second, it's logical to place it in the intermediate position. This approach allows for smooth animation and improved video perception, which is especially important in modern multimedia applications.

Image generation technologies began to develop in the mid-1970s, but became especially popular with the advent of high-refresh-rate displays. This created a contrast between content production and consumption. Most movies and TV shows are created with 24 frames per second in mind, while modern TVs and monitors are capable of handling 60, 120, and even 240 frames per second. To take advantage of this, TV manufacturers began integrating frame interpolation technologies, which make viewing content smoother and more dynamic. These technologies improve overall picture quality and create a more immersive experience for viewers.

When watching sports, frame interpolation can be useful, providing a smoother and more dynamic image. However, this process often leads to the appearance of artifacts in intermediate frames, which can look unnatural and blurry. As a result of continuous viewing, objects on the screen can lose clarity and turn into something resembling a shapeless jelly. This effect, known as the "soap opera effect", can significantly negatively affect the perception of content.

Creating the perfect intermediate frame in a movie using mathematical algorithms is a complex task. Firstly, adjacent frames can differ significantly from each other. Secondly, the algorithms process only a set of pixels, which limits their capabilities, since they do not have access to information about the actual location of the actors in the frame. This makes the process of creating intermediate frames not only technically complex but also requires a deep understanding of the visual content.

Many directors do not like to make artificial changes to the original material. The standard frequency of 24 frames per second is fundamental for the film industry, and an uncontrolled increase in this frequency is not always justified. This can negatively affect the perception of the film and violate its artistic unity.

How DLSS 3 Works

Interpolation in cinema often leads to artifacts and does not always produce the desired result. In contrast, interpolation technologies have found successful application in the gaming industry. This is because the frame rate in games is typically significantly higher than in films, and in some cases, it's unlimited. Even in cinematic-style projects, the minimum frame rate never drops below 30 FPS. This reduces the difference between successive images, simplifying the process of rendering intermediate frames for interpolation technologies. This allows for smoother and more realistic animations in games, significantly improving the overall gaming experience.

Image generation algorithms in games use not only pixel data on the screen but also specialized information from the game engine, allowing for more accurate frame processing. DLSS and FSR engineers have leveraged these advantages in the development of their frame generation systems, significantly improving image quality and game performance. This allows developers to create more detailed worlds and ensure smooth gameplay without losing visual quality.

The first mainstream frame generator was DLSS 3, introduced by NVIDIA in September 2022. It is similar to solutions used in televisions: the graphics card creates two real frames, forms an optical flow field to estimate the speed and direction of pixel movement, and then generates an intermediate frame. However, despite a similar structure, DLSS 3 initially demonstrated significantly more impressive results compared to similar technologies for televisions. This innovation opens new horizons in the gaming experience, providing smoother graphics and high performance.

Marketing Confusion

Marketing confusion occurs when companies lack clarity in their strategies and approaches to promoting products or services. This can lead to inconsistent communication, errors in brand positioning, and, ultimately, decreased sales. The main causes of marketing confusion include unclear goals, lack of a target audience strategy, and a variety of advertising channels.

To address marketing confusion, it is important to audit current marketing activities, identify key messages, and set clear goals. Developing a unified strategy based on understanding customer needs and market specifics will help avoid further misunderstandings. The primary focus should be on creating a consistent and understandable brand that is easily perceived by the target audience. Optimizing marketing processes and continuously analyzing results will allow companies not only to eliminate confusion but also to improve the effectiveness of their advertising campaigns. Proper use of SEO tactics also plays a key role in increasing visibility and attracting targeted traffic, which in turn contributes to business growth. Many gamers don't fully understand what DLSS is, and this is understandable, as today this acronym covers a whole range of technologies. DLSS 2 is designed to increase image resolution without reducing performance. DLSS 3, in turn, acts as a frame generator, which allows for a smoother gameplay experience. Reflex, which NVIDIA also includes in the DLSS 3 ecosystem, is a separate technology designed to reduce player input lag. This technology long predates NVIDIA's artificial graphics enhancement and remains an important tool for improving game quality.

The technical term DLSS actually refers to only one of three technologies the company combines into a single system. The acronym DLSS has become a brand that signals to users the possibility of improving image quality in games. This can create confusion, especially when it comes to the technology's compatibility with different graphics cards. For example, DLSS 3 is only supported on modern GPUs, but that doesn't mean owners of older models won't be able to reap the benefits. The DLSS 2 resolution upscaler is still available for them, allowing for improved graphics and increased gaming performance.

The difference between DLSS 3 and other technologies is that DLSS 3 avoids the soap opera effect by using a more comprehensive approach to frame generation. The algorithm takes into account not only the pixel data displayed on the screen but also object motion vectors and depth maps. These elements, which we mentioned in the previous article, allow the algorithm to more accurately determine the movement of key objects in a scene. Thus, DLSS 3 provides more realistic images and smooth animations, which makes the gaming process more immersive.

Motion vectors can be used to create a full frame without using optical flow, but the result may be less than ideal. This is because not all objects in a scene are clearly linked to a motion vector. Some geometric elements depend on other objects. For example, shadows do not have their own motion, but are entirely dependent on the object that casts them and the light source. As a result, the movement of such objects may be nonlinear, and motion vectors cannot accurately reflect their dynamics. In contrast, optical flow is able to more accurately determine the movement of objects in a scene.

NVIDIA uses specialized optical flow accelerators, which are present in the RTX 4000 series of graphics cards. This makes the technology exclusive to the new GPUs. Importantly, video games provide smoother images compared to films, resulting in smaller differences between individual frames. This approach enables high performance and an improved visual experience in games.

Movies are rendered at 24 frames per second, with each image displayed on screen for 41 milliseconds. In fast-paced action films, the scene can change dramatically during this time: in one frame, an explosion is just beginning, and in the next, it is already complete. In contrast, the classic frame rate of video games is 60 frames per second, allowing each frame to be on screen for only 16 milliseconds. During this short period of time, images change less significantly, simplifying the frame construction process. Under these conditions, the algorithm is better able to avoid errors.

NVIDIA's solution has sparked an interesting controversy in the gaming community. DLSS 3 technology is only available on the latest graphics cards, while users of older hardware desperately need higher frame rates. For DLSS 3 to fully function, a game must achieve at least 60 frames per second without using this technology. This creates additional challenges for players with older systems looking to improve their gaming experience.

The benefits of DLSS 3 aren't always clear. The more frames needed for a comfortable gameplay experience, the more difficult it is for the technology to cope with this task. DLSS 3's benefits are most noticeable for users with unbalanced PCs equipped with a powerful graphics card but a weak processor. In situations where the CPU becomes a bottleneck and can't unleash the graphics card's potential, DLSS 3 demonstrates its advantages, significantly improving gaming performance and ensuring smooth gameplay.

DLSS 3 Issues and Disadvantages

Despite its clear advantages, DLSS doesn't always provide perfect frame reconstruction. One of the main issues is the dependence of the result on the initial frame rate. Experience shows that at frame rates above 60 frames per second, image quality becomes more reliable. In addition, even if one of the frames turns out to be unsuccessful, it will be displayed on the screen for only a few milliseconds, and in most cases, players will not notice the flaws.

Dropping below 30 FPS is not recommended. At such a low frame rate, DLSS often makes calculation errors, which negatively impacts image quality. Furthermore, a snowball effect occurs: as the frame rate decreases, each frame is displayed on the screen longer, making imperfections more noticeable. To avoid deterioration in visual perception, it is recommended to maintain a frame rate of at least 30 FPS.

The generator's problems are not limited to just one aspect. The algorithm effectively tracks gradual changes in frames, but it has difficulty predicting instantaneous transformations. This becomes especially evident during moments when abrupt changes occur in the game. In such cases, the intermediate frame often turns into an artifact, representing a mixture of elements of the first and second frames. This flaw can negatively impact the game's visual quality and overall gameplay dynamics.

Looping animations and sharp effects, such as muzzle flashes or small particles from explosions, can significantly impact the visual experience. Often, these effects become blurry or are ignored by the generator, resulting in jittery images. This can negatively impact the overall visual quality and cause discomfort for viewers. To avoid such problems, it is important to pay attention to optimizing graphics and setting up animations, which will improve display stability and increase user satisfaction.

Interfaces remain one of the main issues with DLSS 3. The technology does not effectively predict the movement of icons and pointers, which causes significant difficulties. Initially, this led to noticeable artifacts in all games supporting DLSS 3. Text and interface elements often jittered, making them difficult to read and reducing the overall comfort of the game. Improving the interface experience is an important step in improving the user experience and addressing these shortcomings.

The extent of the effect depends largely on the specific game. In Hitman 3, for example, the on-screen interface is minimal, and the game itself is not very dynamic, making frame rate less noticeable. In contrast, in F1 2023, opponents' names appear in boxes above their cars and move in sync with them, creating a more vibrant and immersive gaming experience. Differences in approaches to displaying information on the screen can significantly affect the overall gaming experience and the player's perception of what is happening.

Players often encounter unpleasant flickering on the screen, which significantly impairs the gaming experience. Experience shows that solving such problems requires additional effort from developers, as well as updating DLSS 3 drivers. In a number of games, for example, Cyberpunk 2077, the interface was fixed over time, which increased display quality and improved user interaction. To eliminate such problems, it is important to follow updates from developers and regularly update drivers, which will help ensure a stable and comfortable gameplay.

How FSR 3 Works

Last year, AMD introduced its new frame generator, FSR 3. As with other technologies from the company, the emphasis was on accessibility and versatility. FSR 3 does not require specialized computing units, which allows it to be used even on older video cards from any manufacturer. This makes the technology especially attractive for users looking to improve gaming performance without the need to upgrade hardware. FSR 3 offers an easy way to improve graphics quality and gameplay smoothness, which will certainly be of interest to gamers and game developers.

DLSS and FSR both use depth maps and motion vectors received from the game engine and create an optical flow field to analyze the displacement between two images. The main difference between these technologies lies in the methods for generating optical fields. DLSS uses artificial intelligence algorithms to improve image quality, while FSR is based on more traditional approaches, making it more accessible to a variety of gaming platforms. Both technologies aim to improve performance and graphics quality in games, but their approaches to image processing are different.

FSR does not require specialized acceleration cores, which makes its operation simpler. The algorithm breaks the image into 8x8 pixel blocks and analyzes significant changes within these blocks. While this method may negatively impact image quality, FSR 3 has demonstrated impressive results in practice from the very first launches. This technology improves graphics performance without the need for additional hardware, making it accessible to a wide range of users.

The main issues with this technology lie not in image quality, but in ease of use. As with DLSS, the technology may exhibit incorrect operation when vertical synchronization is enabled.

Until recently, AMD's frame generator automatically activated the FSR 2 upscaler, since both technologies used the same data from the game engine. It is important to note that there is no direct contradiction between them: these technologies can function independently. In the new version of the technology, FSR 3.1, the frame generator can be combined with various upscalers, including DLSS from competitors, or disabled completely. This provides greater flexibility for developers and users, allowing them to optimize in-game graphics for individual preferences and hardware capabilities.

Frame generation technologies have rapidly entered the gaming industry, demonstrating strong results from the very beginning. They promise to continue to improve in the future, but their true value is not yet clear. Many gamers hope for a free performance boost, but it's worth noting that technologies like DLSS and FSR are unable to transform 30 FPS into a smooth 60 FPS with high image quality.

For these technologies to work effectively, a high native frame rate is required. However, this creates a certain conflict: users with low-spec video cards have the greatest need for these technologies, while they are primarily optimized for owners of powerful hardware.

Read also:

• What is DLSS - and how does this technology improve performance in games?
• What is FSR - and how does this technology increase resolution in games?