Nvidia VFX nodes bring local upscaling and frame interpolation to ComfyUI

ComfyUI added a suite of Nvidia VFX nodes that enable local video upscaling, frame generation, and SDR-to-HDR conversion on RTX hardware. The integration brings professional-grade color management and EXR support to the node-based interface, allowing creators to process high-fidelity video without leaving their local environment. This update specifically targets the technical requirements of visual effects pipelines that demand high bit-depth and precise color handling.

What's new

The new node set for ComfyUI includes three primary capabilities: Super Resolution, Frame Interpolation, and SDR-to-HDR conversion. The Super Resolution node allows for 2x and 4x upscaling of video frames directly on the GPU, utilizing Nvidia's latest models to reconstruct detail while maintaining temporal stability. Unlike standard image upscalers, these nodes are optimized for the sequential nature of video, reducing the flickering often seen in AI-generated content.

The Frame Interpolation node provides a local alternative for creating slow-motion effects or increasing the frame rate of generated clips. It uses motion estimation to generate intermediate frames, similar to the technology found in DLSS 3 but applied to video files. Additionally, the SDR-to-HDR node automates the process of expanding the dynamic range of standard video, which is essential for artists delivering content for modern HDR displays. Support for the EXR file format and linear color spaces ensures that these tools fit into professional compositing workflows without losing data.

How it fits your workflow

For filmmakers and VFX artists, these Nvidia VFX nodes turn ComfyUI into a more viable post-production tool. Previously, many creators had to export their ComfyUI renders and move to external software like Topaz Video AI or DaVinci Resolve for upscaling and frame rate adjustments. By keeping these steps within the ComfyUI graph, editors can build automated pipelines that generate, upscale, and interpolate video in a single pass.

This local implementation offers a significant advantage over cloud-based alternatives like Runway or Luma AI, where upscaling often incurs additional costs or requires re-uploading large files. For those working with sensitive footage or massive EXR sequences, the ability to perform high-quality temporal upscaling locally on an RTX 4090 or similar hardware provides both a speed and privacy benefit. The inclusion of proper color management also makes ComfyUI more compatible with industry-standard software like Foundry Nuke or Adobe After Effects, as the output maintains the necessary metadata for professional grading.

What it costs / how to try it

The Nvidia VFX nodes are available as a free extension for ComfyUI as of November 2024. Users must have a compatible Nvidia RTX GPU and the latest drivers installed to utilize the hardware acceleration. The nodes can be installed via the ComfyUI Manager or by cloning the official repository into the custom_nodes folder.