Nvidia NVENC

From Wikipedia, the free encyclopedia

Nvidia NVENC (short for Nvidia Encoder)[1] is a feature in Nvidia graphics cards that performs video encoding, offloading this compute-intensive task from the CPU to a dedicated part of the GPU. It was introduced with the Kepler-based GeForce 600 series in March 2012 (GT 610, GT620 and GT630 is Fermi Architecture).[2][3]

The encoder is supported in many livestreaming and recording programs, such as vMix, Wirecast, Open Broadcaster Software (OBS) and Bandicam, as well as video editing apps, such as Adobe Premiere Pro or DaVinci Resolve. It also works with Share game capture, which is included in Nvidia's GeForce Experience software.[4][5][6]

Until March 2023 consumer-targeted GeForce graphics cards officially support no more than 3 simultaneously encoding video streams, regardless of the count of the cards installed, but this restriction can be circumvented on Linux and Windows systems by applying an unofficial patch to the drivers. Doing so also unlocks NVIDIA Frame Buffer Capture (NVFBC), a fast desktop capture API that uses the capabilities of the GPU and its driver to accelerate capture.[7] Professional cards support between 3 and unrestricted simultaneous streams per card, depending on card model and compression quality,[2] the restrictions were loosened in 2023 allowing up to 5 simultaneously encoding video streams.[8] From January 2024 onwards, 8 simultaneous encoding video streams became the baseline.[9]

Nvidia chips also feature an onboard decoder, NVDEC (short for Nvidia Decoder), to offload video decoding from the CPU to a dedicated part of the GPU.[2]

Versions[edit]

NVENC has undergone several hardware revisions since its introduction with the first Kepler GPU (GK104).[10]

NVENC summary[11][12]
GPU Hardware H.264 (AVC)

(In H.264, NVENC always has B Frame support, max 4096x4096 resolution, and max 8-bit depth)

H.265 (HEVC) AV1
NVENC Generation GPU Code Name NVENC per Chip Chroma Lossless Coding Chroma Lossless Coding Resolution Color Depth B Frames AV1
4:2:0 4:4:4 4:2:0 4:4:4
1st Gen GK110 1 Yes No No H.265 not supported AV1 not supported
GK107
GK106
GK104
2nd Gen GM107 1 Yes Yes Yes H.265 not supported AV1 not supported
3rd Gen GM206 1 Yes Yes Yes Yes Y?[12] N?[11] No 4096 x 4096 8-bit No
GM204 2 No
GM200
4th Gen GP108 0 No NVENC encoders available
GP107 1 Yes Yes Yes Yes Yes Yes 8192 x 8192 10-bit No AV1 not supported
GP106
GP104-2xx+ 2
GP104-1xx 1
GP102 2
GP100 3 4096 x 4096
5th Gen GV10x 8192 x 8192
TU117 1
6th Gen TU116 Yes
TU106
TU104
TU102
7th Gen GA107 1 Yes Yes Yes Yes Yes Yes 8192 x 8192 10-bit Yes
GA106
GA104
GA102
GA100[13] 0 No NVENC encoders available
8th Gen AD107 1 Yes Yes Yes Yes Yes Yes 8192 x 8192 10-bit Yes Yes
AD106
AD104-250
AD104-400 2
AD103
AD102
NVENC Generation GPU Code Name NVENC per Chip Chroma Lossless Coding Chroma Lossless Coding Resolution Color Depth B Frames AV1
4:2:0 4:4:4 4:2:0 4:4:4

First generation, Kepler GK1xx[edit]

The first generation of NVENC, which is shared by all Kepler-based GPUs, supports H.264 high-profile (YUV420, I/P/B frames, CAVLC/CABAC), H.264 SVC Temporal Encode VCE, and Display Encode Mode (DEM).

NVidia's documentation states a peak encoder throughput of 8× realtime at a resolution of 1920×1080 (where the baseline "1×" equals 30 Hz). Actual throughput varies on the selected preset, user-controlled parameters and settings, and the GPU/memory clock frequencies. The published 8× rating is achievable with the NVENC high-performance preset, which sacrifices compression efficiency and quality for encoder throughput. The high-quality preset is considerably slower but produces fewer compression artifacts

Second generation, Maxwell GM107[edit]

Introduced with the first-generation Maxwell architecture, second generation NVENC adds support for the high-performance HP444 profile (YUV4:4:4, predictive lossless encoding), and increases encoder throughput up to 16× realtime, which corresponds to about 1080p @ 480 Hz with the high-performance preset.

Maxwell GM108 does not have NVENC hardware encoder support.

Third generation, Maxwell GM20x[edit]

Introduced with the second-generation Maxwell architecture, third generation NVENC implements the video compression algorithm High Efficiency Video Coding (a.k.a. HEVC, H.265) and also increases the H.264 encoder's throughput to cover 4K-resolution at 60 Hz (2160p60). However, it does not support B-frames for HEVC encoding (just I and P frames). The maximum NVENC HEVC coding tree unit (CU) size is 32 (the HEVC standard allows a maximum of 64), and its minimum CU size is 8.

HEVC encoding also lacks Sample Adaptive Offset (SAO). Adaptive quantization, look-ahead rate control, adaptive B-frames (H.264 only) and adaptive GOP features were added with the release of Nvidia Video Codec SDK 7.[14] These features rely on CUDA cores for hardware acceleration.

SDK 7 supports two forms of adaptive quantization; Spatial AQ (H.264 and HEVC) and Temporal AQ (H.264 only).

Nvidia's consumer-grade (GeForce) cards and some of its lower-end professional Quadro cards are restricted to three simultaneous encoding jobs. Its higher-end Quadro cards do not have this restriction.

Fourth generation, Pascal GP10x[edit]

Fourth generation NVENC implements HEVC Main10 10-bit hardware encoding. It also doubles the encoding performance of 4K H.264 & HEVC when compared to previous generation NVENC. It supports HEVC 8K, 4:4:4 chroma subsampling, lossless encoding, and sample adaptive offset (SAO).

Nvidia Video Codec SDK 8 added Pascal exclusive Weighted Prediction feature (CUDA based). Weighted prediction is not supported if the encode session is configured with B frames (H.264).

There is no B-Frame support for HEVC encoding, and the maximum CU size is 32×32.

The NVIDIA GT 1030 and the Mobile Quadro P500 are GP108 chips that don't support the NVENC encoder.[11]

In laptop graphics, NVIDIA MX Graphics do not include NVENC as they are based on a Maxwell-generation GM108 or a Pascal-generation GP108 chip.[15] The GeForce MX350 is a GP107 chip whose NVENC encoder is disabled during manufacture.

Fifth generation, Volta GV10x/Turing TU117[edit]

Volta NVENC has similar performance as Pascal's NVENC. [1]

It does not offer support for HEVC B-Frames.

In mobile graphics, as with most other GeForce MX-series graphics, the GeForce MX450 does not support NVENC as it is a TU117 chip whose hardware encoder is permanently disabled in its manufacture. The GeForce MX550, however, does support NVENC as its hardware encoder remains enabled at manufacturing level.

Sixth generation, Turing TU10x/TU116[edit]

Sixth generation NVENC implements HEVC 8K encoding at 30 FPS, HEVC B-frames and HEVC B-frames as reference (with support for each and middle modes[16]) and Alpha HEVC[17] support and provides up to 25% bitrate savings for HEVC and up to 15% bitrate savings for H.264. The initial launch of the Nvidia GeForce GTX 1650 was exempt from this generation however, as it used Volta NVENC instead of Turing. Nvidia updated the NVENC encoder of the GTX 1650 cards in 2020 to also use the Turing engine.[18] The GTX 1650 Super uses the Turing NVENC engine as it is based on the TU116 rather than the TU117 used in the original GTX 1650.[19]

Seventh generation, Ampere GA10x[edit]

Ampere has essentially the same NVENC generation engine as Turing.[20] The only substantive difference is that NVDEC received support for AV1 decoding (with film grain).

In entry-level mobile graphics, the GA107-chip-based GeForce MX570 comes in two versions, one of which (the GeForce MX570 A) has the hardware decoder and encoder permanently disabled during manufacturing.

Eighth generation, Ada Lovelace AD10x[edit]

Nvidia announced the next-gen NVENC with 8K 10-bit 60FPS AV1 fixed function hardware encoder in Ada Lovelace GPUs.[21][22]

Operating system support[edit]

The Nvidia NVENC SIP core needs to be supported by the device driver. The driver provides one or more interfaces, (e.g. OpenMAX IL) to NVENC. The NVENC SIP core can only be accessed through the proprietary NVENC API (as opposed to the open-source VDPAU API).

It is bundled with Nvidia's GeForce driver.

NVENC is available for Windows and Linux operating systems.[2] The free and open-source nouveau device driver does not support Nvidia NVENC.[23]

Application software support[edit]

GPU throughput[edit]

Comparison of Encode Throughput[36][citation needed]

Streams H.264 Encode (1080p30)
GM204(Tesla M6) 18
GM107(Tesla M10) 28
GM200(Tesla M40) 18
GM204(Tesla M60) 36
GP104(Tesla P4) 24
TU104(Tesla T4) 32
P100 36
V100 36

See also[edit]

References[edit]

  1. ^ "NVIDIA GeForce RTX 40 Series Graphics Cards". NVIDIA. Retrieved February 28, 2024.
  2. ^ a b c d "NVIDIA VIDEO CODEC SDK". NVIDIA Developer. Nvidia. August 23, 2013. Retrieved November 12, 2017.
  3. ^ "Maxwell's Feature Set: Kepler Refined". AnandTech. February 18, 2014.
  4. ^ "System Requirements for NVIDIA GeForce Experience | GeForce | GeForce". www.geforce.com. Retrieved August 17, 2016.
  5. ^ "Wirecast Tech Specs". telestream.net. Retrieved December 19, 2017.
  6. ^ "Open Broadcaster Software – Index". obsproject.com. Archived from the original on March 23, 2019. Retrieved August 17, 2016.
  7. ^ "nvidia-patch". GitHub.
  8. ^ Shilov, Anton (March 24, 2023). "Nvidia Lifts Some Video Encoding Limitations from Consumer GPUs". tomshardware. Retrieved March 26, 2023.
  9. ^ "Video Encode and Decode GPU Support Matrix".
  10. ^ "S5613 – High-Performance Video Encoding Using NVIDIA GPUs". Nvidia.
  11. ^ a b c "Video Encode and Decode GPU Support Matrix". NVIDIA Developer. November 9, 2016. Retrieved August 22, 2020.
  12. ^ a b "NVIDIA VIDEO CODEC SDK". NVIDIA Developer. November 9, 2016. Retrieved August 22, 2020.
  13. ^ "NVIDIA Ampere Architecture In-Depth". NVIDIA Developer Blog. May 14, 2020. Retrieved August 31, 2020.
  14. ^ http://on-demand.gputechconf.com/gtc/2016/presentation/s6226-abhijit-patait-high-performance-video.pdf [bare URL PDF]
  15. ^ "NVIDIA GeForce MX250 i MX230 – dwie "nowe" grafiki do laptopów". Dobre Programy (in Polish). February 21, 2019.
  16. ^ "B-Frame reference mode flag in ffmpeg nvenc is bugged and doesn't work. · Issue #2374 · obsproject/obs-studio". GitHub. Retrieved March 24, 2021.
  17. ^ Harrison, John (January 30, 2021). "johnhe4/nvenc_h265_transparency". GitHub. Retrieved March 24, 2021.
  18. ^ "NVIDIA GeForce GTX 1650 Graphics Card". NVIDIA. Retrieved March 24, 2021.
  19. ^ Walton, Jarred (November 23, 2019). "Nvidia GeForce GTX 1650 Super review". PC Gamer. Retrieved March 24, 2021.
  20. ^ "NVIDIA Ampere GA102 GPU Architecture: Second-Generation RTX" (PDF). NVIDIA. Retrieved September 21, 2022.
  21. ^ Gray, Jon (September 20, 2022). "Creativity At The Speed of Light: GeForce RTX 40 Series Graphics Cards Unleash Up To 2X Performance in 3D Rendering, AI, and Video Exports For Gamers and Creators". NVIDIA. Retrieved September 21, 2022.
  22. ^ "NVIDIA Video Codec SDK". NVIDIA. August 23, 2013. Retrieved September 21, 2022.
  23. ^ "Nouveau Feature Matrix". Freedesktop.org.
  24. ^ Tack, Stanley (May 19, 2020). "Cut to the Video: Adobe Premiere Pro Helps Content Creators Work Faster with GPU-Accelerated Exports | NVIDIA Blog". The Official NVIDIA Blog. Retrieved March 24, 2021.
  25. ^ "BRIDGE LIVE is a broadcast-quality, low-latency turnkey system".
  26. ^ AVIDemux Changelog
  27. ^ CyberLink Forum Official Post
  28. ^ "Blackmagic Forum • View topic – Davinci studio 16, NVENC unavailable". forum.blackmagicdesign.com. Retrieved March 24, 2021.
  29. ^ "nvenc.c H.264 hardware encoding using nvidia nvenc".
  30. ^ "QUADRO DESKTOP/QUADRO NOTEBOOK DRIVER RELEASE 375".
  31. ^ HandBrake 1.2.0 released
  32. ^ forum post by staff member saying there is an issue with the way the software is interacting with the encoder but at the same time saying it exsits
  33. ^ "Transcoding | Jellyfin".
  34. ^ MacroSystem Arabesk 8 info from Casablanca Expert
  35. ^ vMix 27 is here!
  36. ^ "NVIDIA vGPU Resources for Design & VIrtualization". NVIDIA. Retrieved March 24, 2021.

External links[edit]