[FFmpeg-trac] #11655(avcodec:closed): Cuda/nvdec hwaccel outputs P016LE instead of P010LE on 10bit video

[FFmpeg]

#11655: Cuda/nvdec hwaccel outputs P016LE instead of P010LE on 10bit video
-------------------------------------+-------------------------------------
             Reporter:  nyanmisaka   |                    Owner:  Timo
                                     |  Rothenpieler <timo@…>
                 Type:  defect       |                   Status:  closed
             Priority:  normal       |                Component:  avcodec
              Version:  git-master   |               Resolution:  fixed
             Keywords:  cuda nvdec   |               Blocked By:
  nvidia hwaccel                     |
             Blocking:               |  Reproduced by developer:  0
Analyzed by developer:  0            |
-------------------------------------+-------------------------------------
Comment (by nyanmisaka):

 Replying to [comment:11 Timo R.]:
 > And I can't see anything wrong in cuviddec.c, it correctly outputs P010
 for 10 bit 420.

 Hi Timo, you can use this command line to reproduce the problem in CUVID.
 And here is the log:

 {{{
 ffmpeg -v quiet -f lavfi -i nullsrc=s=1920x1080,format=p010le \
 -c:v hevc_nvenc -vframes 1 -f nut - | ffmpeg -c:v hevc_cuvid -i - -f null
 -


 ffmpeg version N-120169-g0fe9f25e76-20250704 Copyright (c) 2000-2025 the
 FFmpeg developers
   built with gcc 15.1.0 (crosstool-NG 1.27.0.42_35c1e72)
   configuration: --prefix=/ffbuild/prefix --pkg-config-flags=--static
 --pkg-config=pkg-config --cross-prefix=x86_64-w64-mingw32- --arch=x86_64
 --target-os=mingw32 --enable-gpl --enable-version3 --disable-debug
 --disable-w32threads --enable-pthreads --enable-iconv --enable-zlib
 --enable-libfribidi --enable-gmp --enable-libxml2 --enable-lzma --enable-
 fontconfig --enable-libharfbuzz --enable-libfreetype --enable-libvorbis
 --enable-opencl --disable-libpulse --enable-libvmaf --disable-libxcb
 --disable-xlib --enable-amf --enable-libaom --enable-libaribb24 --enable-
 avisynth --enable-chromaprint --enable-libdav1d --enable-libdavs2
 --enable-libdvdread --enable-libdvdnav --disable-libfdk-aac --enable-
 ffnvcodec --enable-cuda-llvm --enable-frei0r --enable-libgme --enable-
 libkvazaar --enable-libaribcaption --enable-libass --enable-libbluray
 --enable-libjxl --enable-libmp3lame --enable-libopus --enable-librist
 --enable-libssh --enable-libtheora --enable-libvpx --enable-libwebp
 --enable-libzmq --enable-lv2 --enable-libvpl --enable-openal --enable-
 liboapv --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-
 libopenh264 --enable-libopenjpeg --enable-libopenmpt --enable-librav1e
 --enable-librubberband --enable-schannel --enable-sdl2 --enable-libsnappy
 --enable-libsoxr --enable-libsrt --enable-libsvtav1 --enable-libtwolame
 --enable-libuavs3d --disable-libdrm --enable-vaapi --enable-libvidstab
 --enable-vulkan --enable-libshaderc --enable-libplacebo --enable-libvvenc
 --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxvid
 --enable-libzimg --enable-libzvbi --extra-cflags=-DLIBTWOLAME_STATIC
 --extra-cxxflags= --extra-libs=-lgomp --extra-ldflags=-pthread --extra-
 ldexeflags= --cc=x86_64-w64-mingw32-gcc --cxx=x86_64-w64-mingw32-g++
 --ar=x86_64-w64-mingw32-gcc-ar --ranlib=x86_64-w64-mingw32-gcc-ranlib
 --nm=x86_64-w64-mingw32-gcc-nm --extra-version=20250704
   libavutil      60.  4.101 / 60.  4.101
   libavcodec     62.  5.100 / 62.  5.100
   libavformat    62.  1.101 / 62.  1.101
   libavdevice    62.  0.100 / 62.  0.100
   libavfilter    11.  1.100 / 11.  1.100
   libswscale      9.  0.100 /  9.  0.100
   libswresample   6.  0.100 /  6.  0.100
 Input #0, nut, from 'fd:':
   Metadata:
     encoder         : Lavf62.1.101
   Duration: N/A, bitrate: N/A
   Stream #0:0: Video: hevc (Main 10) (HEVC / 0x43564548), yuv420p10le(tv),
 1920x1080 [SAR 1:1 DAR 16:9], 25 tbr, 51200 tbn
     Metadata:
       encoder         : Lavc62.5.100 hevc_nvenc
 Stream mapping:
   Stream #0:0 -> #0:0 (hevc (hevc_cuvid) -> wrapped_avframe (native))
 Output #0, null, to 'pipe:':
   Metadata:
     encoder         : Lavf62.1.101
   Stream #0:0: Video: wrapped_avframe, p016le(tv, progressive), 1920x1080
 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 25 fps, 25 tbn
     Metadata:
       encoder         : Lavc62.5.100 wrapped_avframe
 [out#0/null @ 000001474eee9ec0] video:0KiB audio:0KiB subtitle:0KiB other
 streams:0KiB global headers:0KiB muxing overhead: unknown
 frame=    1 fps=0.0 q=-0.0 Lsize=N/A time=00:00:00.16 bitrate=N/A
 speed=7.97x elapsed=0:00:00.02
 }}}

 As you can see, the CUVID decoder is outputting P016 format.
 {{{
 Stream #0:0: Video: wrapped_avframe, p016le(tv, progressive), 1920x1080
 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 25 fps, 25 tbn
 }}}
-- 
Ticket URL: <https://trac.ffmpeg.org/ticket/11655#comment:13>
FFmpeg <https://ffmpeg.org>
FFmpeg issue tracker