[FFmpeg-trac] #11655(avcodec:new): Cuda/nvdec hwaccel outputs P016LE instead of P010LE on 10bit video

[FFmpeg]

#11655: Cuda/nvdec hwaccel outputs P016LE instead of P010LE on 10bit video
-------------------------------------+-------------------------------------
             Reporter:  nyanmisaka   |                     Type:  defect
               Status:  new          |                 Priority:  normal
            Component:  avcodec      |                  Version:  git-
             Keywords:  cuda nvdec   |  master
  nvidia hwaccel                     |               Blocked By:
             Blocking:               |  Reproduced by developer:  0
Analyzed by developer:  0            |
-------------------------------------+-------------------------------------
 Summary of the bug: Cuda/nvdec hwaccel outputs P016LE instead of P010LE on
 10bit video.

 How to reproduce:
 {{{
 ffmpeg -hwaccel cuda -hwaccel_output_format cuda \
 -i /path/to/10bit-video -an -sn -dn -vf hwdownload,format=p010le -f null -

 ...

 [hwdownload @ 0000020612888240] Invalid output format p010le for hwframe
 download.
 [Parsed_hwdownload_0 @ 00000206106e7140] Failed to configure output pad on
 Parsed_hwdownload_0
 [vf#0:0 @ 0000020610752240] Error reinitializing filters!
 }}}

 Regression caused by
 https://git.ffmpeg.org/gitweb/ffmpeg.git/commit/30e6effff94c6f4310aa2db571917bb2952f4d9e

 For correctness and consistency with the old behavior, a change like this
 is required in the above commit:
 {{{
 +        } else {
 +            frames_ctx->sw_format = sw_desc->comp[0].depth == 10 ?
 AV_PIX_FMT_P010LE : AV_PIX_FMT_P016LE;
 +        }
 }}}
-- 
Ticket URL: <https://trac.ffmpeg.org/ticket/11655>
FFmpeg <https://ffmpeg.org>
FFmpeg issue tracker