[FFmpeg-trac] #8556(avcodec:new): PCM 24-bit integer sample format encoding introduces more quantification error

FFmpeg trac at avcodec.org
Sat Mar 7 15:06:18 EET 2020


#8556: PCM 24-bit integer sample format encoding introduces more quantification
error
-------------------------------------+-----------------------------------
             Reporter:  Prcuvu       |                    Owner:
                 Type:  defect       |                   Status:  new
             Priority:  normal       |                Component:  avcodec
              Version:  unspecified  |               Resolution:
             Keywords:               |               Blocked By:
             Blocking:               |  Reproduced by developer:  0
Analyzed by developer:  0            |
-------------------------------------+-----------------------------------

Comment (by Ishisashi):

 The input value is 0x33C00000 and the output value is 0x000000.
 0x33C00000 is 8.94069671630859375×10^-8^, and
 (8.94069671630859375×10^-8^×2^23^) is 0.75, which is rounded to 0 in
 output.

--
Ticket URL: <https://trac.ffmpeg.org/ticket/8556#comment:2>
FFmpeg <https://ffmpeg.org>
FFmpeg issue tracker


More information about the FFmpeg-trac mailing list