[FFmpeg-trac] #10923(undetermined:new): crash when encode with libx265

[FFmpeg]

#10923: crash when encode with libx265
-------------------------------------+-------------------------------------
             Reporter:  Viacheslav   |                    Owner:  (none)
                 Type:  defect       |                   Status:  new
             Priority:  normal       |                Component:
                                     |  undetermined
              Version:  6.1          |               Resolution:
             Keywords:  crash        |               Blocked By:
             Blocking:               |  Reproduced by developer:  0
Analyzed by developer:  0            |
-------------------------------------+-------------------------------------
Description changed by Viacheslav:

Old description:

> Summary of the bug: when i try encode have several errors and ffmpeg
> crash
>
> `malloc_consolidate(): invalid chunk size` or `corrupted double-linked`
> or `double free or corruption` or `corrupted size vs. prev_size` or
> `Segmentation fault`
>

> How to reproduce:
> {{{
> ffmpeg -i ./sample_caused_crash_264to265.mkv -map 0 -c:v libx265 -preset
> medium -crf 23 ./output.mkv
> }}}
>
> {{{
> ffmpeg version 6.1.1 Copyright (c) 2000-2023 the FFmpeg developers
> built with gcc 11 (Ubuntu 11.4.0-1ubuntu1~22.04)
> configuration: --enable-nonfree --enable-gpl --enable-openssl --enable-
> libdav1d --enable-libsvtav1 --enable-libx264 --enable-libx265 --enable-
> libvpx --enable-libxvid --enable-libvidstab --enable-libaom --enable-
> libzimg --enable-lv2 --enable-libopencore_amrnb --enable-
> libopencore_amrwb --enable-libmp3lame --enable-libopus --enable-libvorbis
> --enable-libtheora --enable-libfdk-aac --enable-libwebp --enable-
> libfreetype --enable-libsrt --enable-libzmq --disable-ffnvcodec --enable-
> amf --disable-shared --enable-pthreads --enable-static --enable-version3
> --extra-cflags='-I/app/workspace/include -I/app/workspace/include/lilv-0'
> --extra-ldexeflags= --extra-ldflags=-L/app/workspace/lib --extra-
> libs='-ldl -lpthread -lm -lz' --pkgconfigdir=/app/workspace/lib/pkgconfig
> --pkg-config-flags=--static --prefix=/app/workspace --extra-version=
> libavutil      58. 29.100 / 58. 29.100
> libavcodec     60. 31.102 / 60. 31.102
> libavformat    60. 16.100 / 60. 16.100
> libavdevice    60.  3.100 / 60.  3.100
> libavfilter     9. 12.100 /  9. 12.100
> libswscale      7.  5.100 /  7.  5.100
> libswresample   4. 12.100 /  4. 12.100
> libpostproc    57.  3.100 / 57.  3.100
> }}}

New description:

 Summary of the bug: when i try encode have several errors and ffmpeg crash

 `malloc_consolidate(): invalid chunk size` or `corrupted double-linked` or
 `double free or corruption` or `corrupted size vs. prev_size` or
 `Segmentation fault`


 How to reproduce:
 {{{
 ffmpeg -i ./sample_caused_crash_264to265.mkv -map 0 -c:v libx265 -preset
 medium -crf 23 ./output.mkv
 }}}

 sample file uploaded to videolan

 {{{
 ffmpeg version 6.1.1 Copyright (c) 2000-2023 the FFmpeg developers
 built with gcc 11 (Ubuntu 11.4.0-1ubuntu1~22.04)
 configuration: --enable-nonfree --enable-gpl --enable-openssl --enable-
 libdav1d --enable-libsvtav1 --enable-libx264 --enable-libx265 --enable-
 libvpx --enable-libxvid --enable-libvidstab --enable-libaom --enable-
 libzimg --enable-lv2 --enable-libopencore_amrnb --enable-libopencore_amrwb
 --enable-libmp3lame --enable-libopus --enable-libvorbis --enable-libtheora
 --enable-libfdk-aac --enable-libwebp --enable-libfreetype --enable-libsrt
 --enable-libzmq --disable-ffnvcodec --enable-amf --disable-shared
 --enable-pthreads --enable-static --enable-version3 --extra-
 cflags='-I/app/workspace/include -I/app/workspace/include/lilv-0' --extra-
 ldexeflags= --extra-ldflags=-L/app/workspace/lib --extra-libs='-ldl
 -lpthread -lm -lz' --pkgconfigdir=/app/workspace/lib/pkgconfig --pkg-
 config-flags=--static --prefix=/app/workspace --extra-version=
 libavutil      58. 29.100 / 58. 29.100
 libavcodec     60. 31.102 / 60. 31.102
 libavformat    60. 16.100 / 60. 16.100
 libavdevice    60.  3.100 / 60.  3.100
 libavfilter     9. 12.100 /  9. 12.100
 libswscale      7.  5.100 /  7.  5.100
 libswresample   4. 12.100 /  4. 12.100
 libpostproc    57.  3.100 / 57.  3.100
 }}}

--
-- 
Ticket URL: <https://trac.ffmpeg.org/ticket/10923#comment:1>
FFmpeg <https://ffmpeg.org>
FFmpeg issue tracker