[FFmpeg-trac] #10164(undetermined:new): Segfault dual pass transcoding AVC to AV1

[FFmpeg]

#10164: Segfault dual pass transcoding AVC to AV1
-------------------------------------+-------------------------------------
             Reporter:  Ferdi        |                     Type:  defect
  Scholten                           |
               Status:  new          |                 Priority:  normal
            Component:               |                  Version:  git-
  undetermined                       |  master
             Keywords:               |               Blocked By:
             Blocking:               |  Reproduced by developer:  0
Analyzed by developer:  0            |
-------------------------------------+-------------------------------------
 Summary of the bug: Transcoding video to AV1 with libaom in dual pass mode
 often ends with segfault. Transcoding the same video in single pass mode
 with the same parameters always works fine.

 Might happen with several input formats such as AVC, h264 or MP4 ASP. The
 segfault does not always happen on all files of these types. The segfault
 does always occur at the end of the transcode, the resulting output video
 is missing everything after the last keyframe of the input.

 This might already be going on for some time as I mainly use scripts
 (without screen output) to transcode in bulk.

 ffmpeg[10706]: segfault at 28 ip 000055e092c976e1 sp 00007fff3e1e6f08
 error 4 in ffmpeg[55e091270000+280a000] likely on CPU 5 (core 2, socket 0)

 How to reproduce:
 ffmpeg -i test.mkv -c:v libaom-av1 -pass 1 -cpu-used 4 -row-mt true
 -threads 8 -lag-in-frames 48 -crf 35 -tiles 1x2 -aq-mode 3 -an -f null
 /dev/null
 ffmpeg -i test.mkv -c:v libaom-av1 -pass 2 -cpu-used 4 -row-mt true
 -threads 8 -lag-in-frames 48 -crf 35 -tiles 1x2 -aq-mode 3 -c:a libopus
 -vbr on -c:s copy A/test.mkv

 ffmpeg version N-109745-g7d49fef8b4 Copyright (c) 2000-2023 the FFmpeg
 developers
   built with gcc 12 (Ubuntu 12.2.0-3ubuntu1)
   configuration: --prefix=/home/ferdi/ffmpeg_build --pkg-config-
 flags=--static --extra-cflags=-I/home/ferdi/ffmpeg_build/include --extra-
 ldflags=-L/home/ferdi/ffmpeg_build/lib --extra-libs='-lpthread -lm'
 --ld=g++ --bindir=/home/ferdi/bin --enable-gpl --enable-gnutls --enable-
 libaom --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-
 libmp3lame --enable-libopus --enable-libsvtav1 --enable-libdav1d --enable-
 libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-
 nonfree --enable-libvmaf --enable-lto
   libavutil      57. 44.100 / 57. 44.100
   libavcodec     59. 61.100 / 59. 61.100
   libavformat    59. 37.100 / 59. 37.100
   libavdevice    59.  8.101 / 59.  8.101
   libavfilter     8. 56.100 /  8. 56.100
   libswscale      6.  8.112 /  6.  8.112
   libswresample   4.  9.100 /  4.  9.100
   libpostproc    56.  7.100 / 56.  7.100
-- 
Ticket URL: <https://trac.ffmpeg.org/ticket/10164>
FFmpeg <https://ffmpeg.org>
FFmpeg issue tracker