[FFmpeg-user] Logo overlay and Webvtt subtitle rising RAM usages

[Jonathan Baecker]

Hello People,

I have a file with embed webvtt and I want to overlay on this a logo. 
But somehow ffmpeg start eating more and more RAM and sometimes this 
error came up:

  Application provided invalid, non monotonically increasing dts to 
muxer in stream 0: 750 >= 750

Command to reproduce:

ffmpeg -i video_audio_vtt.mkv -filter_complex 
"[0:v]null[v];movie=logo.png:loop=0,setpts=N/(FRAME_RATE*TB),format=rgba,colorchannelmixer=aa=0.7[l];[v][l]overlay=W-w-12:12:shortest=1[vout0]" 
-map "[vout0]" -map "0:a:0" -map 0:s:0 -c:s srt -f null -

Full output:

ffmpeg version git-2022-09-15-c9bd6ee Copyright (c) 2000-2022 the FFmpeg 
developers
   built with gcc 12 (GCC)
   configuration: --disable-debug --disable-shared --disable-doc 
--enable-gpl --enable-version3 --enable-runtime-cpudetect 
--enable-avfilter --enable-zlib --enable-decklink --enable-libklvanc 
--enable-fontconfig --enable-libaom --enable-libfdk-aac 
--enable-libfribidi --enable-libfreetype --enable-libmp3lame 
--enable-libopus --enable-libsoxr --enable-libsrt --enable-libtwolame 
--enable-libvpx --enable-libx264 --enable-libx265 --enable-libzmq 
--enable-nonfree --enable-opengl --enable-openssl --enable-libsvtav1 
--enable-lv2 --enable-librav1e --enable-libdav1d --enable-pic
   libavutil      57. 36.101 / 57. 36.101
   libavcodec     59. 43.100 / 59. 43.100
   libavformat    59. 31.100 / 59. 31.100
   libavdevice    59.  8.101 / 59.  8.101
   libavfilter     8. 49.100 /  8. 49.100
   libswscale      6.  8.112 /  6.  8.112
   libswresample   4.  9.100 /  4.  9.100
   libpostproc    56.  7.100 / 56.  7.100
Input #0, matroska,webm, from 'tests/assets/video_audio_vtt.mkv':
   Metadata:
     COMPATIBLE_BRANDS: isomiso2mp41
     MAJOR_BRAND     : isom
     MINOR_VERSION   : 512
     ENCODER         : Lavf59.31.100
   Duration: 00:00:30.02, start: 0.000000, bitrate: 151 kb/s
   Stream #0:0: Video: hevc (Main), yuv420p(tv, bt470bg/unknown/unknown, 
progressive), 1280x720 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 1k tbn (default)
     Metadata:
       HANDLER_NAME    : VideoHandler
       VENDOR_ID       : [0][0][0][0]
       ENCODER         : Lavc59.43.100 libx265
       DURATION        : 00:00:30.021000000
   Stream #0:1: Audio: aac (LC), 48000 Hz, stereo, fltp (default)
     Metadata:
       HANDLER_NAME    : SoundHandler
       VENDOR_ID       : [0][0][0][0]
       DURATION        : 00:00:30.021000000
   Stream #0:2: Subtitle: webvtt
     Metadata:
       DURATION        : 00:00:20.321000000
Input #1, png_pipe, from 'tests/assets/logo.png':
   Duration: N/A, bitrate: N/A
   Stream #1:0: Video: png, rgba(pc), 42x42 [SAR 2835:2835 DAR 1:1], 25 
fps, 25 tbr, 25 tbn
Stream mapping:
   Stream #0:0 (hevc) -> overlay (graph 0)
   Stream #1:0 (png) -> format:default (graph 0)
   format:default (graph 0) -> Stream #0:0 (wrapped_avframe)
   Stream #0:1 -> #0:1 (aac (native) -> pcm_s16le (native))
   Stream #0:2 -> #0:2 (webvtt (native) -> subrip (srt))
Press [q] to stop, [?] for help
Output #0, null, to 'pipe:':
   Metadata:
     COMPATIBLE_BRANDS: isomiso2mp41
     MAJOR_BRAND     : isom
     MINOR_VERSION   : 512
     encoder         : Lavf59.31.100
   Stream #0:0: Video: wrapped_avframe, yuv420p(tv, progressive), 
1280x720 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 25 fps, 25 tbn
     Metadata:
       encoder         : Lavc59.43.100 wrapped_avframe
   Stream #0:1: Audio: pcm_s16le, 48000 Hz, stereo, s16, 1536 kb/s (default)
     Metadata:
       HANDLER_NAME    : SoundHandler
       VENDOR_ID       : [0][0][0][0]
       DURATION        : 00:00:30.021000000
       encoder         : Lavc59.43.100 pcm_s16le
   Stream #0:2: Subtitle: subrip
     Metadata:
       DURATION        : 00:00:20.321000000
       encoder         : Lavc59.43.100 srt
[null @ 0x55850c0] Application provided invalid, non monotonically 
increasing dts to muxer in stream 0: 750 >= 750
frame= 7040 fps=185 q=-0.0 Lsize=N/A time=00:04:41.56 bitrate=N/A 
speed=7.41x
video:3300kB audio:5632kB subtitle:0kB other streams:0kB global 
headers:0kB muxing overhead: unknown
Exiting normally, received signal 2.

I will attach the file, so you can test this to.

You will also notice that the progress is not counting normal, the frame 
numbers a jumping.

Any idea what is happen here, and how I can handle this?

Regards

Jonathan

-------------- next part --------------
A non-text attachment was scrubbed...
Name: video_audio_vtt.mkv
Type: video/x-matroska
Size: 566771 bytes
Desc: not available
URL: <https://ffmpeg.org/pipermail/ffmpeg-user/attachments/20221019/abfc3fba/attachment.mkv>