[FFmpeg-user] Running ffmpeg on AWS Lambda

Ehsan Afzali eafzali at gmail.com
Sat Sep 17 00:36:00 EEST 2016


Hi,

Yes I have also tried it with different ram allocation and always ends
there. and here is the result with the latest git verision:

"stackTrace": [
    "ffmpeg version N-81664-g6f062eb-static
http://johnvansickle.com/ffmpeg/  Copyright (c) 2000-2016 the FFmpeg
developers",
    "  built with gcc 5.4.1 (Debian 5.4.1-2) 20160904",
    "  configuration: --enable-gpl --enable-version3 --enable-static
--disable-debug --enable-libmp3lame --enable-libx264 --enable-libx265
--enable-libwebp --enable-libspeex --enable-libvorbis --enable-libvpx
--enable-libfreetype --enable-fontconfig --enable-libxvid
--enable-libopencore-amrnb --enable-libopencore-amrwb
--enable-libtheora --enable-libvo-amrwbenc --enable-gray
--enable-libopenjpeg --enable-libopus --enable-libass --enable-gnutls
--enable-libvidstab --enable-libsoxr --enable-frei0r
--enable-libfribidi --disable-indev=sndio --disable-outdev=sndio
--enable-librtmp --enable-libmfx --enable-libzimg --cc=gcc-5",
    "  libavutil      55. 29.100 / 55. 29.100",
    "  libavcodec     57. 55.101 / 57. 55.101",
    "  libavformat    57. 49.100 / 57. 49.100",
    "  libavdevice    57.  0.102 / 57.  0.102",
    "  libavfilter     6. 62.100 /  6. 62.100",
    "  libswscale      4.  1.100 /  4.  1.100",
    "  libswresample   2.  1.100 /  2.  1.100",
    "  libpostproc    54.  0.100 / 54.  0.100",
    "Splitting the commandline.",
    "Reading option '-y' ... matched as option 'y' (overwrite output
files) with argument '1'.",
    "Reading option '-loglevel' ... matched as option 'loglevel' (set
logging level) with argument 'debug'.",
    "Reading option '-framerate' ... matched as AVOption 'framerate'
with argument '1'.",
    "Reading option '-i' ... matched as input file with argument
'/tmp/253df2a0-7c55-11e6-bc4a-432268f26650/%03d.jpg'.",
    "Reading option '-c:v' ... matched as option 'c' (codec name) with
argument 'libx264'.",
    "Reading option '-r' ... matched as option 'r' (set frame rate (Hz
value, fraction or abbreviation)) with argument '30'.",
    "Reading option '-pix_fmt' ... matched as option 'pix_fmt' (set
pixel format) with argument 'yuv420p'.",
    "Reading option '/tmp/25c80a30-7c55-11e6-bc4a-432268f26650.mp4'
... matched as output file.",
    "Finished splitting the commandline.",
    "Parsing a group of options: global .",
    "Applying option y (overwrite output files) with argument 1.",
    "Applying option loglevel (set logging level) with argument debug.",
    "Successfully parsed a group of options.",
    "Parsing a group of options: input file
/tmp/253df2a0-7c55-11e6-bc4a-432268f26650/%03d.jpg.",
    "Successfully parsed a group of options.",
    "Opening an input file:
/tmp/253df2a0-7c55-11e6-bc4a-432268f26650/%03d.jpg.",
    "[file @ 0x4d60480] Setting default whitelist 'file,crypto'",
    "[AVIOContext @ 0x4d60760] Statistics: 9804675 bytes read, 0 seeks",
    "[mjpeg @ 0x4d60000] marker=d8 avail_size_in_buf=9804673",
    "[mjpeg @ 0x4d60000] marker parser used 0 bytes (0 bits)",
    "[mjpeg @ 0x4d60000] marker=e1 avail_size_in_buf=9804671",
    "[mjpeg @ 0x4d60000] marker parser used 20785 bytes (166280 bits)",
    "[mjpeg @ 0x4d60000] marker=db avail_size_in_buf=9783883",
    "[mjpeg @ 0x4d60000] index=0",
    "[mjpeg @ 0x4d60000] qscale[0]: 0",
    "[mjpeg @ 0x4d60000] index=1",
    "[mjpeg @ 0x4d60000] qscale[1]: 0",
    "[mjpeg @ 0x4d60000] marker parser used 132 bytes (1056 bits)",
    "[mjpeg @ 0x4d60000] marker=c0 avail_size_in_buf=9783749",
    "[mjpeg @ 0x4d60000] Changing bps from 0 to 8",
    "[mjpeg @ 0x4d60000] sof0: picture: 5312x2988",
    "[mjpeg @ 0x4d60000] component 0 2:2 id: 0 quant:0",
    "[mjpeg @ 0x4d60000] component 1 1:1 id: 1 quant:1",
    "[mjpeg @ 0x4d60000] component 2 1:1 id: 2 quant:1",
    "[mjpeg @ 0x4d60000] pix fmt id 22111100",
    "[mjpeg @ 0x4d60000] marker parser used 17 bytes (136 bits)",
    "[mjpeg @ 0x4d60000] marker=c4 avail_size_in_buf=9783730",
    "[mjpeg @ 0x4d60000] marker parser used 0 bytes (0 bits)",
    "[mjpeg @ 0x4d60000] escaping removed 36375 bytes",
    "[mjpeg @ 0x4d60000] marker=da avail_size_in_buf=9783310",
    "[mjpeg @ 0x4d60000] marker parser used 0 bytes (0 bits)",
    "[mjpeg @ 0x4d60000] marker=d9 avail_size_in_buf=0",
    "[mjpeg @ 0x4d60000] decode frame unused 0 bytes",
    "[image2 @ 0x4d5e760] Probe buffer size limit of 5000000 bytes reached",
    "Input #0, image2, from
'/tmp/253df2a0-7c55-11e6-bc4a-432268f26650/%03d.jpg':",
    "  Duration: 00:00:04.00, start: 0.000000, bitrate: N/A",
    "    Stream #0:0, 1, 1/1: Video: mjpeg, 1 reference frame,
yuvj420p(pc, bt470bg/unknown/unknown, center), 5312x2988, 0/1, 1 tbr,
1 tbn, 1 tbc",
    "Successfully opened the file.",
    "Parsing a group of options: output file
/tmp/25c80a30-7c55-11e6-bc4a-432268f26650.mp4.",
    "Applying option c:v (codec name) with argument libx264.",
    "Applying option r (set frame rate (Hz value, fraction or
abbreviation)) with argument 30.",
    "Applying option pix_fmt (set pixel format) with argument yuv420p.",
    "Successfully parsed a group of options.",
    "Opening an output file: /tmp/25c80a30-7c55-11e6-bc4a-432268f26650.mp4.",
    "[file @ 0x4d66460] Setting default whitelist 'file,crypto'",
    "Successfully opened the file.",
    "detected 2 logical cores",
    "[graph 0 input from stream 0:0 @ 0x4d655c0] Setting 'video_size'
to value '5312x2988'",
    "[graph 0 input from stream 0:0 @ 0x4d655c0] Setting 'pix_fmt' to
value '12'",
    "[graph 0 input from stream 0:0 @ 0x4d655c0] Setting 'time_base'
to value '1/1'",
    "[graph 0 input from stream 0:0 @ 0x4d655c0] Setting
'pixel_aspect' to value '0/1'",
    "[graph 0 input from stream 0:0 @ 0x4d655c0] Setting 'sws_param'
to value 'flags=2'",
    "[graph 0 input from stream 0:0 @ 0x4d655c0] Setting 'frame_rate'
to value '1/1'",
    "[graph 0 input from stream 0:0 @ 0x4d655c0] w:5312 h:2988
pixfmt:yuvj420p tb:1/1 fr:1/1 sar:0/1 sws_param:flags=2",
    "[format @ 0x4d65440] compat: called with args=[yuv420p]",
    "[format @ 0x4d65440] Setting 'pix_fmts' to value 'yuv420p'",
    "[auto-inserted scaler 0 @ 0x4d64060] Setting 'flags' to value 'bicubic'",
    "[auto-inserted scaler 0 @ 0x4d64060] w:iw h:ih flags:'bicubic' interl:0",
    "[format @ 0x4d65440] auto-inserting filter 'auto-inserted scaler
0' between the filter 'Parsed_null_0' and the filter 'format'",
    "[AVFilterGraph @ 0x4d65da0] query_formats: 4 queried, 2 merged, 1
already done, 0 delayed",
    "[swscaler @ 0x4d6e9c0] deprecated pixel format used, make sure
you did set range correctly",
    "[auto-inserted scaler 0 @ 0x4d64060] w:5312 h:2988 fmt:yuvj420p
sar:0/1 -> w:5312 h:2988 fmt:yuv420p sar:0/1 flags:0x4",
    "[libx264 @ 0x4d62ec0] using mv_range_thread = 504",
    "[libx264 @ 0x4d62ec0] frame MB size (332x187) > level limit (36864)",
    "[libx264 @ 0x4d62ec0] DPB size (4 frames, 248336 mbs) > level
limit (2 frames, 184320 mbs)",
    "[libx264 @ 0x4d62ec0] using cpu capabilities: MMX2 SSE2Fast SSSE3
SSE4.2 AVX",
    "[libx264 @ 0x4d62ec0] profile High, level 5.2",
    "[libx264 @ 0x4d62ec0] 264 - core 148 r276 3f5ed56 - H.264/MPEG-4
AVC codec - Copyleft 2003-2016 - http://www.videolan.org/x264.html -
options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7
psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1
8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2
threads=3 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1
interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2
b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250
keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf
mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40
aq=1:1.00",
    "[mp4 @ 0x4d61a00] Using AVStream.codec to pass codec parameters
to muxers is deprecated, use AVStream.codecpar instead.",
    "Output #0, mp4, to '/tmp/25c80a30-7c55-11e6-bc4a-432268f26650.mp4':",
    "  Metadata:",
    "    encoder         : Lavf57.49.100",
    "    Stream #0:0, 0, 1/15360: Video: h264 (libx264), 1 reference
frame ([33][0][0][0] / 0x0021), yuv420p(center), 5312x2988, 0/1,
q=-1--1, 30 fps, 15360 tbn, 30 tbc",
    "    Metadata:",
    "      encoder         : Lavc57.55.101 libx264",
    "    Side data:",
    "      cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: -1",
    "Stream mapping:",
    "  Stream #0:0 -> #0:0 (mjpeg (native) -> h264 (libx264))",
    "Press [q] to stop, [?] for help",
    "cur_dts is invalid (this is harmless if it occurs once at the
start per stream)",
    "[mjpeg @ 0x4d60c60] marker=d8 avail_size_in_buf=9804673",
    "[mjpeg @ 0x4d60c60] marker parser used 0 bytes (0 bits)",
    "[mjpeg @ 0x4d60c60] marker=e1 avail_size_in_buf=9804671",
    "[mjpeg @ 0x4d60c60] marker parser used 20785 bytes (166280 bits)",
    "[mjpeg @ 0x4d60c60] marker=db avail_size_in_buf=9783883",
    "[mjpeg @ 0x4d60c60] index=0",
    "[mjpeg @ 0x4d60c60] qscale[0]: 0",
    "[mjpeg @ 0x4d60c60] index=1",
    "[mjpeg @ 0x4d60c60] qscale[1]: 0",
    "[mjpeg @ 0x4d60c60] marker parser used 132 bytes (1056 bits)",
    "[mjpeg @ 0x4d60c60] marker=c0 avail_size_in_buf=9783749",
    "[mjpeg @ 0x4d60c60] sof0: picture: 5312x2988",
    "[mjpeg @ 0x4d60c60] component 0 2:2 id: 0 quant:0",
    "[mjpeg @ 0x4d60c60] component 1 1:1 id: 1 quant:1",
    "[mjpeg @ 0x4d60c60] component 2 1:1 id: 2 quant:1",
    "[mjpeg @ 0x4d60c60] pix fmt id 22111100",
    "[mjpeg @ 0x4d60c60] marker parser used 17 bytes (136 bits)",
    "[mjpeg @ 0x4d60c60] marker=c4 avail_size_in_buf=9783730",
    "[mjpeg @ 0x4d60c60] class=0 index=0 nb_codes=12",
    "[mjpeg @ 0x4d60c60] class=1 index=0 nb_codes=251",
    "[mjpeg @ 0x4d60c60] class=0 index=1 nb_codes=12",
    "[mjpeg @ 0x4d60c60] class=1 index=1 nb_codes=251",
    "[mjpeg @ 0x4d60c60] marker parser used 418 bytes (3344 bits)",
    "[mjpeg @ 0x4d60c60] escaping removed 36375 bytes",
    "[mjpeg @ 0x4d60c60] marker=da avail_size_in_buf=9783310",
    "[mjpeg @ 0x4d60c60] component: 0",
    "[mjpeg @ 0x4d60c60] component: 1",
    "[mjpeg @ 0x4d60c60] component: 2",
    "[mjpeg @ 0x4d60c60] marker parser used 9746934 bytes (77975466 bits)",
    "[mjpeg @ 0x4d60c60] marker=d9 avail_size_in_buf=0",
    "[mjpeg @ 0x4d60c60] decode frame unused 0 bytes",
    "Clipping frame in rate conversion by 0.000008",
    "*** 29 dup!",
    "cur_dts is invalid (this is harmless if it occurs once at the
start per stream)",
    "[file @ 0x5cef420] Setting default whitelist 'file,crypto'",
    "[AVIOContext @ 0x5cef240] Statistics: 9804675 bytes read, 0 seeks",
    "[mjpeg @ 0x4d60c60] marker=d8 avail_size_in_buf=9804673",
    "[mjpeg @ 0x4d60c60] marker parser used 0 bytes (0 bits)",
    "[mjpeg @ 0x4d60c60] marker=e1 avail_size_in_buf=9804671",
    "[mjpeg @ 0x4d60c60] marker parser used 20785 bytes (166280 bits)",
    "[mjpeg @ 0x4d60c60] marker=db avail_size_in_buf=9783883",
    "[mjpeg @ 0x4d60c60] index=0",
    "[mjpeg @ 0x4d60c60] qscale[0]: 0",
    "[mjpeg @ 0x4d60c60] index=1",
    "[mjpeg @ 0x4d60c60] qscale[1]: 0",
    "[mjpeg @ 0x4d60c60] marker parser used 132 bytes (1056 bits)",
    "[mjpeg @ 0x4d60c60] marker=c0 avail_size_in_buf=9783749",
    "[mjpeg @ 0x4d60c60] sof0: picture: 5312x2988",
    "[mjpeg @ 0x4d60c60] component 0 2:2 id: 0 quant:0",
    "[mjpeg @ 0x4d60c60] component 1 1:1 id: 1 quant:1",
    "[mjpeg @ 0x4d60c60] component 2 1:1 id: 2 quant:1",
    "[mjpeg @ 0x4d60c60] pix fmt id 22111100",
    "[mjpeg @ 0x4d60c60] marker parser used 17 bytes (136 bits)",
    "[mjpeg @ 0x4d60c60] marker=c4 avail_size_in_buf=9783730",
    "[mjpeg @ 0x4d60c60] class=0 index=0 nb_codes=12",
    "[mjpeg @ 0x4d60c60] class=1 index=0 nb_codes=251",
    "[mjpeg @ 0x4d60c60] class=0 index=1 nb_codes=12",
    "[mjpeg @ 0x4d60c60] class=1 index=1 nb_codes=251",
    "[mjpeg @ 0x4d60c60] marker parser used 418 bytes (3344 bits)",
    "[mjpeg @ 0x4d60c60] escaping removed 36375 bytes",
    "[mjpeg @ 0x4d60c60] marker=da avail_size_in_buf=9783310",
    "[mjpeg @ 0x4d60c60] component: 0",
    "[mjpeg @ 0x4d60c60] component: 1",
    "[mjpeg @ 0x4d60c60] component: 2",
    "[mjpeg @ 0x4d60c60] marker parser used 9746934 bytes (77975466 bits)",
    "[mjpeg @ 0x4d60c60] marker=d9 avail_size_in_buf=0",
    "[mjpeg @ 0x4d60c60] decode frame unused 0 bytes",
    "*** 29 dup!",
    "",
    "ChildProcess.exithandler (child_process.js:213:12)",
    "emitTwo (events.js:87:13)",
    "ChildProcess.emit (events.js:172:7)",
    "maybeClose (internal/child_process.js:821:16)",
    "Process.ChildProcess._handle.onexit (internal/child_process.js:211:5)"
  ]
}


Thanks
On Fri, 16 Sep 2016 at 8:41 pm, Moritz Barsnick <barsnick at gmx.net> wrote:

> On Fri, Sep 16, 2016 at 14:16:40 +0000, Ehsan Afzali wrote:
> > I've created a gist with both outputs here:
> > https://gist.github.com/eafzali/85a056468d6449a0f4a01d4422a114e2
>
> You should have pasted that to the list, it's not too long.
>
> > "[mjpeg @ 0x47e6260] marker parser used 9746934 bytes (77975466 bits)",
> > "[mjpeg @ 0x47e6260] marker=d9 avail_size_in_buf=0",
> > "[mjpeg @ 0x47e6260] decode frame unused 0 bytes",
> > "*** 29 dup!",
>
> The output of the failing command really ends here?
>
> > Would please guide me how can I trace the problem?
>
> Sure: Please update to the latest version first:
> > "ffmpeg version N-45007-g9d7e42e- http://johnvansickle.com/ffmpeg/
> Copyright (c) 2000-2015 the FFmpeg developers",
> as this version is from March 2015, and nobody will go hunting bugs in
> it. You're using the build from johnvansickle.com, so just go there and
> grab a new version (git, not release please). Then test again.
>
> Thanks,
> Moritz
> _______________________________________________
> ffmpeg-user mailing list
> ffmpeg-user at ffmpeg.org
> http://ffmpeg.org/mailman/listinfo/ffmpeg-user
>
> To unsubscribe, visit link above, or email
> ffmpeg-user-request at ffmpeg.org with subject "unsubscribe".


More information about the ffmpeg-user mailing list