[FFmpeg-trac] #6915(avformat:open): DASH audio segments duration doesn't match exactly with video segments duration.
FFmpeg
trac at avcodec.org
Fri Dec 22 01:33:30 EET 2017
#6915: DASH audio segments duration doesn't match exactly with video segments
duration.
------------------------------------+-------------------------------------
Reporter: beloko | Owner: stevenliu
Type: defect | Status: open
Priority: normal | Component: avformat
Version: git-master | Resolution:
Keywords: | Blocked By:
Blocking: | Reproduced by developer: 0
Analyzed by developer: 0 |
------------------------------------+-------------------------------------
Comment (by stevenliu):
Replying to [comment:40 stevenliu]:
> If the two m3u8 list not MUST sequence align, i think this way can fix
it.
But i think this is not a perfect solution, i want set the
EXT-X-TARGETDURATION higher value align maybe better,
if audio playlist EXT-X-TARGETDURATION > video playlist
EXT-X-TARGETDURATION
the align to audio playlist EXT-X-TARGETDURATION
otherwise the align to video playlist EXT-X-TARGETDURATION
>
> {{{
> MacBook:xxx StevenLiu$ rm -rf *.m4s *.m3u8;./ffmpeg -hide_banner -i
~/bbb_sunflower_1080p_30fps_normal.mp4 -g 150 -r 100 -x264opts
"scenecut=-1" -f dash -min_seg_duration 1000000 -window_size 99999 -t 5
-hls_playlist 1 output_Steven.mpd
> Input #0, mov,mp4,m4a,3gp,3g2,mj2, from
'/Users/StevenLiu/bbb_sunflower_1080p_30fps_normal.mp4':
> Metadata:
> major_brand : isom
> minor_version : 1
> compatible_brands: isomavc1
> creation_time : 2013-12-16T17:44:39.000000Z
> title : Big Buck Bunny, Sunflower version
> artist : Blender Foundation 2008, Janus Bager Kristensen
2013
> comment : Creative Commons Attribution 3.0 -
http://bbb3d.renderfarming.net
> genre : Animation
> composer : Sacha Goedegebure
> Duration: 00:10:34.53, start: 0.000000, bitrate: 3481 kb/s
> Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p,
1920x1080 [SAR 1:1 DAR 16:9], 2998 kb/s, 30 fps, 30 tbr, 30k tbn, 60 tbc
(default)
> Metadata:
> creation_time : 2013-12-16T17:44:39.000000Z
> handler_name : GPAC ISO Video Handler
> Stream #0:1(und): Audio: mp3 (mp4a / 0x6134706D), 48000 Hz, stereo,
s16p, 160 kb/s (default)
> Metadata:
> creation_time : 2013-12-16T17:44:42.000000Z
> handler_name : GPAC ISO Audio Handler
> Stream #0:2(und): Audio: ac3 (ac-3 / 0x332D6361), 48000 Hz,
5.1(side), fltp, 320 kb/s (default)
> Metadata:
> creation_time : 2013-12-16T17:44:42.000000Z
> handler_name : GPAC ISO Audio Handler
> Side data:
> audio service type: main
> Stream mapping:
> Stream #0:0 -> #0:0 (h264 (native) -> h264 (libx264))
> Stream #0:2 -> #0:1 (ac3 (native) -> aac (native))
> Press [q] to stop, [?] for help
> [libx264 @ 0x7f9441042000] using SAR=1/1
> [libx264 @ 0x7f9441042000] using cpu capabilities: MMX2 SSE2Fast SSSE3
SSE4.2 AVX AVX2 FMA3 LZCNT BMI2
> [libx264 @ 0x7f9441042000] profile High, level 5.1
> [libx264 @ 0x7f9441042000] 264 - core 133 r2334M a3ac64b - H.264/MPEG-4
AVC codec - Copyleft 2003-2013 - http://www.videolan.org/x264.html -
options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7
psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1
8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=6
lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0
bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1
b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=150 keyint_min=15
scenecut=0 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0
qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
> [aac @ 0x7f9441043800] Using a PCE to encode channel layout
> [dash @ 0x7f944180dc00] No bit rate set for stream 0
> [dash @ 0x7f944180dc00] Opening 'init-stream0.m4s' for writing
> [dash @ 0x7f944180dc00] Opening 'init-stream1.m4s' for writing
> [dash @ 0x7f944180dc00] Opening 'output_Steven.mpd.tmp' for writing
> Bandwidth info not available, set audio and video bitrates
> Output #0, dash, to 'output_Steven.mpd':
> Metadata:
> major_brand : isom
> minor_version : 1
> compatible_brands: isomavc1
> composer : Sacha Goedegebure
> title : Big Buck Bunny, Sunflower version
> artist : Blender Foundation 2008, Janus Bager Kristensen
2013
> comment : Creative Commons Attribution 3.0 -
http://bbb3d.renderfarming.net
> genre : Animation
> encoder : Lavf58.3.100
> Stream #0:0(und): Video: h264 (libx264), yuv420p(progressive),
1920x1080 [SAR 1:1 DAR 16:9], q=-1--1, 100 fps, 12800 tbn, 100 tbc
(default)
> Metadata:
> creation_time : 2013-12-16T17:44:39.000000Z
> handler_name : GPAC ISO Video Handler
> encoder : Lavc58.8.100 libx264
> Side data:
> cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: -1
> Stream #0:1(und): Audio: aac (LC), 48000 Hz, 5.1(side), fltp, 394
kb/s (default)
> Metadata:
> creation_time : 2013-12-16T17:44:42.000000Z
> handler_name : GPAC ISO Audio Handler
> encoder : Lavc58.8.100 aac
> Side data:
> audio service type: main
> [dash @ 0x7f944180dc00] Opening 'chunk-stream1-00001.m4s.tmp' for
writingrop=0 speed=0.444x
> [dash @ 0x7f944180dc00] Opening 'output_Steven.mpd.tmp' for writing
> [dash @ 0x7f944180dc00] Opening 'chunk-stream0-00001.m4s.tmp' for
writingdrop=0 speed=0.526x
> [dash @ 0x7f944180dc00] Opening 'output_Steven.mpd.tmp' for writing
> [dash @ 0x7f944180dc00] Opening 'chunk-stream1-00002.m4s.tmp' for
writingdrop=0 speed=0.459x
> [dash @ 0x7f944180dc00] Opening 'output_Steven.mpd.tmp' for writing
> [dash @ 0x7f944180dc00] Opening 'chunk-stream1-00003.m4s.tmp' for
writingdrop=0 speed=0.548x
> [dash @ 0x7f944180dc00] Opening 'output_Steven.mpd.tmp' for writing
> [dash @ 0x7f944180dc00] Opening 'chunk-stream0-00002.m4s.tmp' for
writing
> [dash @ 0x7f944180dc00] Opening 'output_Steven.mpd.tmp' for writing
> [dash @ 0x7f944180dc00] Opening 'chunk-stream1-00004.m4s.tmp' for
writingdrop=0 speed=0.49x
> [dash @ 0x7f944180dc00] Opening 'output_Steven.mpd.tmp' for writing
> [dash @ 0x7f944180dc00] Opening 'chunk-stream0-00003.m4s.tmp' for
writingdrop=0 speed=0.502x
> [dash @ 0x7f944180dc00] Opening 'output_Steven.mpd.tmp' for writing
> [dash @ 0x7f944180dc00] Opening 'chunk-stream1-00005.m4s.tmp' for
writing
> [dash @ 0x7f944180dc00] Opening 'output_Steven.mpd.tmp' for writing
> [dash @ 0x7f944180dc00] Opening 'chunk-stream0-00004.m4s.tmp' for
writing
> [dash @ 0x7f944180dc00] Opening 'chunk-stream1-00006.m4s.tmp' for
writing
> [dash @ 0x7f944180dc00] Opening 'output_Steven.mpd.tmp' for writing
> frame= 500 fps= 44 q=-1.0 Lsize=N/A time=00:00:05.01 bitrate=N/A
dup=354 drop=0 speed=0.436x
> video:365kB audio:241kB subtitle:0kB other streams:0kB global
headers:0kB muxing overhead: unknown
> [libx264 @ 0x7f9441042000] frame I:4 Avg QP:16.78 size: 20153
> [libx264 @ 0x7f9441042000] frame P:150 Avg QP:20.52 size: 1625
> [libx264 @ 0x7f9441042000] frame B:346 Avg QP:18.64 size: 141
> [libx264 @ 0x7f9441042000] consecutive B-frames: 5.4% 5.2% 5.4% 84.0%
> [libx264 @ 0x7f9441042000] mb I I16..4: 92.8% 3.1% 4.1%
> [libx264 @ 0x7f9441042000] mb P I16..4: 6.0% 1.9% 0.1% P16..4:
2.5% 0.2% 0.2% 0.0% 0.0% skip:89.2%
> [libx264 @ 0x7f9441042000] mb B I16..4: 0.2% 0.0% 0.0% B16..8:
0.6% 0.0% 0.0% direct: 0.2% skip:99.0% L0:33.2% L1:65.7% BI: 1.1%
> [libx264 @ 0x7f9441042000] 8x8 transform intra:17.9% inter:71.0%
> [libx264 @ 0x7f9441042000] coded y,uvDC,uvAC intra: 3.2% 11.7% 2.2%
inter: 0.2% 0.7% 0.1%
> [libx264 @ 0x7f9441042000] i16 v,h,dc,p: 83% 12% 3% 1%
> [libx264 @ 0x7f9441042000] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 20% 11% 62%
1% 2% 1% 2% 1% 1%
> [libx264 @ 0x7f9441042000] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 26% 22% 28%
4% 4% 4% 4% 3% 4%
> [libx264 @ 0x7f9441042000] i8c dc,h,v,p: 77% 14% 9% 0%
> [libx264 @ 0x7f9441042000] Weighted P-Frames: Y:22.7% UV:22.0%
> [libx264 @ 0x7f9441042000] ref P L0: 83.9% 4.5% 9.7% 1.5% 0.4%
> [libx264 @ 0x7f9441042000] ref B L0: 73.8% 24.9% 1.3%
> [libx264 @ 0x7f9441042000] ref B L1: 97.2% 2.8%
> [libx264 @ 0x7f9441042000] kb/s:597.11
> [aac @ 0x7f9441043800] Qavg: 190.813
> MacBook:xxx StevenLiu$ cat media_0.m3u8 media_1.m3u8
> #EXTM3U
> #EXT-X-VERSION:6
> #EXT-X-TARGETDURATION:2
> #EXT-X-MEDIA-SEQUENCE:1
> #EXT-X-MAP:URI="init-stream0.m4s"
> #EXTINF:1.500000,
> chunk-stream0-00001.m4s
> #EXTINF:1.500000,
> chunk-stream0-00002.m4s
> #EXTINF:1.500000,
> chunk-stream0-00003.m4s
> #EXTINF:0.500000,
> chunk-stream0-00004.m4s
> #EXT-X-ENDLIST
> #EXTM3U
> #EXT-X-VERSION:6
> #EXT-X-TARGETDURATION:1
> #EXT-X-MEDIA-SEQUENCE:1
> #EXT-X-MAP:URI="init-stream1.m4s"
> #EXTINF:0.960000,
> chunk-stream1-00001.m4s
> #EXTINF:0.981333,
> chunk-stream1-00002.m4s
> #EXTINF:0.981333,
> chunk-stream1-00003.m4s
> #EXTINF:0.981333,
> chunk-stream1-00004.m4s
> #EXTINF:0.981333,
> chunk-stream1-00005.m4s
> #EXTINF:0.114667,
> chunk-stream1-00006.m4s
> #EXT-X-ENDLIST
> MacBook:xxx StevenLiu$
> MacBook:xxx StevenLiu$ mediastreamvalidator master.m3u8
> mediastreamvalidator: Version 1.2(170822)
>
> [master.m3u8] Started loading root playlist
> [media_1.m3u8] Started loading media playlist
> Can't deal with multiple sample timings per sample buffer
> [media_1.m3u8] All media files delivered and have end tag, stopping
>
>
--------------------------------------------------------------------------------
> media_1.m3u8
>
--------------------------------------------------------------------------------
> Processed 6 out of 6 segments
> Average segment duration: 0.833333
> Total segment bitrates (all discontinuities): average: 397.52 kb/s, max:
400.91 kb/s
> Playlist max bitrate: 394.000000 kb/s
> Audio Group ID: AUDIO
>
>
> Discontinuity: sequence: 0, parsed segment count: 6 of 6, duration:
5.000 sec, average: 397.52 kb/s, max: 400.91 kb/s
> Track ID: 1
> Audio Codec: AAC-LC
> Audio sample rate: 48000 Hz
> Audio channels: 0
> Audio channel layout: (null)
>
>
--------------------------------------------------------------------------------
> MUST fix issues
>
--------------------------------------------------------------------------------
>
> Error: Zero sample count
> --> Detail: Track ID 295
> --> Source: media_1.m3u8 - chunk-stream1-00006.m4s:6235 at 0
>
> MacBook:xxx StevenLiu$ git diff
> diff --git a/libavformat/dashenc.c b/libavformat/dashenc.c
> index 5687530f2d..07dd2bef5f 100644
> --- a/libavformat/dashenc.c
> +++ b/libavformat/dashenc.c
> @@ -1168,6 +1168,7 @@ static int dash_write_packet(AVFormatContext *s,
AVPacket *pkt)
> DASHContext *c = s->priv_data;
> AVStream *st = s->streams[pkt->stream_index];
> OutputStream *os = &c->streams[pkt->stream_index];
> + int get_split_time_point = 0;
> int ret;
>
> ret = update_stream_extradata(s, os, st->codecpar);
> @@ -1195,10 +1196,17 @@ static int dash_write_packet(AVFormatContext *s,
AVPacket *pkt)
> if (os->first_pts == AV_NOPTS_VALUE)
> os->first_pts = pkt->pts;
>
> - if ((!c->has_video || st->codecpar->codec_type ==
AVMEDIA_TYPE_VIDEO) &&
> - pkt->flags & AV_PKT_FLAG_KEY && os->packets_written &&
> - av_compare_ts(pkt->pts - os->start_pts, st->time_base,
> - c->min_seg_duration, AV_TIME_BASE_Q) >= 0) {
> + if (c->has_video && st->codecpar->codec_type == AVMEDIA_TYPE_AUDIO)
{
> + if ( av_compare_ts(pkt->pts + pkt->duration - os->start_pts,
st->time_base, c->min_seg_duration, AV_TIME_BASE_Q) >= 0) {
> + get_split_time_point = 1;
> + }
> + } else {
> + if (av_compare_ts(pkt->pts - os->start_pts, st->time_base,
c->min_seg_duration, AV_TIME_BASE_Q) >= 0) {
> + get_split_time_point = 1;
> + }
> + }
> + if ((!c->has_video || (st->codecpar->codec_type ==
AVMEDIA_TYPE_VIDEO) || c->hls_playlist) &&
> + pkt->flags & AV_PKT_FLAG_KEY && os->packets_written &&
get_split_time_point) {
> int64_t prev_duration = c->last_duration;
>
> c->last_duration = av_rescale_q(pkt->pts - os->start_pts,
> MacBook:xxx StevenLiu$
> }}}
--
Ticket URL: <https://trac.ffmpeg.org/ticket/6915#comment:41>
FFmpeg <https://ffmpeg.org>
FFmpeg issue tracker
More information about the FFmpeg-trac
mailing list