[FFmpeg-trac] #7768(undetermined:new): ffmpeg does not handle HTTP read errors (e.g. from cloud storage)

[FFmpeg]

#7768: ffmpeg does not handle HTTP read errors (e.g. from cloud storage)
-------------------------------------+-------------------------------------
             Reporter:  dprestegard  |                    Owner:
                 Type:  enhancement  |                   Status:  new
             Priority:  normal       |                Component:
                                     |  undetermined
              Version:  unspecified  |               Resolution:
             Keywords:  http         |               Blocked By:
             Blocking:               |  Reproduced by developer:  0
Analyzed by developer:  0            |
-------------------------------------+-------------------------------------

Comment (by dprestegard):

 Confirmed. After quite awhile:

 [tls @ 00000159a52d7740] Error in the pull function.0:24.17
 bitrate=100805.6kbits/s speed=0.00143x
 [tcp @ 0000015ac96e2940] Original list of addresses:
 [tcp @ 0000015ac96e2940] Address 52.216.236.229 port 443
 [tcp @ 0000015ac96e2940] Interleaved list of addresses:
 [tcp @ 0000015ac96e2940] Address 52.216.236.229 port 443
 [tcp @ 0000015ac96e2940] Starting connection attempt to 52.216.236.229
 port 443
 [tcp @ 0000015ac96e2940] Successfully connected to 52.216.236.229 port 443
 [https @ 00000159a489dc40] request: GET
 /download.opencontent.netflix.com/Meridian/MER_SHR_C_EN-XX_US-
 NR_51_LTRT_UHD_201
 60913_OV/MER_SHR_C_EN-XX_US-NR_51_LTRT_UHD_20160913_OV/MER_SHR_C_EN-XX_US-
 NR_51_LTRT_UHD_20160913_OV_01.mxf HTTP/1.1
 User-Agent: Lavf/58.26.101
 Accept: */*
 Range: bytes=27217019339-
 Connection: close
 Host: s3.amazonaws.com
 Icy-MetaData: 1

 https://s3.amazonaws.com/download.opencontent.netflix.com/Meridian
 /MER_SHR_C_EN-XX_US-NR_51_LTRT_UHD_20160913_OV/MER_SHR
 _C_EN-XX_US-NR_51_LTRT_UHD_20160913_OV/MER_SHR_C_EN-XX_US-
 NR_51_LTRT_UHD_20160913_OV_01.mxf: corrupt input packet in str
 eam 0
 [jpeg2000 @ 00000159a55272c0] Psot 1970142 too big
 [jpeg2000 @ 00000159a55272c0] error during processing marker segment ff90
 [tls @ 0000015ac96e1500] Error in the pull function.0:24.19
 bitrate=101169.5kbits/s speed=0.0014x
 [tls @ 0000015ac96e1500] The specified session has been invalidated for
 some reason.
     Last message repeated 1 times
 [tls @ 0000015ac96e1500] The specified session has been invalidated for
 some reason.speed=0.00136x
     Last message repeated 1 times
 [tls @ 0000015ac96e1500] The specified session has been invalidated for
 some reason.speed=0.00132x
     Last message repeated 1 times
 [tls @ 0000015ac96e1500] The specified session has been invalidated for
 some reason.speed=0.00129x
     Last message repeated 1 times
 [tls @ 0000015ac96e1500] The specified session has been invalidated for
 some reason.speed=0.00127x
     Last message repeated 1 times
 [tls @ 0000015ac96e1500] The specified session has been invalidated for
 some reason.speed=0.00124x
     Last message repeated 1 times
 [tls @ 0000015ac96e1500] The specified session has been invalidated for
 some reason.speed=0.00122x
     Last message repeated 1 times
 [tls @ 0000015ac96e1500] The specified session has been invalidated for
 some reason.speed=0.00119x
     Last message repeated 1 times
 Error while decoding stream #0:0: Invalid data found when processing input
 [tls @ 0000015ac96e1500] The specified session has been invalidated for
 some reason.speed=0.00116x
     Last message repeated 1 times
 [out_0_0 @ 00000159bd978580] EOF on sink link out_0_0:default.
 No more output streams to write to, finishing.
 frame= 1511 fps=0.1 q=-0.0 Lsize=  336740kB time=00:00:25.15
 bitrate=109648.0kbits/s speed=0.000963x
 video:336716kB audio:0kB subtitle:0kB other streams:0kB global headers:2kB
 muxing overhead: 0.007196%
 Input file #0
 (https://s3.amazonaws.com/download.opencontent.netflix.com/Meridian
 /MER_SHR_C_EN-XX_US-NR_51_LTRT_UHD_2016
 0913_OV/MER_SHR_C_EN-XX_US-NR_51_LTRT_UHD_20160913_OV/MER_SHR_C_EN-XX_US-
 NR_51_LTRT_UHD_20160913_OV_01.mxf):
   Input stream #0:0 (video): 1512 packets read (27191430359 bytes); 1511
 frames decoded;
   Total: 1512 packets (27191430359 bytes) demuxed
 Output file #0 (test_01.mp4):
   Output stream #0:0 (video): 1511 frames encoded; 1511 packets muxed
 (344797328 bytes);
   Total: 1511 packets (344797328 bytes) muxed
 1511 frames successfully decoded, 1 decoding errors
 [AVIOContext @ 00000159a556a880] Statistics: 2 seeks, 1319 writeouts
 x265 [info]: frame I:     10, Avg QP:15.01  kb/s: 294753.33
 x265 [info]: frame P:    400, Avg QP:15.28  kb/s: 210073.99
 x265 [info]: frame B:   1101, Avg QP:20.19  kb/s: 71169.26
 x265 [info]: Weighted P-Frames: Y:3.5% UV:3.0%
 x265 [info]: Weighted B-Frames: Y:1.4% UV:1.1%
 x265 [info]: consecutive B-frames: 26.6% 0.2% 1.5% 33.7% 31.0% 3.4% 2.9%
 0.0% 0.7%

 encoded 1511 frames in 26120.40s (0.06 fps), 109420.58 kb/s, Avg QP:18.85
 [AVIOContext @ 00000159a4e60600] Statistics: 27193009947 bytes read, 31
 seeks


 Here's the full encoding report at loglevel debug

 https://genie-public-streaming-test.s3.us-
 west-1.amazonaws.com/ffmpeg-20190306-173420.log

--
Ticket URL: <https://trac.ffmpeg.org/ticket/7768#comment:3>
FFmpeg <https://ffmpeg.org>
FFmpeg issue tracker