[FFmpeg-user] h264_vulkan and hevc_vulkan Encode failed on Intel
Terje J. Hanssen
terjejhanssen at gmail.com
Sat Dec 14 01:05:43 EET 2024
Den 13.12.2024 22:16, skrev Dennis Mungai:
> On Sat, 14 Dec 2024 at 00:14, Dennis Mungai <dmngaie at gmail.com> wrote:
>
>> On Fri, 13 Dec 2024 at 15:47, Terje J. Hanssen <terjejhanssen at gmail.com>
>> wrote:
>>
>>> While decode benchmarks test seemingly works on Intel, encode failed as
>>> shown below.
>>> If here are some missing steps or something wrong with the ffmpeg
>>> command lines used, I would be happy to hear back and test alternatives?
>>>
>>> ls /usr/share/vulkan/icd.d
>>> intel_hasvk_icd.x86_64.json intel_icd.x86_64.json lvp_icd.x86_64.json
>>>
>>> export VK_ICD_FILENAMES=/usr/share/vulkan/icd.d/intel_icd.x86_64.json
>>> export ANV_VIDEO_DECODE=1
>>> export ANV_VIDEO_ENCODE=1
>>>
>>>
>>> vulkaninfo | egrep -i 'decode|encode'
>>> VK_KHR_video_decode_h264 : extension revision 9
>>> VK_KHR_video_decode_h265 : extension revision 8
>>> VK_KHR_video_decode_queue : extension revision 8
>>> VK_KHR_video_encode_h264 : extension revision 14
>>> VK_KHR_video_encode_h265 : extension revision 14
>>> VK_KHR_video_encode_queue : extension revision 12
>>> queueFlags = QUEUE_VIDEO_DECODE_BIT_KHR |
>>> QUEUE_VIDEO_ENCODE_BIT_KHR
>>> VIDEO_CODEC_OPERATION_ENCODE_H264_BIT_KHR
>>> VIDEO_CODEC_OPERATION_ENCODE_H265_BIT_KHR
>>> VIDEO_CODEC_OPERATION_DECODE_H264_BIT_KHR
>>> VIDEO_CODEC_OPERATION_DECODE_H265_BIT_KHR
>>>
>>>
>>> vulkaninfo --summary
>>> ==========
>>> VULKANINFO
>>> ==========
>>>
>>> Vulkan Instance Version: 1.3.296
>>>
>>>
>>> Instance Extensions: count = 24
>>> -------------------------------
>>> VK_EXT_acquire_drm_display : extension revision 1
>>> VK_EXT_acquire_xlib_display : extension revision 1
>>> VK_EXT_debug_report : extension revision 10
>>> VK_EXT_debug_utils : extension revision 2
>>> VK_EXT_direct_mode_display : extension revision 1
>>> VK_EXT_display_surface_counter : extension revision 1
>>> VK_EXT_headless_surface : extension revision 1
>>> VK_EXT_surface_maintenance1 : extension revision 1
>>> VK_EXT_swapchain_colorspace : extension revision 5
>>> VK_KHR_device_group_creation : extension revision 1
>>> VK_KHR_display : extension revision 23
>>> VK_KHR_external_fence_capabilities : extension revision 1
>>> VK_KHR_external_memory_capabilities : extension revision 1
>>> VK_KHR_external_semaphore_capabilities : extension revision 1
>>> VK_KHR_get_display_properties2 : extension revision 1
>>> VK_KHR_get_physical_device_properties2 : extension revision 2
>>> VK_KHR_get_surface_capabilities2 : extension revision 1
>>> VK_KHR_portability_enumeration : extension revision 1
>>> VK_KHR_surface : extension revision 25
>>> VK_KHR_surface_protected_capabilities : extension revision 1
>>> VK_KHR_wayland_surface : extension revision 6
>>> VK_KHR_xcb_surface : extension revision 6
>>> VK_KHR_xlib_surface : extension revision 6
>>> VK_LUNARG_direct_driver_loading : extension revision 1
>>>
>>> Instance Layers: count = 3
>>> --------------------------
>>> VK_LAYER_KHRONOS_validation Khronos Validation Layer 1.3.296 version 1
>>> VK_LAYER_MESA_device_select Linux device selection layer 1.3.211 version 1
>>> VK_LAYER_MESA_overlay Mesa Overlay layer 1.3.211 version 1
>>>
>>> Devices:
>>> ========
>>> GPU0:
>>> apiVersion = 1.3.296
>>> driverVersion = 24.3.0
>>> vendorID = 0x8086
>>> deviceID = 0x56a1
>>> deviceType = PHYSICAL_DEVICE_TYPE_DISCRETE_GPU
>>> deviceName = Intel(R) Arc(tm) A750 Graphics (DG2)
>>> driverID = DRIVER_ID_INTEL_OPEN_SOURCE_MESA
>>> driverName = Intel open-source Mesa driver
>>> driverInfo = Mesa 24.3.0
>>> conformanceVersion = 1.3.6.0
>>> deviceUUID = 8680a156-0800-0000-0300-000000000000
>>> driverUUID = b3041234-0ed8-a53d-ceb8-4ffd54a9fd93
>>>
>>> #######################
>>>
>>> inxi -CGSz
>>> System:
>>> Kernel: 6.6.63-1-longterm arch: x86_64 bits: 64
>>> Console: pty pts/0 Distro: openSUSE Tumbleweed-Slowroll 20241202
>>> CPU:
>>> Info: 12-core (8-mt/4-st) model: 12th Gen Intel Core i7-12700KF bits:
>>> 64
>>> type: MST AMCP cache: L2: 12 MiB
>>> Speed (MHz): avg: 800 min/max: 800/4900:5000:3800 cores: 1: 800 2: 800
>>> 3: 800 4: 800 5: 800 6: 800 7: 800 8: 800 9: 800 10: 800 11: 800
>>> 12: 800
>>> 13: 800 14: 800 15: 800 16: 800 17: 800 18: 800 19: 800 20: 800
>>> Graphics:
>>> Device-1: Intel DG2 [Arc A750] driver: i915 v: kernel
>>> Device-2: Microdia Camera driver: snd-usb-audio,uvcvideo type: USB
>>> Display: unspecified server: X.org v: 1.21.1.14 with: Xwayland v:
>>> 24.1.4
>>> driver: X: loaded: modesetting unloaded: vesa dri: iris gpu: i915
>>> resolution: 2560x1440~60Hz
>>> API: EGL v: 1.5 drivers: iris,swrast platforms:
>>> gbm,x11,surfaceless,device
>>> API: OpenGL v: 4.6 compat-v: 4.5 vendor: intel mesa v: 24.3.0
>>> renderer: Mesa Intel Arc A750 Graphics (DG2)
>>> API: Vulkan v: 1.3.296 drivers: N/A surfaces: xcb,xlib
>>>
>>> ====================
>>>
>>> ffmpeg version 7.1 Copyright (c) 2000-2024 the FFmpeg developers
>>> built with gcc 14 (SUSE Linux)
>>>
>>> ffmpeg -hide_banner -encoders | grep vulkan
>>> V....D h264_vulkan H.264/AVC (Vulkan) (codec h264)
>>> V....D hevc_vulkan H.265/HEVC (Vulkan) (codec hevc)
>>>
>>> ######################
>>>
>>> ffmpeg -hide_banner -init_hw_device vulkan -i hdv09_04.m2t -vf
>>> "format=nv12,hwupload" -c:v h264_vulkan -y hdv09_04_h264_vulkan_nv12.mp4
>>>
>>> [mpeg2video @ 0x55db4fe22d80] Invalid frame dimensions 0x0.
>>> Last message repeated 3 times
>>> [mpegts @ 0x55db4fe042c0] PES packet size mismatch
>>> [mpegts @ 0x55db4fe042c0] Packet corrupt (stream = 1, dts = 258142320).
>>> [mpegts @ 0x55db4fe042c0] Could not find codec parameters for stream 2
>>> (Unknown: none ([160][0][0][0] / 0x00A0)): unknown codec
>>> Consider increasing the value for the 'analyzeduration' (0) and
>>> 'probesize' (5000000) options
>>> [mpegts @ 0x55db4fe042c0] Could not find codec parameters for stream 3
>>> (Unknown: none ([161][0][0][0] / 0x00A1)): unknown codec
>>> Consider increasing the value for the 'analyzeduration' (0) and
>>> 'probesize' (5000000) options
>>> Input #0, mpegts, from 'hdv09_04.m2t':
>>> Duration: 00:03:59.06, start: 2629.496000, bitrate: 26110 kb/s
>>> Program 100
>>> Stream #0:0[0x810]: Video: mpeg2video (Main) ([2][0][0][0] / 0x0002),
>>> yuv420p(tv, bt709, top first), 1440x1080 [SAR 4:3 DAR 16:9], 25000 kb/s,
>>> 25 fps, 25 tbr, 90k tbn
>>> Side data:
>>> cpb: bitrate max/min/avg: 25000000/0/0 buffer size: 7340032
>>> vbv_delay: N/A
>>> Stream #0:1[0x814]: Audio: mp2 (mp3float) ([3][0][0][0] / 0x0003),
>>> 48000 Hz, stereo, fltp, 384 kb/s
>>> Stream #0:2[0x815]: Unknown: none ([160][0][0][0] / 0x00A0)
>>> Stream #0:3[0x811]: Unknown: none ([161][0][0][0] / 0x00A1)
>>> Stream mapping:
>>> Stream #0:0 -> #0:0 (mpeg2video (native) -> h264 (h264_vulkan))
>>> Stream #0:1 -> #0:1 (mp2 (native) -> aac (native))
>>> Press [q] to stop, [?] for help
>>> [h264_vulkan @ 0x55db4fe236c0] No rate control settings specified, using
>>> fixed QP = 18
>>> Output #0, mp4, to 'hdv09_04_h264_vulkan_nv12.mp4':
>>> Metadata:
>>> encoder : Lavf61.7.100
>>> Stream #0:0: Video: h264 (High) (avc1 / 0x31637661), vulkan(tv,
>>> bt709, top coded first (swapped)), 1440x1080 [SAR 4:3 DAR 16:9], q=2-31,
>>> 25 fps, 12800 tbn
>>> Metadata:
>>> encoder : Lavc61.19.100 h264_vulkan
>>> Stream #0:1: Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo,
>>> fltp, 128 kb/s
>>> Metadata:
>>> encoder : Lavc61.19.100 aac
>>>
>>> [h264_vulkan @ 0x55db4fe236c0] Encode failed: -729850096.
>>> [vost#0:0/h264_vulkan @ 0x55db4fe5d480] Error submitting video frame to
>>> the encoder
>>> [vost#0:0/h264_vulkan @ 0x55db4fe5d480] Error encoding a frame: Error
>>> number -729850096 occurred
>>> [vost#0:0/h264_vulkan @ 0x55db4fe5d480] Task finished with error code:
>>> -729850096 (Error number -729850096 occurred)
>>> [vost#0:0/h264_vulkan @ 0x55db4fe5d480] Terminating thread with return
>>> code -729850096 (Error number -729850096 occurred)
>>> Unable to submit command buffer: VK_ERROR_DEVICE_LOST
>>> [hwupload @ 0x7ff7c0004440] Failed to upload frame: -542398533.
>>> [vf#0:0 @ 0x55db4fd17100] Error while filtering: Generic error in an
>>> external library
>>> [vf#0:0 @ 0x55db4fd17100] Task finished with error code: -542398533
>>> (Generic error in an external library)
>>> [vf#0:0 @ 0x55db4fd17100] Terminating thread with return code -542398533
>>> (Generic error in an external library)
>>> [out#0/mp4 @ 0x55db4fd198c0] video:0KiB audio:19KiB subtitle:0KiB other
>>> streams:0KiB global headers:0KiB muxing overhead: 5.515885%
>>> frame= 0 fps=0.0 q=0.0 Lsize= 20KiB time=N/A bitrate=N/A speed=N/A
>>> [aac @ 0x55db4fe069c0] Qavg: 1286.721
>>> Conversion failed!
>>>
>>> ========================
>>>
>>> ffmpeg -hide_banner -init_hw_device vulkan=vkdev:0 -filter_hw_device
>>> vkdev -i h264_8bit_yuv420p.mp4 -filter:v "format=nv12,hwupload" -c:v
>>> hevc_vulkan hevc_vulkan_8b420.mp4
>>>
>>> Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'h264_8bit_yuv420p.mp4':
>>> Metadata:
>>> major_brand : isom
>>> minor_version : 512
>>> compatible_brands: isomiso2avc1mp41
>>> encoder : Lavf61.1.100
>>> Duration: 00:01:11.20, start: 0.000000, bitrate: 8464 kb/s
>>> Stream #0:0[0x1](und): Video: h264 (High) (avc1 / 0x31637661),
>>> yuvj420p(pc, smpte170m/unknown/unknown, top first), 1920x1080 [SAR 1:1
>>> DAR 16:9], 8462 kb/s, 25 fps, 25 tbr, 12800 tbn (default)
>>> Metadata:
>>> handler_name : VideoHandler
>>> vendor_id : [0][0][0][0]
>>> File 'hevc_vulkan_8b420.mp4' already exists. Overwrite? [y/N] y
>>> Stream mapping:
>>> Stream #0:0 -> #0:0 (h264 (native) -> hevc (hevc_vulkan))
>>> Press [q] to stop, [?] for help
>>> [swscaler @ 0x7f0aa0014b00] deprecated pixel format used, make sure you
>>> did set range correctly
>>> [hevc_vulkan @ 0x5583b890fdc0] No rate control settings specified, using
>>> fixed QP = 18
>>> Output #0, mp4, to 'hevc_vulkan_8b420.mp4':
>>> Metadata:
>>> major_brand : isom
>>> minor_version : 512
>>> compatible_brands: isomiso2avc1mp41
>>> encoder : Lavf61.7.100
>>> Stream #0:0(und): Video: hevc (Main) (hev1 / 0x31766568), vulkan(pc,
>>> smpte170m/unknown/unknown, top coded first (swapped)), 1920x1080 [SAR
>>> 1:1 DAR 16:9], q=2-31, 25 fps, 12800 tbn (default)
>>> Metadata:
>>> handler_name : VideoHandler
>>> vendor_id : [0][0][0][0]
>>> encoder : Lavc61.19.100 hevc_vulkan
>>>
>>> [hevc_vulkan @ 0x5583b890fdc0] Encode failed: -1744827296.
>>> [vost#0:0/hevc_vulkan @ 0x5583b890aec0] Error submitting video frame to
>>> the encoder
>>> [vost#0:0/hevc_vulkan @ 0x5583b890aec0] Error encoding a frame: Error
>>> number -1744827296 occurred
>>> [vost#0:0/hevc_vulkan @ 0x5583b890aec0] Task finished with error code:
>>> -1744827296 (Error number -1744827296 occurred)
>>> [vost#0:0/hevc_vulkan @ 0x5583b890aec0] Terminating thread with return
>>> code -1744827296 (Error number -1744827296 occurred)
>>> [out#0/mp4 @ 0x5583b883ecc0] video:0KiB audio:0KiB subtitle:0KiB other
>>> streams:0KiB global headers:0KiB muxing overhead: unknown
>>> [out#0/mp4 @ 0x5583b883ecc0] Output file is empty, nothing was
>>> encoded(check -ss / -t / -frames parameters if used)
>>> frame= 0 fps=0.0 q=0.0 Lsize= 0KiB time=N/A bitrate=N/A speed=N/A
>>> Conversion failed!
>>>
>>
>> A similar ticket on this issue: https://trac.ffmpeg.org/ticket/11219
Yeah, I noticed that.
> And also reported to mesa upstream, specifically regarding the state of
> Intel's ANV's Vulkan video:
> https://gitlab.freedesktop.org/mesa/mesa/-/issues/11969
Good.
I've tried my tests also on openSUSE Tumbleweed with Mesa 24.3.1, and
got the same faults.
> _______________________________________________
> ffmpeg-user mailing list
> ffmpeg-user at ffmpeg.org
> https://ffmpeg.org/mailman/listinfo/ffmpeg-user
>
> To unsubscribe, visit link above, or email
> ffmpeg-user-request at ffmpeg.org with subject "unsubscribe".
More information about the ffmpeg-user
mailing list