[FFmpeg-user] how to set the color background when i use overlay_qsv

[zhaofg at bstar.com.cn]

hello:
I check it to tag 5.0 and the command run correctly, but the cpu is very high. I am not sure it used the gpu to decoder, scale, overlay and encoder. I don't know how to make sure it used the gpu.
From: zhaofg at bstar.com.cn
Date: 2022-01-27 20:24
To: ffmpeg-user at ffmpeg.org
Subject: Re: [FFmpeg-user] how to set the color background when i use overlay_qsv
Thanks for your answer.  I will try the latest version. My ffmpeg download from https://github.com/FFmpeg/FFmpeg, and i checkout it to tag n4.4
,then i build it on the ubuntu system.
 
From: Xiang, Haihao
Date: 2022-01-27 14:40
To: ffmpeg-user at ffmpeg.org
Subject: Re: [FFmpeg-user] how to set the color background when i use overlay_qsv
On Thu, 2022-01-27 at 11:04 +0800, zhaofg at bstar.com.cn wrote:
> hello:
>     I want to splice four or more video into one video，i want to set the
> background to a fixed size and the color is black, so i must scale the image
> then overlay. 
>     
>     My environment is ubuntu and I used command is:
> 
>     ffmpeg -i h1.mp4 -i h2.mp4 -i h3.mp4 -i h4.mp4 -filter_complex
> "color=c=black:s=1920x1080[bg];[0:v]scale=iw/2:-1[img0];[1:v]scale=iw/2:-
> 1[img1];[2:v] scale=iw/2:-1[img2];[3:v]scale=iw/2:-
> 1[img3];[bg][img0]overlay=shortest=1[out0];[out0][img1]overlay=shortest=1:x=w[
> out1];[out1][img2]overlay=shortest=1:y=h[out2];[out2][img3]overlay=shortest=1:
> x=w:y=h" -y out.mp4
> 
> ------------------------------------------------------------------------------
> ------------------------------------------------------------------------------
> -----
> the comman is correct,but when i change it to qsv. It's not working correctly:
> 
>     ./ffmpeg -hwaccel qsv -c:v h264_qsv -i h1.mp4 -hwaccel qsv -c:v h264_qsv
> -i h2.mp4 -hwaccel qsv -c:v h264_qsv -i h3.mp4 -hwaccel qsv -c:v h264_qsv -i
> h4.mp4 -filter_complex "color=black:r=30:size=1920x1080:sar=1/1,
> hwupload=extra_hw_frames=64,format=qsv[bg];[0:v]scale_qsv=iw/2:ih/2[img0];[1:v
> ]scale_qsv=iw/2:ih/2[img1];[2:v]
> scale_qsv=iw/2:ih/2[img2];[3:v]scale_qsv=iw/2:ih/2[img3];[bg][img0]overlay_qsv
> =shortest=1[out0];[out0][img1]overlay_qsv=shortest=1:x=w[out1];[out1][img2]ove
> rlay_qsv=shortest=1:y=h[out2];[out2][img3]overlay_qsv=shortest=1:x=w:y=h" -y
> out.mp4
> 
>  output:
> [hwupload @ 0x5593003e07c0] A hardware device reference is required to upload
> frames to.
> [Parsed_hwupload_1 @ 0x5593003e0680] Query format failed for
> 'Parsed_hwupload_1': Invalid argument
> Error reinitializing filters!
> Failed to inject frame into filter network: Invalid argument
> Error while processing the decoded data for stream #3:0
> Conversion failed!
> ------------------------------------------------------------------------------
> ------------------------------------------------------------------------------
> ----
> ./ffmpeg -init_hw_device qsv=hw -filter_hw_device hw -hwaccel qsv -c:v
> h264_qsv -i h1.mp4 -hwaccel qsv -c:v h264_qsv -i h2.mp4 -hwaccel qsv -c:v
> h264_qsv -i h3.mp4 -hwaccel qsv -c:v h264_qsv -i h4.mp4 -filter_complex
> "color=black:r=30:size=1920x1080:sar=1/1,
> hwupload=extra_hw_frames=64,format=qsv[bg];[0:v]scale_qsv=iw/2:ih/2[img0];[1:v
> ]scale_qsv=iw/2:ih/2[img1];[2:v]
> scale_qsv=iw/2:ih/2[img2];[3:v]scale_qsv=iw/2:ih/2[img3];[bg][img0]overlay_qsv
> =shortest=1[out0];[out0][img1]overlay_qsv=shortest=1:x=w[out1];[out1][img2]ove
> rlay_qsv=shortest=1:y=h[out2];[out2][img3]overlay_qsv=shortest=1:x=w:y=h" -y
> out.mp4
> 
> 
> output:
> [Parsed_overlay_qsv_7 @ 0x563881a99180] Inputs with different underlying QSV
> devices are forbidden.
> [Parsed_overlay_qsv_7 @ 0x563881a99180] Failed to configure output pad on
> Parsed_overlay_qsv_7
> Error reinitializing filters!
> Failed to inject frame into filter network: Invalid argument
> Error while processing the decoded data for stream #3:0
> Conversion failed!
> ------------------------------------------------------------------------------
> ------------------------------------------------------------------------------
> ----
> I want to know How can I modify my command to run correctly. Thank you.
What is the version of your FFmpeg? Your command work for me with the latest
FFmpeg (https://git.ffmpeg.org/gitweb/ffmpeg.git/shortlog/refs/heads/master).
There is a green line at the bottom of each scaled image with your command, you
may try vpp_qsv instead of scale_qsv. We will fix the green line issue in
scale_qsv
Thanks
Haihao
_______________________________________________
ffmpeg-user mailing list
ffmpeg-user at ffmpeg.org
https://ffmpeg.org/mailman/listinfo/ffmpeg-user
To unsubscribe, visit link above, or email
ffmpeg-user-request at ffmpeg.org with subject "unsubscribe".
_______________________________________________
ffmpeg-user mailing list
ffmpeg-user at ffmpeg.org
https://ffmpeg.org/mailman/listinfo/ffmpeg-user
 
To unsubscribe, visit link above, or email
ffmpeg-user-request at ffmpeg.org with subject "unsubscribe".