GStreamer HW decoder

Which Khadas SBC do you use?

VIM3 Pro

Which system do you use? Android, Ubuntu, OOWOW or others?

Ubuntu

Which version of system do you use? Khadas official images, self built images, or others?

vim3-ubuntu-20.04-gnome-linux-4.9-fenix-1.4-221229

Please describe your issue below:

Hello @numbqq,

We found that Amlogic decoder/encoder have been installed with Gstreamer in the host, but we’d like to use the hw plugins with gstreamer in OpenCV. If we reinstall gstreamer using apt to build with OpenCV, we can’t find the hw plugins, we think we should do something from souece code. Do you have information on how to use the hw plugins with gstreamer in OpneCV?

In addition, can we import some hw elements from host to use hw plugins in a docker container?

Thanks a lot,

Did you find a solution for it? I am trying to do the same thing. Thanks!

No, I haven’t found a solution.

@numbqq Could you please help us? Thanks

1 Like

Hello @JJ1997

Do you want to get the decoded frames with Gstreamer? But I’m afried to tell you that current plugin doesn’t support it, so even you can use it with OpenCV you will also can’t get the frames.

We are now working with the 5.15 kernel for VIM3, with this version of kernel it will support this feature.

Hello. I am trying to find a way to decode h264, h265 videostreams on the gpu. with ubuntu. I am not good with c and c++. I was hoping to find a way to do it using ffmpeg, gstreamer etc. Just need to decode and encode them for ip camera aplications. On a python script. Thanks for commenting about the new kernel.

Hello @numbqq, in fact, I have successfully used default h264 plugins (avdev_h264) of Gstreamer to decode and get the video stream in python, but I don’t know how to find and use the hardware decoders that come with vim3 Amlogic. I can’t find them after reinstalling Gstreamer to use with OpenCV. Do you have any information about how to install Gstreamer to find the hw decoders? Or we should also wait the new kernel to find the decoders?

Hello @Berk_Guvercin

We suggest you to wait for the new 5.15 kernel in Q3, it will have better support for hardware decoding & encoding.

Hello @JJ1997

Gstreamer hardware decoding plugin doesn’t work well with 4.9 kernel, you can wait for our new 5.15 kernel in Q3. Or you can try to use hardware decoding with other api: VIM3/3L Hardware Decoding [Khadas Docs]

1 Like

Thank you for replying. I am currently designing systems that work with ip cameras. Thus need maximum hardware utilization due to limited resources. Thank you for the reply. I will push them to the future development and develop other parts for now! Would love to have Khadas as a hardware provider of our new startup!