HDMI video src

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

HDMI video src

yasoua
Is there any element in gstreamer to capture video or images from HDMI VIDEO
input.
I have a board with Hdmi video input and two microdisplays.What i want to do
is to apply gstereamer filters on the images displayed in the two displays
and provided with the hdmi input.
I have seen gstremear elements that capture data from camera devices and
thad read data from files but about this case of hdmi video source , is
there any solution to handle this.
Could someone help please.Thanks.



--
Sent from: http://gstreamer-devel.966125.n4.nabble.com/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: HDMI video src

Peter Maersk-Moller-2
It all depends on your OS and capture card (chipset).

I use deckvidosrc for some HDMI capture, v4l2src for others. For RaspberryPi HDMI capture over camera interface there are other solutions. If you use Windows, life is too short and  I just don't care anymore.

Best regards
P

On Thu, Feb 11, 2021 at 10:54 AM yasoua <[hidden email]> wrote:
Is there any element in gstreamer to capture video or images from HDMI VIDEO
input.
I have a board with Hdmi video input and two microdisplays.What i want to do
is to apply gstereamer filters on the images displayed in the two displays
and provided with the hdmi input.
I have seen gstremear elements that capture data from camera devices and
thad read data from files but about this case of hdmi video source , is
there any solution to handle this.
Could someone help please.Thanks.



--
Sent from: http://gstreamer-devel.966125.n4.nabble.com/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: HDMI video src

yasoua
Thank you for your answer.

Actually i am working on a module based on NXP imx8 processor. ( linux)
The module includes also two microdisplays which are managed by MachXO2
fpga. Data or images displayed in the microdisplays come from hdmi input.

I have lenses in front of each microdispaly, so we see deformations.

When i asked this question i thougth that the deformations seen come from
the source ( hdmi video input) thas is why i was looking for a way to
capture the HDMI video input and apply cameracalibte and cameraundistort
filters to it.

UPDATE : i realized that the deformations are due to lenses placed in front
of each microdisplay. When i removed them i didn't see any distortion.
The issue or the question : is there  any way to correct this distortion
using gstreamer elements  while keeping my optic (lenses).

I tried to be clear so that you could understand my issue and you could help
me.

For the deckvidosrc , do you mean decklinkvideosrc ? i didn't find any
deckvidosrc in gstreamer documentation.

Best regards
 



--
Sent from: http://gstreamer-devel.966125.n4.nabble.com/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: HDMI video src

Nicolas Dufresne-5
Le jeudi 11 février 2021 à 10:13 -0600, yasoua a écrit :

> Thank you for your answer.
>
> Actually i am working on a module based on NXP imx8 processor. ( linux)
> The module includes also two microdisplays which are managed by MachXO2
> fpga. Data or images displayed in the microdisplays come from hdmi input.
>
> I have lenses in front of each microdispaly, so we see deformations.
>
> When i asked this question i thougth that the deformations seen come from
> the source ( hdmi video input) thas is why i was looking for a way to
> capture the HDMI video input and apply cameracalibte and cameraundistort
> filters to it.

I own an USB / HDMI capture device that is UVC and works just fine with v4l2src.
I'm also working on some other adapters, which in fact required a tad of work on
GStreamer side for my use case:

https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/-/merge_requests/870

But with some v4l2-ctl calls and v4l2src it worked otherwise. On IMX8, an HDMI
receiver would be hooked to the "camera" interface, hence should be very similar
to using RPi HDMI capture. Though v4l2src (or gstreamer-imx equivalent) is
likeky the right GStreamer elements.


>
> UPDATE : i realized that the deformations are due to lenses placed in front
> of each microdisplay. When i removed them i didn't see any distortion.
> The issue or the question : is there  any way to correct this distortion
> using gstreamer elements  while keeping my optic (lenses).

My best bet would be:

https://gstreamer.freedesktop.org/documentation/opencv/cameracalibrate.html?gi-language=c
https://gstreamer.freedesktop.org/documentation/opencv/cameraundistort.html?gi-language=c

Hopefully you have access to an accelerated version of OpenCV (e.g. through
OpenCL or such). I know there was some lense correction done in GL too, for some
VR use case, but that does not seems to be in the upstream GStreamer. Hopefully
real experts on the subject will reply here.

>
> I tried to be clear so that you could understand my issue and you could help
> me.
>
> For the deckvidosrc , do you mean decklinkvideosrc ? i didn't find any
> deckvidosrc in gstreamer documentation.
>
> Best regards
>  
>
>
>
> --
> Sent from: http://gstreamer-devel.966125.n4.nabble.com/
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel


_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: HDMI video src

yasoua
Thank you for your help.

I have found a gstreamer plugin that could maybe help me to correct lens
distorion without having access to accelerated version of opencv (opencl /
GL).

https://gstreamer.freedesktop.org/documentation/frei0r/frei0r-filter-lens-correction.html?gi-language=c

My problem at this level is how can i capture images from my microdisplay.
Is there any gstreamer plugins that allows to capture video from
microdispalys. I have tried with ximagesrc but it doesn't work because it's
only for X display.

Just for information , i am working with emagin and Microoled displays.

could someone guide me please. Thanks in advance.





--
Sent from: http://gstreamer-devel.966125.n4.nabble.com/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: HDMI video src

Nicolas Dufresne-5
Le lundi 15 février 2021 à 06:55 -0600, yasoua a écrit :

> Thank you for your help.
>
> I have found a gstreamer plugin that could maybe help me to correct lens
> distorion without having access to accelerated version of opencv (opencl /
> GL).
>
> https://gstreamer.freedesktop.org/documentation/frei0r/frei0r-filter-lens-correction.html?gi-language=c
>
> My problem at this level is how can i capture images from my microdisplay.
> Is there any gstreamer plugins that allows to capture video from
> microdispalys. I have tried with ximagesrc but it doesn't work because it's
> only for X display.
>
> Just for information , i am working with emagin and Microoled displays.

This falls a bit outside of GStreamer project. To capture from a display you
need your renderer/copositor cooperation or write back hardware support.

For the first, XTest API has been used (with ximagesrc) on older intergration,
while Wayland does not yet have a strong standard. The Gnome project have pushed
forward a dbus portal that enables you to obtain a stream from your compositor
through a pipewire stream (pipewiresrc and some dbus code needed).

When you have special write back hardware, you can record your display on the
side into RAM, though this is a bit rare and niche. You will find some platforms
were a V4L2 capture driver has been made to speak with the DRM driver in order
to achive this (Renesas R-Car, v4l2src).

Otherwise there is the unliked DRM writeback connector, but I'm not aware of any
GStreamer integration.

Nicolas

>
> could someone guide me please. Thanks in advance.
>
>
>
>
>
> --
> Sent from: http://gstreamer-devel.966125.n4.nabble.com/
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel


_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel