Video overlay using VAAPI
Locked
Video overlay using VAAPI
 
|
Hello,
I want to program a GStreamer pipeline overlaying a video generated with "videotestsrc" over a video received from the network on an Intel PC (VAAPI). What is the most efficient way to realize such an overlay. The overlay works fine with "clockoverlay" but I have not found yet a solution with "videotestsrc". Any help is appreciated. Thanks, Wolfgang. _______________________________________________ gstreamer-devel mailing list [hidden email] https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel |
Re: Video overlay using VAAPI
|
|
Le mer. 13 juin 2018 04:57, Wolfgang Grandegger <[hidden email]> a écrit : Hello, I believe best would be to use glvideomixer.
_______________________________________________ gstreamer-devel mailing list [hidden email] https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel |
Re: Video overlay using VAAPI
|
|
Hello,
Am 13.06.2018 um 13:45 schrieb Nicolas Dufresne: > > > Le mer. 13 juin 2018 04:57, Wolfgang Grandegger <[hidden email] > <mailto:[hidden email]>> a écrit : > > Hello, > > I want to program a GStreamer pipeline overlaying a video generated with > "videotestsrc" over a video received from the network on an Intel PC > (VAAPI). What is the most efficient way to realize such an overlay. The > overlay works fine with "clockoverlay" but I have not found yet a > solution with "videotestsrc". > > > I believe best would be to use glvideomixer. OK, thakns, the following is working: # gst-launch-1.0 glvideomixer name=m ! vaapisink \ videotestsrc ! video/xraw,format=RGBA,width=1280,height=800,framerate=30/1 ! \ m. videotestsrc pattern=1 ! video/x-raw,format=RGBA,width=1280,height=50 ! m. But when I try to read a MJPEG encoded stream from the network it's not shown, but just the overlay: # gst-launch-1.0 -v glvideomixer name=m ! vaapisink display=1 \ udpsrc port=50004 ! application/x-rtp,encoding-name=JPEG,payload=26 ! queue ! \ rtpjpegdepay ! vaapijpegdec ! vaapipostproc ! \ m. videotestsrc pattern=1 ! video/x-raw,format=RGBA,width=1280,height=50 ! m. It's difficult to understand what's working together. Maybe it's because I mixed elements from "vaapi" and "opengl" modules. The following works just fine. # gst-launch-1.0 udpsrc port=50004 ! application/x-rtp,encoding-name=JPEG,payload=26 \ ! queue ! rtpjpegdepay ! vaapijpegdec ! vaapipostproc ! vaapisink Wolfgang. _______________________________________________ gstreamer-devel mailing list [hidden email] https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel |
|
|
On Thu, 14 Jun 2018 at 11:57, Wolfgang Grandegger wrote:
> Hello, > > Am 13.06.2018 um 13:45 schrieb Nicolas Dufresne: > > > > > > Le mer. 13 juin 2018 04:57, Wolfgang Grandegger <[hidden email] > > <mailto:[hidden email]>> a écrit : > > > > Hello, > > > > I want to program a GStreamer pipeline overlaying a video generated with > > "videotestsrc" over a video received from the network on an Intel PC > > (VAAPI). What is the most efficient way to realize such an overlay. The > > overlay works fine with "clockoverlay" but I have not found yet a > > solution with "videotestsrc". > > > > > > I believe best would be to use glvideomixer. > > OK, thakns, the following is working: > > # gst-launch-1.0 glvideomixer name=m ! vaapisink \ > videotestsrc ! video/xraw,format=RGBA,width=1280,height=800,framerate=30/1 ! \ > m. videotestsrc pattern=1 ! video/x-raw,format=RGBA,width=1280,height=50 ! m. > > But when I try to read a MJPEG encoded stream from the network it's not > shown, but just the overlay: > > # gst-launch-1.0 -v glvideomixer name=m ! vaapisink display=1 \ > udpsrc port=50004 ! application/x-rtp,encoding-name=JPEG,payload=26 ! queue ! \ > rtpjpegdepay ! vaapijpegdec ! vaapipostproc ! \ > m. videotestsrc pattern=1 ! video/x-raw,format=RGBA,width=1280,height=50 > ! m. I guess, what you want is this gst-launch-1.0 -v glvideomixer name=m ! vaapisink \ videotestsrc pattern=1 ! video/x-raw,width=1280,height=720 ! m. \ udpsrc port=50004 ! application/x-rtp,encoding-name=JPEG,payload=26 ! queue ! \ rtpjpegdepay ! vaapijpegdec ! vaapipostproc ! m. > > It's difficult to understand what's working together. Maybe it's because I mixed elements > from "vaapi" and "opengl" modules. > > The following works just fine. > > # gst-launch-1.0 udpsrc port=50004 ! application/x-rtp,encoding-name=JPEG,payload=26 \ > ! queue ! rtpjpegdepay ! vaapijpegdec ! vaapipostproc ! vaapisink > > > Wolfgang. > _______________________________________________ > gstreamer-devel mailing list > [hidden email] > https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel gstreamer-devel mailing list [hidden email] https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel |
Re: Video overlay using VAAPI
|
|
Le jeu. 14 juin 2018 06:22, Víctor Jáquez <[hidden email]> a écrit : On Thu, 14 Jun 2018 at 11:57, Wolfgang Grandegger wrote: Looks like this bug: > _______________________________________________ gstreamer-devel mailing list [hidden email] https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel |
Re: Video overlay using VAAPI
|
|
Hello,
Am 14.06.2018 um 12:55 schrieb Nicolas Dufresne: > > > Le jeu. 14 juin 2018 06:22, Víctor Jáquez <[hidden email] > <mailto:[hidden email]>> a écrit : > > On Thu, 14 Jun 2018 at 11:57, Wolfgang Grandegger wrote: > > Hello, > > > > Am 13.06.2018 um 13:45 schrieb Nicolas Dufresne: > > > > > > > > > Le mer. 13 juin 2018 04:57, Wolfgang Grandegger > <[hidden email] <mailto:[hidden email]> > > > <mailto:[hidden email] <mailto:[hidden email]>>> a écrit : > > > > > > Hello, > > > > > > I want to program a GStreamer pipeline overlaying a video > generated with > > > "videotestsrc" over a video received from the network on an > Intel PC > > > (VAAPI). What is the most efficient way to realize such an > overlay. The > > > overlay works fine with "clockoverlay" but I have not found > yet a > > > solution with "videotestsrc". > > > > > > > > > I believe best would be to use glvideomixer. > > > > OK, thakns, the following is working: > > > > # gst-launch-1.0 glvideomixer name=m ! vaapisink \ > > videotestsrc ! > video/xraw,format=RGBA,width=1280,height=800,framerate=30/1 ! \ > > m. videotestsrc pattern=1 ! > video/x-raw,format=RGBA,width=1280,height=50 ! m. > > > > But when I try to read a MJPEG encoded stream from the network > it's not > > shown, but just the overlay: > > > Looks like this bug: > > https://bugzilla.gnome.org/show_bug.cgi?id=796505 But the command below works fine: # gst-launch-1.0 udpsrc port=50004 ! application/x-rtp,encoding-name=JPEG,payload=26 \ ! queue ! rtpjpegdepay ! vaapijpegdec ! vaapipostproc ! vaapisink I have here 1.12.24. Another good reason to upgrade to a more recent version... > > > > # gst-launch-1.0 -v glvideomixer name=m ! vaapisink display=1 \ > > udpsrc port=50004 ! > application/x-rtp,encoding-name=JPEG,payload=26 ! queue ! \ > > rtpjpegdepay ! vaapijpegdec ! vaapipostproc ! \ > > m. videotestsrc pattern=1 ! > video/x-raw,format=RGBA,width=1280,height=50 > > ! m. > > I guess, what you want is this > > gst-launch-1.0 -v glvideomixer name=m ! vaapisink \ > videotestsrc pattern=1 ! video/x-raw,width=1280,height=720 ! m. \ > udpsrc port=50004 ! > application/x-rtp,encoding-name=JPEG,payload=26 ! queue ! \ > rtpjpegdepay ! vaapijpegdec ! vaapipostproc ! m. Victor suggested the same command. I'm a bit puzzled. I want to have a band 50 pixel high at to top with pattern=1 over the normal video pattern on the whole screen received from the network. The result should be the same as the command at the top of this email. Did I miss something? And the band at the top should even be transparent... but that's another topic. Wolfgang. _______________________________________________ gstreamer-devel mailing list [hidden email] https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel |
Re: Video overlay using VAAPI
|
|
Le jeudi 14 juin 2018 à 13:41 +0200, Wolfgang Grandegger a écrit :
> > https://bugzilla.gnome.org/show_bug.cgi?id=796505 > > But the command below works fine: > > # gst-launch-1.0 udpsrc port=50004 ! application/x-rtp,encoding- > name=JPEG,payload=26 \ > ! queue ! rtpjpegdepay ! vaapijpegdec ! vaapipostproc ! > vaapisink > > I have here 1.12.24. Another good reason to upgrade to a more recent > version... Indeed, the jpeg bug only happens when transforming VA Surface to GL Texture, on a separate thread. Upgrading is likely a good idea, a lot of improvement is happending on VAAPI. Nicolas _______________________________________________ gstreamer-devel mailing list [hidden email] https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel |
Re: Video overlay using VAAPI
|
|
In reply to this post by Wolfgang Grandegger
Hello Nicolas,
Am 14.06.2018 um 13:41 schrieb Wolfgang Grandegger: > Hello, > > Am 14.06.2018 um 12:55 schrieb Nicolas Dufresne: >> >> >> Le jeu. 14 juin 2018 06:22, Víctor Jáquez <[hidden email] >> <mailto:[hidden email]>> a écrit : >> >> On Thu, 14 Jun 2018 at 11:57, Wolfgang Grandegger wrote: >> > Hello, >> > >> > Am 13.06.2018 um 13:45 schrieb Nicolas Dufresne: >> > > >> > > >> > > Le mer. 13 juin 2018 04:57, Wolfgang Grandegger >> <[hidden email] <mailto:[hidden email]> >> > > <mailto:[hidden email] <mailto:[hidden email]>>> a écrit : >> > > >> > > Hello, >> > > >> > > I want to program a GStreamer pipeline overlaying a video >> generated with >> > > "videotestsrc" over a video received from the network on an >> Intel PC >> > > (VAAPI). What is the most efficient way to realize such an >> overlay. The >> > > overlay works fine with "clockoverlay" but I have not found >> yet a >> > > solution with "videotestsrc". >> > > >> > > >> > > I believe best would be to use glvideomixer. >> > >> > OK, thakns, the following is working: >> > >> > # gst-launch-1.0 glvideomixer name=m ! vaapisink \ >> > videotestsrc ! >> video/xraw,format=RGBA,width=1280,height=800,framerate=30/1 ! \ >> > m. videotestsrc pattern=1 ! >> video/x-raw,format=RGBA,width=1280,height=50 ! m. >> > >> > But when I try to read a MJPEG encoded stream from the network >> it's not >> > shown, but just the overlay: >> >> >> Looks like this bug: >> >> https://bugzilla.gnome.org/show_bug.cgi?id=796505 > > But the command below works fine: > > # gst-launch-1.0 udpsrc port=50004 ! application/x-rtp,encoding-name=JPEG,payload=26 \ > ! queue ! rtpjpegdepay ! vaapijpegdec ! vaapipostproc ! vaapisink > > I have here 1.12.24. Another good reason to upgrade to a more recent > version... I extracted that patch from the git repo and applied it to may version... and now the command above works! Great! Thanks! Wolfgang. PS: my mail client just offers me to reply to the author or the list, but not both? Is that intentional? _______________________________________________ gstreamer-devel mailing list [hidden email] https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel |
Re: Video overlay using VAAPI
|
|
Le jeu. 14 juin 2018 08:14, Wolfgang Grandegger <[hidden email]> a écrit : Hello Nicolas, It's our list configuration. Only non registered email will be kept. Nothing to worry about, we still see the messages, but if you CC us explicitly, then we get duplicates or inbox messages. _______________________________________________ _______________________________________________ gstreamer-devel mailing list [hidden email] https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel |
Re: Video overlay using VAAPI
|
|
Am 14.06.2018 um 14:24 schrieb Nicolas Dufresne:
> > > Le jeu. 14 juin 2018 08:14, Wolfgang Grandegger <[hidden email] > <mailto:[hidden email]>> a écrit : > > Hello Nicolas, > > Am 14.06.2018 um 13:41 schrieb Wolfgang Grandegger: > > Hello, > > > > Am 14.06.2018 um 12:55 schrieb Nicolas Dufresne: > >> > >> > >> Le jeu. 14 juin 2018 06:22, Víctor Jáquez <[hidden email] > <mailto:[hidden email]> > >> <mailto:[hidden email] <mailto:[hidden email]>>> a écrit : > >> > >> On Thu, 14 Jun 2018 at 11:57, Wolfgang Grandegger wrote: > >> > Hello, > >> > > >> > Am 13.06.2018 um 13:45 schrieb Nicolas Dufresne: > >> > > > >> > > > >> > > Le mer. 13 juin 2018 04:57, Wolfgang Grandegger > >> <[hidden email] <mailto:[hidden email]> > <mailto:[hidden email] <mailto:[hidden email]>> > >> > > <mailto:[hidden email] <mailto:[hidden email]> > <mailto:[hidden email] <mailto:[hidden email]>>>> a écrit : > >> > > > >> > > Hello, > >> > > > >> > > I want to program a GStreamer pipeline overlaying a video > >> generated with > >> > > "videotestsrc" over a video received from the network > on an > >> Intel PC > >> > > (VAAPI). What is the most efficient way to realize > such an > >> overlay. The > >> > > overlay works fine with "clockoverlay" but I have not > found > >> yet a > >> > > solution with "videotestsrc". > >> > > > >> > > > >> > > I believe best would be to use glvideomixer. > >> > > >> > OK, thakns, the following is working: > >> > > >> > # gst-launch-1.0 glvideomixer name=m ! vaapisink \ > >> > videotestsrc ! > >> video/xraw,format=RGBA,width=1280,height=800,framerate=30/1 ! \ > >> > m. videotestsrc pattern=1 ! > >> video/x-raw,format=RGBA,width=1280,height=50 ! m. > >> > > >> > But when I try to read a MJPEG encoded stream from the network > >> it's not > >> > shown, but just the overlay: > >> > >> > >> Looks like this bug: > >> > >> https://bugzilla.gnome.org/show_bug.cgi?id=796505 > > > > But the command below works fine: > > > > # gst-launch-1.0 udpsrc port=50004 ! > application/x-rtp,encoding-name=JPEG,payload=26 \ > > ! queue ! rtpjpegdepay ! vaapijpegdec ! vaapipostproc ! > vaapisink > > > > I have here 1.12.24. Another good reason to upgrade to a more recent > > version... > > I extracted that patch from the git repo and applied it to may > version... and now the command above works! Great! Thanks! After a while it stopped working... needs a reboot to recover. This command already puts quite some load to the system. Is it possible to do more in hardware, with less CPU usage and latency, by implementing a dedicated GStreamer-Application. > > Wolfgang. > > PS: my mail client just offers me to reply to the author or the list, > but not both? Is that intentional? > > > It's our list configuration. Only non registered email will be kept. > Nothing to worry about, we still see the messages, but if you CC us > explicitly, then we get duplicates or inbox messages. Fine with me! Wolfgang. _______________________________________________ gstreamer-devel mailing list [hidden email] https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel |
|
|
In reply to this post by Nicolas Dufresne-5
On Thu, 14 Jun 2018 at 06:55, Nicolas Dufresne wrote:
> Le jeu. 14 juin 2018 06:22, Víctor Jáquez <[hidden email]> a écrit : > > > On Thu, 14 Jun 2018 at 11:57, Wolfgang Grandegger wrote: > > > Hello, > > > > > > Am 13.06.2018 um 13:45 schrieb Nicolas Dufresne: > > > > > > > > > > > > Le mer. 13 juin 2018 04:57, Wolfgang Grandegger <[hidden email] > > > > <mailto:[hidden email]>> a écrit : > > > > > > > > Hello, > > > > > > > > I want to program a GStreamer pipeline overlaying a video > > generated with > > > > "videotestsrc" over a video received from the network on an Intel > > PC > > > > (VAAPI). What is the most efficient way to realize such an > > overlay. The > > > > overlay works fine with "clockoverlay" but I have not found yet a > > > > solution with "videotestsrc". > > > > > > > > > > > > I believe best would be to use glvideomixer. > > > > > > OK, thakns, the following is working: > > > > > > # gst-launch-1.0 glvideomixer name=m ! vaapisink \ > > > videotestsrc ! > > video/xraw,format=RGBA,width=1280,height=800,framerate=30/1 ! \ > > > m. videotestsrc pattern=1 ! > > video/x-raw,format=RGBA,width=1280,height=50 ! m. > > > > > > But when I try to read a MJPEG encoded stream from the network it's not > > > shown, but just the overlay: > > > > Looks like this bug: > > https://bugzilla.gnome.org/show_bug.cgi?id=796505 > Unless he is using the new intel vaapi driver (not packaged by any distro so far), intel-media-driver (iHD), I don't think it is the case. vmjl > > > > > # gst-launch-1.0 -v glvideomixer name=m ! vaapisink display=1 \ > > > udpsrc port=50004 ! > > application/x-rtp,encoding-name=JPEG,payload=26 ! queue ! \ > > > rtpjpegdepay ! vaapijpegdec ! vaapipostproc ! \ > > > m. videotestsrc pattern=1 ! > > video/x-raw,format=RGBA,width=1280,height=50 > > > ! m. > > > > I guess, what you want is this > > > > gst-launch-1.0 -v glvideomixer name=m ! vaapisink \ > > videotestsrc pattern=1 ! video/x-raw,width=1280,height=720 ! m. \ > > udpsrc port=50004 ! application/x-rtp,encoding-name=JPEG,payload=26 ! > > queue ! \ > > rtpjpegdepay ! vaapijpegdec ! vaapipostproc ! m. > > > > > > > > It's difficult to understand what's working together. Maybe it's because > > I mixed elements > > > from "vaapi" and "opengl" modules. > > > > > > The following works just fine. > > > > > > # gst-launch-1.0 udpsrc port=50004 ! > > application/x-rtp,encoding-name=JPEG,payload=26 \ > > > ! queue ! rtpjpegdepay ! vaapijpegdec ! vaapipostproc ! vaapisink > > > > > > > > > Wolfgang. > > > _______________________________________________ > > > gstreamer-devel mailing list > > > [hidden email] > > > https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel > > gstreamer-devel mailing list [hidden email] https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel |
Re: Video overlay using VAAPI
|
|
Am 14.06.2018 um 15:38 schrieb Víctor Jáquez:
> On Thu, 14 Jun 2018 at 06:55, Nicolas Dufresne wrote: >> Le jeu. 14 juin 2018 06:22, Víctor Jáquez <[hidden email]> a écrit : >> >>> On Thu, 14 Jun 2018 at 11:57, Wolfgang Grandegger wrote: >>>> Hello, >>>> >>>> Am 13.06.2018 um 13:45 schrieb Nicolas Dufresne: >>>>> >>>>> >>>>> Le mer. 13 juin 2018 04:57, Wolfgang Grandegger <[hidden email] >>>>> <mailto:[hidden email]>> a écrit : >>>>> >>>>> Hello, >>>>> >>>>> I want to program a GStreamer pipeline overlaying a video >>> generated with >>>>> "videotestsrc" over a video received from the network on an Intel >>> PC >>>>> (VAAPI). What is the most efficient way to realize such an >>> overlay. The >>>>> overlay works fine with "clockoverlay" but I have not found yet a >>>>> solution with "videotestsrc". >>>>> >>>>> >>>>> I believe best would be to use glvideomixer. >>>> >>>> OK, thakns, the following is working: >>>> >>>> # gst-launch-1.0 glvideomixer name=m ! vaapisink \ >>>> videotestsrc ! >>> video/xraw,format=RGBA,width=1280,height=800,framerate=30/1 ! \ >>>> m. videotestsrc pattern=1 ! >>> video/x-raw,format=RGBA,width=1280,height=50 ! m. >>>> >>>> But when I try to read a MJPEG encoded stream from the network it's not >>>> shown, but just the overlay: >>> >> >> Looks like this bug: >> >> https://bugzilla.gnome.org/show_bug.cgi?id=796505 >> > > Unless he is using the new intel vaapi driver (not packaged by any distro so > far), intel-media-driver (iHD), I don't think it is the case. You mean "https://github.com/intel/media-driver"? What else do I need to use that driver? Will it work together with GStreamer 1.4.1 packages? I'm using Buildroot... should not be a big deal to add it. Wolfgang. _______________________________________________ gstreamer-devel mailing list [hidden email] https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel |
|
|
On Fri, 15 Jun 2018 at 11:19, Wolfgang Grandegger wrote:
> >> > >> Looks like this bug: > >> > >> https://bugzilla.gnome.org/show_bug.cgi?id=796505 > >> > > > > Unless he is using the new intel vaapi driver (not packaged by any distro so > > far), intel-media-driver (iHD), I don't think it is the case. > > You mean "https://github.com/intel/media-driver"? What else do I need to > use that driver? Will it work together with GStreamer 1.4.1 packages? > I'm using Buildroot... should not be a big deal to add it. Don't use it (unless you know what are you doing). vmjl _______________________________________________ gstreamer-devel mailing list [hidden email] https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel |
«
Return to GStreamer-devel
|
1 view|%1 views
| Free forum by Nabble | Edit this page |