GStreamer-devel

ZeroCopy + AppSink + VAAPI + Qt

Classic

List

Threaded

11 messages Options

Timtchenko, Michael

ZeroCopy + AppSink + VAAPI + Qt

Hi folks,

i'm trying to implement an efficient, zero copy image handling on a EGL-System without a window manager. Unfortunately this seems to be a quite hard job. :-/

My application uses the following pipeline:

"udpsrc port=55555 caps=\"application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264, payload=(int)96\" "
"! rtph264depay "
"! vaapih264dec "
"! vaapipostproc name=postproc "
"! video/x-raw, format=RGBA "
"! appsink name=sink emit-signals=true sync=false max-buffers=1 drop=true"

As you can see, i'm using vaapi elements as well as the appsink. I'm getting notified by signal, when a new frame is received.
Afterwards i'm pulling the frame by the following code:

#####

GstSample* sample = gst_app_sink_pull_sample( m_data->appSink );
GstBuffer* buffer = gst_sample_get_buffer( sample );

GstMapInfo* map = new GstMapInfo();
gst_buffer_map( buffer, map, GST_MAP_READ );

and access the data by

map->data()

####

This is the status quo, but my goal is to put/bind the data into a texture and render it within the qt screnegraph without any additional copy actions. To achieve this,
I need to get a already rendered texture or a direct access to the framebuffer object. Currently i'm uploading the data with the OpenGL-function glTexImage2D which isn't very efficient at all.

In (1) they said, that this can be done by:

[...Using memory:VASurface you can map it as a normal gst video frame:
gst_video_frame_map ...]

Unfortunately i don't have a clue, how i can access a texture or a framebufferobject
from the VASurface. Is that even possible?

Is there someone who can share his knowledge? Any help is welcome! :)

Thanks in advance,
Michael

(1) http://gstreamer-devel.966125.n4.nabble.com/How-to-use-VAAPI-appsink-with-zero-copy-mmap-td4688670.html

Bitte beachten / Please note!

*******************************************************************************

AGCO GmbH
Sitz der AGCO GmbH: Johann-Georg-Fendt-Str.4, 87616 Marktoberdorf, Germany
Registergericht Amtsgericht Kempten HRB 10327
Geschäftsführer: Christoph Groeblinghoff, Ingrid Bussjaeger-Martin, Dr. Heribert Reiter, Ekkehart Glaeser
Vorsitzender des Aufsichtsrates: Torsten Dehner

*******************************************************************************

Diese E-Mail ist nur für den Empfänger bestimmt, an den es gerichtet ist und kann vertrauliches
bzw. unter das Berufsgeheimnis fallendes Material enthalten. Jegliche darin enthaltene Ansicht
oder Meinungsäußerung ist die des Autors und stellt nicht notwendigerweise die Ansicht oder
Meinung von AGCO dar. Sind Sie nicht der Empfänger, so haben Sie diese E-Mail irrtümlich
erhalten und jegliche Verwendung, Veröffentlichung, Weiterleitung, Abschrift oder jeglicher
Druck dieser E-Mail ist strengstens untersagt. Weder AGCO noch der Absender übernehmen die
Haftung für Viren; es obliegt Ihrer Verantwortung, die E-Mail und deren angehängte
Dateien (sofern vorhanden) auf Viren zu überprüfen.

*******************************************************************************

This email is intended solely for the use of the individual to whom it is addressed and may contain
confidential and/or privileged material. Any views or opinions presented are solely those of the
author and do not necessarily represent those of AGCO. If you are not the intended recipient, be
advised that you have received this email in error and that any use, dissemination, forwarding,
printing or copying of this email is strictly prohibited. Neither AGCO nor the sender accepts any
responsibility for viruses and it is your responsibility to scan and virus check the email and its
attachment(s) (if any).

*******************************************************************************
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

Nicolas Dufresne-5

Re: ZeroCopy + AppSink + VAAPI + Qt

Le jeudi 30 janvier 2020 à 09:45 +0000, Timtchenko, Michael a écrit :

> Hi folks,
>
> i'm trying to implement an efficient, zero copy image handling on a EGL-System
> without a window manager. Unfortunately this seems to be a quite hard job. :-/
>
> My application uses the following pipeline:
>
> "udpsrc port=55555 caps=\"application/x-rtp, media=(string)video, clock-
> rate=(int)90000, encoding-name=(string)H264, payload=(int)96\" "
> "! rtph264depay "
> "! vaapih264dec "
> "! vaapipostproc name=postproc "
> "! video/x-raw, format=RGBA "
> "! appsink name=sink emit-
> signals=true sync=false max-buffers=1 drop=true"

In this context, you are asking your GPU to upload to system memory. As the GPU
does not operate in LINEAR pixel formats, this requires a copy (detiling,
decompression, etc.). If you goals is to manually import your decoded image to
GL, I would suggest requesting DMAbuf, VASurface, or the deprecated
GstVideoGLTextureUploadMeta.

video/x-raw\(memory:DMABuf\)
video/x-raw\(memory:VASurface\)
video/x-raw\(meta:GstVideoGLTextureUploadMeta\)

And then use the appropriate API to zero-copy import that to EGL. With the
preferred method (DMABuf), you need to get the GstMemory and get the DMABuf FD
using gst_dmabuf_memory_get_fd(). The rest is EGL calls, so left to you.

>
> As you can see, i'm using vaapi elements as well as the appsink. I'm getting
> notified by signal, when a new frame is received.
> Afterwards i'm pulling the frame by the following code:
>
> #####
>
> GstSample* sample = gst_app_sink_pull_sample( m_data->appSink );
> GstBuffer* buffer = gst_sample_get_buffer( sample );
>
> GstMapInfo* map = new GstMapInfo();
> gst_buffer_map( buffer, map, GST_MAP_READ );
>
> and access the data by
>
> map->data()
>
> ####
>
> This is the status quo, but my goal is to put/bind the data into a texture and
> render it within the qt screnegraph without any additional copy actions. To
> achieve this,
> I need to get a already rendered texture or a direct access to the framebuffer
> object. Currently i'm uploading the data with the OpenGL-function
> glTexImage2D which isn't very efficient at all.
>
> In (1) they said, that this can be done by:
>
> [...Using memory:VASurface you can map it as a normal gst video frame:
> gst_video_frame_map ...]
>
> Unfortunately i don't have a clue, how i can access a texture or a
> framebufferobject
> from the VASurface. Is that even possible?
>
> Is there someone who can share his knowledge? Any help is welcome! :)
>
> Thanks in advance,
> Michael
>
> (1)
> http://gstreamer-devel.966125.n4.nabble.com/How-to-use-VAAPI-appsink-with-zero-copy-mmap-td4688670.html
>
>
> Bitte beachten / Please note!
>
> ******************************************************************************
> *
>
> AGCO GmbH
> Sitz der AGCO GmbH: Johann-Georg-Fendt-Str.4, 87616 Marktoberdorf, Germany
> Registergericht Amtsgericht Kempten HRB 10327
> Geschäftsführer: Christoph Groeblinghoff, Ingrid Bussjaeger-Martin, Dr.
> Heribert Reiter, Ekkehart Glaeser
> Vorsitzender des Aufsichtsrates: Torsten Dehner
>
> ******************************************************************************
> *
>
> Diese E-Mail ist nur für den Empfänger bestimmt, an den es gerichtet ist und
> kann vertrauliches
> bzw. unter das Berufsgeheimnis fallendes Material enthalten. Jegliche darin
> enthaltene Ansicht
> oder Meinungsäußerung ist die des Autors und stellt nicht notwendigerweise die
> Ansicht oder
> Meinung von AGCO dar. Sind Sie nicht der Empfänger, so haben Sie diese E-Mail
> irrtümlich
> erhalten und jegliche Verwendung, Veröffentlichung, Weiterleitung, Abschrift
> oder jeglicher
> Druck dieser E-Mail ist strengstens untersagt. Weder AGCO noch der Absender
> übernehmen die
> Haftung für Viren; es obliegt Ihrer Verantwortung, die E-Mail und deren
> angehängte
> Dateien (sofern vorhanden) auf Viren zu überprüfen.
>
> ******************************************************************************
> *
>
> This email is intended solely for the use of the individual to whom it is
> addressed and may contain
> confidential and/or privileged material. Any views or opinions presented are
> solely those of the
> author and do not necessarily represent those of AGCO. If you are not the
> intended recipient, be
> advised that you have received this email in error and that any use,
> dissemination, forwarding,
> printing or copying of this email is strictly prohibited. Neither AGCO nor the
> sender accepts any
> responsibility for viruses and it is your responsibility to scan and virus
> check the email and its
> attachment(s) (if any).
>
> ******************************************************************************
> *
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

Timtchenko, Michael

Re: ZeroCopy + AppSink + VAAPI + Qt

In reply to this post by Timtchenko, Michael

Hi all,

first of all: thx to Nicolas Dufresne your tips helped me a lot :)

I rewrote my pipe, in order to use DMABuf:

"udpsrc port=55555 caps=\"application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264, payload=(int)96\" "
"! rtph264depay "
"! vaapih264dec "
"! vaapipostproc name=postproc "
"! video/x-raw(memory:DMABuf) "
"! appsink name=sink emit-signals=true sync=false max-buffers=1 drop=true"

Now i'm facing little problems with pulling the image as well as transforming it to a valid opengl texture :-/
Even now feel i feel more confident, this streaming thing still remains hard stuff.

My goal is still to get a zero-copy video stream within my QtScreneGraph-Application.

In my pull-Method i'm doing the following calls, but i'm not sure, if they are right.

pull()
{
GstSample* sample = gst_app_sink_pull_sample( m_appSink );
GstBuffer* buffer = gst_sample_get_buffer( sample );
GstCaps* caps = gst_sample_get_caps( sample );

GstMapInfo info;
gst_buffer_map( buffer, &info, GST_MAP_READ );

auto mem = gst_buffer_peek_memory( buffer, 0 );
auto fd = gst_dmabuf_memory_get_fd( mem );

// Not sure whether this is right
auto display = gst_gl_display_new();
auto context = gst_gl_context_new( display );

GstVideoInfo vInfo;
gst_video_info_from_caps( &vInfo, caps );

// What are the last two parameters used for?
// In the doc they say:
// gint plane, gsize offset
// but what plane and what offset is required here?
// Unfortunately the return value is still zero
auto image = gst_egl_image_from_dmabuf( context, fd, &vInfo, 0, 0 );
...
}

What context is supposed to get passed into gst_egl_image_from_dmabuf(xxx). Is it the target context, where i want to use the fd, or is it a different one?

But my biggest problem is, that i don't have a glue, how i can retrieve a texture from the given eglimage resp. its fd. I cannot find any sources on the web, related to EglImage texture-conversions or anything like that.

Could anyone please provide some help... i would really appreciate it.

Kind regards,
Michael

-----Ursprüngliche Nachricht-----
Von: gstreamer-devel [mailto:[hidden email]] Im Auftrag von Nicolas Dufresne
Gesendet: Donnerstag, 30. Januar 2020 16:10
An: Discussion of the development of and with GStreamer <[hidden email]>
Betreff: [External] Re: ZeroCopy + AppSink + VAAPI + Qt

Le jeudi 30 janvier 2020 à 09:45 +0000, Timtchenko, Michael a écrit :

> Hi folks,
>
> i'm trying to implement an efficient, zero copy image handling on a
> EGL-System without a window manager. Unfortunately this seems to be a
> quite hard job. :-/
>
> My application uses the following pipeline:
>
> "udpsrc port=55555 caps=\"application/x-rtp, media=(string)video,
> clock- rate=(int)90000, encoding-name=(string)H264, payload=(int)96\" "
> "! rtph264depay "
> "! vaapih264dec "
> "! vaapipostproc name=postproc "
> "! video/x-raw, format=RGBA "
> "! appsink name=sink emit-
> signals=true sync=false max-buffers=1 drop=true"

In this context, you are asking your GPU to upload to system memory. As the GPU does not operate in LINEAR pixel formats, this requires a copy (detiling, decompression, etc.). If you goals is to manually import your decoded image to GL, I would suggest requesting DMAbuf, VASurface, or the deprecated GstVideoGLTextureUploadMeta.

video/x-raw\(memory:DMABuf\)
video/x-raw\(memory:VASurface\)
video/x-raw\(meta:GstVideoGLTextureUploadMeta\)

And then use the appropriate API to zero-copy import that to EGL. With the preferred method (DMABuf), you need to get the GstMemory and get the DMABuf FD using gst_dmabuf_memory_get_fd(). The rest is EGL calls, so left to you.

>
> As you can see, i'm using vaapi elements as well as the appsink. I'm
> getting notified by signal, when a new frame is received.
> Afterwards i'm pulling the frame by the following code:
>
> #####
>
> GstSample* sample = gst_app_sink_pull_sample( m_data->appSink );
> GstBuffer* buffer = gst_sample_get_buffer( sample );
>
> GstMapInfo* map = new GstMapInfo();
> gst_buffer_map( buffer, map, GST_MAP_READ );
>
> and access the data by
>
> map->data()
>
> ####
>
> This is the status quo, but my goal is to put/bind the data into a
> texture and render it within the qt screnegraph without any additional
> copy actions. To achieve this, I need to get a already rendered
> texture or a direct access to the framebuffer object. Currently i'm
> uploading the data with the OpenGL-function glTexImage2D which isn't
> very efficient at all.
>
> In (1) they said, that this can be done by:
>
> [...Using memory:VASurface you can map it as a normal gst video frame:
> gst_video_frame_map ...]
>
> Unfortunately i don't have a clue, how i can access a texture or a
> framebufferobject from the VASurface. Is that even possible?
>
> Is there someone who can share his knowledge? Any help is welcome! :)
>
> Thanks in advance,
> Michael
>
> (1)
> http://gstreamer-devel.966125.n4.nabble.com/How-to-use-VAAPI-appsink-w
> ith-zero-copy-mmap-td4688670.html
>
>
> Bitte beachten / Please note!
>
> **********************************************************************
> ********
> *
>
> AGCO GmbH
> Sitz der AGCO GmbH: Johann-Georg-Fendt-Str.4, 87616 Marktoberdorf,
> Germany Registergericht Amtsgericht Kempten HRB 10327
> Geschäftsführer: Christoph Groeblinghoff, Ingrid Bussjaeger-Martin, Dr.
> Heribert Reiter, Ekkehart Glaeser
> Vorsitzender des Aufsichtsrates: Torsten Dehner
>
> **********************************************************************
> ********
> *
>
> Diese E-Mail ist nur für den Empfänger bestimmt, an den es gerichtet
> ist und kann vertrauliches bzw. unter das Berufsgeheimnis fallendes
> Material enthalten. Jegliche darin enthaltene Ansicht oder
> Meinungsäußerung ist die des Autors und stellt nicht notwendigerweise
> die Ansicht oder Meinung von AGCO dar. Sind Sie nicht der Empfänger,
> so haben Sie diese E-Mail irrtümlich erhalten und jegliche Verwendung,
> Veröffentlichung, Weiterleitung, Abschrift oder jeglicher Druck dieser
> E-Mail ist strengstens untersagt. Weder AGCO noch der Absender
> übernehmen die Haftung für Viren; es obliegt Ihrer Verantwortung, die
> E-Mail und deren angehängte Dateien (sofern vorhanden) auf Viren zu
> überprüfen.
>
> **********************************************************************
> ********
> *
>
> This email is intended solely for the use of the individual to whom it
> is addressed and may contain confidential and/or privileged material.
> Any views or opinions presented are solely those of the author and do
> not necessarily represent those of AGCO. If you are not the intended
> recipient, be advised that you have received this email in error and
> that any use, dissemination, forwarding, printing or copying of this
> email is strictly prohibited. Neither AGCO nor the sender accepts any
> responsibility for viruses and it is your responsibility to scan and
> virus check the email and its
> attachment(s) (if any).
>
> **********************************************************************
> ********
> *
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

This email is intended solely for the use of the individual to whom it is addressed and may contain confidential and/or privileged material. Any views or opinions presented are solely those of the author and do not necessarily represent those of AGCO. If you are not the intended recipient, be advised that you have received this email in error and that any use, dissemination, forwarding, printing or copying of this email is strictly prohibited. Neither AGCO nor the sender accepts any responsibility for viruses and it is your responsibility to scan and virus check the e-mail and its attachment(s) (if any).
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

Victor Jaquez

Re: ZeroCopy + AppSink + VAAPI + Qt

On Tue, 04 Feb 2020 at 14:00, Timtchenko, Michael wrote:
>
> What context is supposed to get passed into gst_egl_image_from_dmabuf(xxx). Is
> it the target context, where i want to use the fd, or is it a different one?
>
> But my biggest problem is, that i don't have a glue, how i can retrieve a
> texture from the given eglimage resp. its fd. I cannot find any sources on the
> web, related to EglImage texture-conversions or anything like that.

Not an epxert, but you don't retrieve a texture from an EGLImage. You bind the
EGLImage to a texture handled by your application's GL Context. Look for
EGLImageTargetTexture2D

vmjl
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

Victor Jaquez

Re: ZeroCopy + AppSink + VAAPI + Qt

On Wed, 05 Feb 2020 at 11:15, Víctor Jáquez wrote:

> On Tue, 04 Feb 2020 at 14:00, Timtchenko, Michael wrote:
> >
> > What context is supposed to get passed into gst_egl_image_from_dmabuf(xxx). Is
> > it the target context, where i want to use the fd, or is it a different one?
> >
> > But my biggest problem is, that i don't have a glue, how i can retrieve a
> > texture from the given eglimage resp. its fd. I cannot find any sources on the
> > web, related to EglImage texture-conversions or anything like that.
>
> Not an epxert, but you don't retrieve a texture from an EGLImage. You bind the
> EGLImage to a texture handled by your application's GL Context. Look for
> EGLImageTargetTexture2D

Timtchenko, Michael

AW: [External] Re: ZeroCopy + AppSink + VAAPI + Qt

Hi again,

Thx for your support! :)

I've decided to use the glupload mechanism, because I wasn't able to generate proper eglimages.. however, it seems to generate textures.

Right now I'm trying to set the GstGlContext properly. To achieve this, I tried to "grab" the opengl context from the "QSGRenderThread" in the QT-Screnegraph and injected it afterwards to the gstreamer.
This thread provides the context, which i used for uploading of texture in my prior approach.

I'm doing this with the following code:

...
GstGLDisplay* display = gst_gl_display_new();
guintptr context = gst_gl_context_get_current_gl_context( GST_GL_PLATFORM_EGL );
GstGLContext* gstcontext = gst_gl_context_new_wrapped( display, context, GST_GL_PLATFORM_EGL, GST_GL_API_ANY );
...

whereas *gstcontext* ist stored and afterwards injected via bus callback in gstreamer.

Here is my respond to the bus callback:
...
case GST_MESSAGE_NEED_CONTEXT:
{
const gchar* context_type;
GstContext* context = NULL;
gst_message_parse_context_type( message, &context_type );
g_print( "got need context %s\n", context_type );
if( g_strcmp0( context_type, "gst.gl.app_context" ) == 0 )
{
GstGLContext* gl_context = gstcontext; // *context from above*
GstStructure* s;
context = gst_context_new( "gst.gl.app_context", TRUE );
s = gst_context_writable_structure( context );
gst_structure_set( s, "context", GST_TYPE_GL_CONTEXT, gl_context, NULL );
gst_element_set_context( GST_ELEMENT( message->src ), context );
}
if( context )
{
gst_context_unref( context );
}
break;
}
...

When i'm trying to pull a frame, i'm getting a texure id. Furthermore, the provided texture ids increase by every single call. (They start with 0).
I pass this id to my another part of my application where i'm binding it to a texture.

And here i encounter the problem:

The uploaded video frames are not available in the rendering context. The provided ids are bound, but they have a different meaning in rendering thread.
For example i receive the frame with id 2, bind this and get a previously uploaded item from the rendering thread displayed.

I'm pretty sure, that there is a mistake within the context setup.
Could some provide an example, how the context of the GstGLContext can be retrieved from the current thread with gstreamer 1.14?

The debug log says:
672 got need context gst.gl.GLDisplay
673 got need context gst.gl.app_context
675 ** (myApp:172): CRITICAL **: 02:47:37.191: gst_gl_context_get_display: assertion 'GST_IS_GL_CONTEXT (context)' failed
677 ** (myApp:172): CRITICAL **: 02:47:37.191: gst_gl_display_get_handle_type: assertion 'GST_IS_GL_DISPLAY (display)' failed
(I've attached the full log below)

Thx in advance!

Best regards
Michael

### Appendix ###

Pipeline:

"udpsrc port=55555 caps=\"application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264, payload=(int)96\" "
"! rtph264depay "
"! vaapih264dec "
"! vaapipostproc name=postproc "
"! glupload "
"! video/x-raw(memory:GLMemory), format=(string)RGBA "
"! appsink name=sink emit-signals=true sync=false max-buffers=1 drop=true"

Debug-Log:

523 0:00:00.987126921 172 0x5bbe00 DEBUG glupload gstglupload.c:1599:gst_gl_upload_new:<glupload0> Created new GLUpload for context (NULL)
524 0:00:01.001294399 172 0x5bbe00 DEBUG glbasefilter gstglbasefilter.c:429:gst_gl_base_filter_change_state:<gluploadelement0> changing state: NULL => READY
525 0:00:01.001501817 172 0x5bbe00 INFO gldisplay gstgldisplay.c:289:gst_gl_display_new: creating a display, user choice:(NULL) (platform: (NULL))
526 0:00:01.002189708 172 0x5bbe00 DEBUG gldisplay gstgldisplay_egl.c:116:gst_gl_display_egl_get_from_native: egl no display extensions: EGL_EXT_client_extensions EGL_EXT_device_base EGL_EXT_device_enumeration EGL_EXT_device_query EGL_EXT_platform_base EGL_KHR_client_get_all_proc_addresses EGL_KHR_debug EGL_MESA_platform_gbm
527 0:00:01.008901079 172 0x5bbe00 DEBUG glbasefilter gstglbasefilter.c:429:gst_gl_base_filter_change_state:<gluploadelement0> changing state: READY => PAUSED
528 0:00:01.009128869 172 0x5bbe00 LOG glutils gstglutils.c:438:gst_gl_handle_context_query:<gluploadelement0> handle context query context query: 0xc780f0, GstQueryContext, context-type=(string)gst.vaapi.Display;
529 0:00:01.014013717 172 0x5bbe00 DEBUG glbasefilter gstglbasefilter.c:429:gst_gl_base_filter_change_state:<gluploadelement0> changing state: PAUSED => PLAYING
530 0:00:01.108233349 172 0xfb68a0 LOG glutils gstglutils.c:438:gst_gl_handle_context_query:<gluploadelement0> handle context query context query: 0x7f6694007850, GstQueryContext, context-type=(string)gst.vaapi.Display;
531 0:00:01.110263863 172 0xfb68a0 DEBUG gldisplay gstgldisplay.c:676:_get_gl_context_for_thread_unlocked:<gldisplayegl0> No GL context for thread (nil)
532 0:00:01.110311709 172 0xfb68a0 DEBUG gldisplay gstgldisplay.c:701:gst_gl_display_get_gl_context_for_thread:<gldisplayegl0> returning context (NULL) for thread (nil)
533 0:00:01.110375791 172 0xfb68a0 INFO glcontext gstglcontext.c:337:gst_gl_context_new: creating a context for display <gldisplayegl0>, user choice:(null)
534 0:00:01.110464937 172 0xfb68a0 DEBUG glcontext gstglcontext.c:371:gst_gl_context_new:<glcontextegl0> Done creating context for display <gldisplayegl0> (user_choice:(null))
535 0:00:01.110481115 172 0xfb68a0 DEBUG gldisplay gstgldisplay.c:534:gst_gl_display_create_context:<gldisplayegl0> creating context <glcontextegl0> from other context (NULL)
536 0:00:01.110500431 172 0xfb68a0 DEBUG glcontext gstglcontext.c:1025:gst_gl_context_create:<glcontextegl0> other_context:(NULL)
537 0:00:01.110520730 172 0xfb68a0 INFO glwindow gstglwindow.c:251:gst_gl_window_new: creating a window, user choice:(null)
538 0:00:01.110530438 172 0xfb68a0 WARN glwindow gstglwindow.c:293:gst_gl_window_new: Could not create window. user specified (null), creating dummy window
539 0:00:01.110744842 172 0xfb68a0 DEBUG glcontext gstglcontext.c:934:gst_gl_context_set_window:<glcontextegl0> window:<gldummywindow0>
540 0:00:01.110884115 172 0x7f66940078a0 DEBUG glcontext gstglcontext.c:1183:gst_gl_context_create_thread:<glcontextegl0> Creating thread
541 0:00:01.110943648 172 0x7f66940078a0 INFO glcontext gstglcontext.c:1240:gst_gl_context_create_thread:<glcontextegl0> Attempting to create opengl context. user chosen api(s) (any), compiled api support (gles2) display api (any)
542 0:00:01.110956788 172 0x7f66940078a0 DEBUG glcontext gstglcontext_egl.c:301:gst_gl_context_egl_create_context:<glcontextegl0> Creating EGL context
543 0:00:01.110971742 172 0x7f66940078a0 LOG gldisplay gstgldisplay_egl.c:260:gst_gl_display_egl_from_gl_display:<gldisplayegl0> display <gldisplayegl0>is already a GstGLDisplayEGL
544 0:00:01.123070353 172 0x7f66940078a0 INFO glcontext gstglcontext_egl.c:339:gst_gl_context_egl_create_context: egl initialized, version: 1.4
545 0:00:01.123126820 172 0x7f66940078a0 INFO glcontext gstglcontext_egl.c:451:gst_gl_context_egl_create_context: Bound OpenGL|ES
546 0:00:01.123199378 172 0x7f66940078a0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 140078144964064, 1
547 0:00:01.123247242 172 0x7f66940078a0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 3.2 flags 1 profile 0
548 0:00:01.124847761 172 0x7f66940078a0 INFO glcontext gstglcontext_egl.c:492:gst_gl_context_egl_create_context: gl context created: 140078144949584
549 0:00:01.124892990 172 0x7f66940078a0 DEBUG glcontext gstglcontext_egl.c:566:gst_gl_context_egl_create_context: No surface/handle !
550 0:00:01.124913056 172 0x7f66940078a0 INFO glcontext gstglcontext.c:1251:gst_gl_context_create_thread:<glcontextegl0> created context
551 0:00:01.124925813 172 0x7f66940078a0 DEBUG glcontext gstglcontext.c:754:gst_gl_context_activate:<glcontextegl0> activate:1
552 0:00:01.125056339 172 0x7f66940078a0 INFO glcontext gstglcontext.c:1267:gst_gl_context_create_thread:<glcontextegl0> available GL APIs: gles2
553 0:00:01.125074643 172 0x7f66940078a0 DEBUG glcontext gstglcontext.c:1286:gst_gl_context_create_thread:<glcontextegl0> Filling info
554 0:00:01.125612559 172 0x7f66940078a0 INFO glcontext gstglcontext.c:1080:_create_context_info:<glcontextegl0> GL_VERSION: OpenGL ES 3.2 Mesa 18.3.3
555 0:00:01.125636705 172 0x7f66940078a0 INFO glcontext gstglcontext.c:1083:_create_context_info:<glcontextegl0> GL_SHADING_LANGUAGE_VERSION: OpenGL ES GLSL ES 3.20
556 0:00:01.125648309 172 0x7f66940078a0 INFO glcontext gstglcontext.c:1085:_create_context_info:<glcontextegl0> GL_VENDOR: Intel Open Source Technology Center
557 0:00:01.125663588 172 0x7f66940078a0 INFO glcontext gstglcontext.c:1087:_create_context_info:<glcontextegl0> GL_RENDERER: Mesa DRI Intel(R) HD Graphics 500 (Broxton 2x6)
558 0:00:01.126069606 172 0x7f66940078a0 DEBUG glcontext gstglcontext.c:1424:gst_gl_context_fill_info:<glcontextegl0> GL_EXTENSIONS: GL_ANDROID_extension_pack_es31a GL_ANGLE_texture_compression_dxt3 GL_ANGLE_texture_compression_dxt5 GL_APPLE_texture_max_level GL_EXT_base_instance GL_EXT_blend_func_extended GL_EXT_blend_minmax GL_EXT_buffer_storage GL_EXT_clip_cull_distance GL_EXT_color_buffer_float GL_EXT_compressed_ETC1_RGB8_sub_texture GL_EXT_copy_image GL_EXT_discard_framebuffer GL_EXT_disjoint_timer_query GL_EXT_draw_buffers GL_EXT_draw_buffers_indexed GL_EXT_draw_elements_base_vertex GL_EXT_frag_depth GL_EXT_geometry_point_size GL_EXT_geometry_shader GL_EXT_gpu_shader5 GL_EXT_map_buffer_range GL_EXT_multi_draw_arrays GL_EXT_occlusion_query_boolean GL_EXT_polygon_offset_clamp GL_EXT_primitive_bounding_box GL_EXT_read_format_bgra GL_EXT_render_snorm GL_EXT_robustness GL_EXT_separate_shader_objects GL_EXT_shader_framebuffer_fetch GL_EXT_shader_framebuffer_fetch_non_coherent GL_EXT_shader_integer_mix GL_EXT_shader_io_blocks GL_EXT_shader_samples_identical GL_EXT_tessellation_point_size GL_EXT_tessellation_shader GL_EXT_texture_border_clamp GL_EXT_texture_buffer GL_EXT_texture_compression_dxt1 GL_EXT_texture_compression_s3tc GL_EXT_texture_cube_map_array GL_EXT_texture_filter_anisotropic GL_EXT_texture_format_BGRA8888 GL_EXT_texture_norm16 GL_EXT_texture_rg GL_EXT_texture_sRGB_decode GL_EXT_texture_type_2_10_10_10_REV GL_EXT_unpack_subimage GL_INTEL_conservative_rasterization GL_INTEL_performance_query GL_KHR_blend_equation_advanced GL_KHR_blend_equation_advanced_coherent GL_KHR_context_flush_control GL_KHR_debug GL_KHR_no_error GL_KHR_robust_buffer_access_behavior GL_KHR_robustness GL_KHR_texture_compression_astc_hdr GL_KHR_texture_compression_astc_ldr GL_KHR_texture_compression_astc_sliced_3d GL_MESA_framebuffer_flip_y GL_MESA_shader_integer_functions GL_NV_draw_buffers GL_NV_fbo_color_attachments GL_NV_fragment_shader_interlock GL_NV_image_formats GL_NV_read_buffer GL_NV_read_depth GL_NV_read_depth_stencil GL_NV_read_stencil GL_OES_EGL_image GL_OES_EGL_image_external GL_OES_EGL_image_external_essl3 GL_OES_EGL_sync GL_OES_compressed_ETC1_RGB8_texture GL_OES_copy_image GL_OES_depth24 GL_OES_depth_texture GL_OES_depth_texture_cube_map GL_OES_draw_buffers_indexed GL_OES_draw_elements_base_vertex GL_OES_element_index_uint GL_OES_fbo_render_mipmap GL_OES_geometry_point_size GL_OES_geometry_shader GL_OES_get_program_binary GL_OES_gpu_shader5 GL_OES_mapbuffer GL_OES_packed_depth_stencil GL_OES_primitive_bounding_box GL_OES_required_internalformat GL_OES_rgb8_rgba8 GL_OES_sample_shading GL_OES_sample_variables GL_OES_shader_image_atomic GL_OES_shader_io_blocks GL_OES_shader_multisample_interpolation GL_OES_standard_derivatives GL_OES_stencil8 GL_OES_surfaceless_context GL_OES_tessellation_point_size GL_OES_tessellation_shader GL_OES_texture_3D GL_OES_texture_border_clamp GL_OES_texture_buffer GL_OES_texture_cube_map_array GL_OES_texture_float GL_OES_texture_float_linear GL_OES_texture_half_float GL_OES_texture_half_float_linear GL_OES_texture_npot GL_OES_texture_stencil8 GL_OES_texture_storage_multisample_2d_array GL_OES_texture_view GL_OES_vertex_array_object GL_OES_vertex_half_float GL_OES_viewport_array
...
617 0:00:01.128329630 172 0x7f66940078a0 INFO glcontext gstgldebug.c:352:_gst_gl_debug_enable:<glcontextegl0> Enabling GL context debugging
618 0:00:01.128402461 172 0x7f66940078a0 INFO glcontext gstglcontext.c:1140:_unlock_create_thread:<glcontextegl0> gl thread running
619 0:00:01.128447966 172 0xfb68a0 INFO glcontext gstglcontext.c:1046:gst_gl_context_create:<glcontextegl0> gl thread created
620 0:00:01.128475728 172 0xfb68a0 DEBUG gldisplay gstgldisplay.c:676:_get_gl_context_for_thread_unlocked:<gldisplayegl0> No GL context for thread 0x7f66940078a0
621 0:00:01.128502670 172 0xfb68a0 DEBUG gldisplay gstgldisplay.c:789:gst_gl_display_add_context:<gldisplayegl0> Adding GL context <glcontextegl0>
622 0:00:01.128517007 172 0xfb68a0 DEBUG gldisplay gstgldisplay.c:797:gst_gl_display_add_context:<gldisplayegl0> successfully inserted context <glcontextegl0>
623 0:00:01.128572606 172 0x7f66940078a0 DEBUG gldebug gstgldebug.c:320:_gst_gl_debug_callback:<glcontextegl0> low: GL debug marker from third party id:0, starting element gluploadelement0
624 0:00:01.129411049 172 0xfb68a0 LOG glbufferpool gstglbufferpool.c:319:gst_gl_buffer_pool_new:<glbufferpool0> new GL buffer pool for context <glcontextegl0>
625 0:00:01.129602003 172 0xfb68a0 LOG glbufferpool gstglbufferpool.c:111:gst_gl_buffer_pool_set_config:<glbufferpool0> 1280x720, caps video/x-raw(memory:DMABuf), format=(string)RGBA, width=(int)1280, height=(int)720, framerate=(fraction)0/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono
626 0:00:01.132893570 172 0xfb68a0 LOG glbufferpool gstglbufferpool.c:360:gst_gl_buffer_pool_finalize:<glbufferpool0> finalize GL buffer pool 0x7f66940bc0b0
627 0:00:01.135439530 172 0xfb68a0 LOG glbufferpool gstglbufferpool.c:319:gst_gl_buffer_pool_new:<glbufferpool1> new GL buffer pool for context <glcontextegl0>
628 0:00:01.135521277 172 0xfb68a0 LOG glbufferpool gstglbufferpool.c:111:gst_gl_buffer_pool_set_config:<glbufferpool1> 1280x720, caps video/x-raw(memory:DMABuf), format=(string)RGBA, width=(int)1280, height=(int)720, framerate=(fraction)0/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono
629 0:00:01.135664205 172 0xfb68a0 LOG glbufferpool gstglbufferpool.c:360:gst_gl_buffer_pool_finalize:<glbufferpool1> finalize GL buffer pool 0x7f66940bc220
630 0:00:01.137504804 172 0xfb68a0 DEBUG glupload gstglupload.c:1776:_upload_find_method:<glupload0> attempting upload with uploader GLMemory
631 0:00:01.137552259 172 0xfb68a0 DEBUG glupload gstglupload.c:1776:_upload_find_method:<glupload0> attempting upload with uploader Dmabuf
632 0:00:01.137768199 172 0xfb68a0 DEBUG gleglimage gsteglimage.c:370:_drm_fourcc_from_info: Getting DRM fourcc for RGBA plane 0
633 0:00:01.137802118 172 0xfb68a0 DEBUG gleglimage gsteglimage.c:445:gst_egl_image_from_dmabuf: fourcc AB24 (875708993) plane 0 (1280x720)
634 0:00:01.137813565 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 0: 12375
635 0:00:01.137824948 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 1: 1280
636 0:00:01.137833311 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 2: 12374
637 0:00:01.137841486 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 3: 720
638 0:00:01.137849645 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 4: 12913
639 0:00:01.137857970 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 5: 875708993
640 0:00:01.137866623 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 6: 12914
641 0:00:01.137874949 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 7: 76
642 0:00:01.137883493 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 8: 12915
643 0:00:01.137891694 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 9: 0
644 0:00:01.137899847 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 10: 12916
645 0:00:01.137908007 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 11: 5120
646 0:00:01.137924516 172 0xfb68a0 LOG gldisplay gstgldisplay_egl.c:260:gst_gl_display_egl_from_gl_display:<gldisplayegl0> display <gldisplayegl0>is already a GstGLDisplayEGL
667 0:00:01.152973210 172 0xfb68a0 LOG gldisplay gstgldisplay_egl.c:260:gst_gl_display_egl_from_gl_display:<gldisplayegl0> display <gldisplayegl0>is already a GstGLDisplayEGL
668 0:00:01.153412185 172 0x7f66940078a0 DEBUG glbasememory gstglbasememory.c:178:gst_gl_base_memory_init: new GL buffer memory:0x7f667c1a4a80 size:3686400
669 0:00:01.153453864 172 0x7f66940078a0 DEBUG glbasetexture gstglmemory.c:340:gst_gl_memory_init: new GL texture context:<glcontextegl0> memory:0x7f667c1a4a80 target:2D format:6408 dimensions:1280x720 stride:5120 size:3686400
672 got need context gst.gl.GLDisplay
673 got need context gst.gl.app_context
675 ** (myApp:172): CRITICAL **: 02:47:37.191: gst_gl_context_get_display: assertion 'GST_IS_GL_CONTEXT (context)' failed
677 ** (myApp:172): CRITICAL **: 02:47:37.191: gst_gl_display_get_handle_type: assertion 'GST_IS_GL_DISPLAY (display)' failed
678 0:00:01.162750514 172 0x5bbe00 WARN glutils gstglutils.c:384:gst_gl_handle_set_context:<gluploadelement0> warning: Cannot set a GL context with a different display type
679 0:00:01.162842863 172 0x5bbe00 WARN glutils gstglutils.c:384:gst_gl_handle_set_context:<gluploadelement0> warning: Cannot set a GL context with a different display type
684 0:00:01.171573162 172 0x7f66c4004890 INFO gldisplay gstgldisplay.c:289:gst_gl_display_new: creating a display, user choice:(NULL) (platform: (NULL))
685 0:00:01.172184559 172 0x7f66c4004890 DEBUG gldisplay gstgldisplay_egl.c:116:gst_gl_display_egl_get_from_native: egl no display extensions: EGL_EXT_client_extensions EGL_EXT_device_base EGL_EXT_device_enumeration EGL_EXT_device_query EGL_EXT_platform_base EGL_KHR_client_get_all_proc_addresses EGL_KHR_debug EGL_MESA_platform_gbm
687 0:00:01.246980731 172 0xfb68a0 LOG glbufferpool gstglbufferpool.c:319:gst_gl_buffer_pool_new:<glbufferpool2> new GL buffer pool for context <glcontextegl0>
688 0:00:01.247122421 172 0xfb68a0 LOG glbufferpool gstglbufferpool.c:111:gst_gl_buffer_pool_set_config:<glbufferpool2> 1280x720, caps video/x-raw(memory:DMABuf), format=(string)RGBA, width=(int)1280, height=(int)720, framerate=(fraction)0/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono
689 0:00:01.247543458 172 0xfb68a0 LOG glbufferpool gstglbufferpool.c:360:gst_gl_buffer_pool_finalize:<glbufferpool2> finalize GL buffer pool 0x7f66940bc390

-----Ursprüngliche Nachricht-----
Von: gstreamer-devel [mailto:[hidden email]] Im Auftrag von Víctor Jáquez
Gesendet: Mittwoch, 5. Februar 2020 11:25
An: Discussion of the development of and with GStreamer <[hidden email]>
Betreff: [External] Re: ZeroCopy + AppSink + VAAPI + Qt

On Wed, 05 Feb 2020 at 11:15, Víctor Jáquez wrote:

> On Tue, 04 Feb 2020 at 14:00, Timtchenko, Michael wrote:
> >
> > What context is supposed to get passed into
> > gst_egl_image_from_dmabuf(xxx). Is it the target context, where i want to use the fd, or is it a different one?
> >
> > But my biggest problem is, that i don't have a glue, how i can
> > retrieve a texture from the given eglimage resp. its fd. I cannot
> > find any sources on the web, related to EglImage texture-conversions or anything like that.
>
> Not an epxert, but you don't retrieve a texture from an EGLImage. You
> bind the EGLImage to a texture handled by your application's GL
> Context. Look for EGLImageTargetTexture2D

Another option would be to use the glupload element, so you appsink would retrieve gl-based buffer which you can "map" with GST_MAP_GL flag and it will return a texture ready to use. But, to achieve that, you must pass your application's GL context, wrapping it inside a GstGLContext, to the pipeline through the sync bus.

In gst-plugins-base code there are examples of this.

vmjl
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

Bitte beachten / Please note!

*******************************************************************************

AGCO GmbH
Sitz der AGCO GmbH: Johann-Georg-Fendt-Str.4, 87616 Marktoberdorf, Germany
Registergericht Amtsgericht Kempten HRB 10327
Geschäftsführer: Christoph Groeblinghoff, Ingrid Bussjaeger-Martin, Dr. Heribert Reiter, Ekkehart Glaeser
Vorsitzender des Aufsichtsrates: Torsten Dehner

*******************************************************************************

Diese E-Mail ist nur für den Empfänger bestimmt, an den es gerichtet ist und kann vertrauliches
bzw. unter das Berufsgeheimnis fallendes Material enthalten. Jegliche darin enthaltene Ansicht
oder Meinungsäußerung ist die des Autors und stellt nicht notwendigerweise die Ansicht oder
Meinung von AGCO dar. Sind Sie nicht der Empfänger, so haben Sie diese E-Mail irrtümlich
erhalten und jegliche Verwendung, Veröffentlichung, Weiterleitung, Abschrift oder jeglicher
Druck dieser E-Mail ist strengstens untersagt. Weder AGCO noch der Absender übernehmen die
Haftung für Viren; es obliegt Ihrer Verantwortung, die E-Mail und deren angehängte
Dateien (sofern vorhanden) auf Viren zu überprüfen.

*******************************************************************************

This email is intended solely for the use of the individual to whom it is addressed and may contain
confidential and/or privileged material. Any views or opinions presented are solely those of the
author and do not necessarily represent those of AGCO. If you are not the intended recipient, be
advised that you have received this email in error and that any use, dissemination, forwarding,
printing or copying of this email is strictly prohibited. Neither AGCO nor the sender accepts any
responsibility for viruses and it is your responsibility to scan and virus check the email and its
attachment(s) (if any).

*******************************************************************************
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

Timtchenko, Michael

AW: [External] Re: ZeroCopy + AppSink + VAAPI + Qt

Hi all,

maybe my last mail was a bit too time consuming for fast reading...

I'll summarize my situation:

- Setup: udpsrc -> vaapi -> glupload -> appsink
- Pulling Frames with retrieving texture ids (ids are increased by every frame) via appsink
- Mapped texture ids are propagated to rendering code, but they are not mapped properly

My guess is, that there is sth wrong with content sharing. But unfortunately i don't know what.

Am i right, that gstreamer creates its own gl context, and the passed context by the bus-message "GST_MESSAGE_NEED_CONTEXT" is merely used
for sharing textures between both? In the case that this is correct, should it be possible to bind an textureid in Thread/Context A, which has
been created in Thread/Context B?

Furthermore i get three context requests over the bus with the following types:

gst.gl.app_context
gst.gl.GLDisplay
gst.vaapi.Display

Is it nescessary to provide all three contexts, or is the application context sufficient for appsink?

Does anybody has suggestions towards this issue? I really appreciate any help/advice or coding examples. Unfortunately i cannot find any complete example :-/

BR,
Michael

-----Ursprüngliche Nachricht-----
Von: gstreamer-devel [mailto:[hidden email]] Im Auftrag von Timtchenko, Michael
Gesendet: Freitag, 7. Februar 2020 10:04
An: Discussion of the development of and with GStreamer <[hidden email]>
Betreff: AW: [External] Re: ZeroCopy + AppSink + VAAPI + Qt

Hi again,

Thx for your support! :)

I've decided to use the glupload mechanism, because I wasn't able to generate proper eglimages.. however, it seems to generate textures.

Right now I'm trying to set the GstGlContext properly. To achieve this, I tried to "grab" the opengl context from the "QSGRenderThread" in the QT-Screnegraph and injected it afterwards to the gstreamer.
This thread provides the context, which i used for uploading of texture in my prior approach.

I'm doing this with the following code:

...
GstGLDisplay* display = gst_gl_display_new(); guintptr context = gst_gl_context_get_current_gl_context( GST_GL_PLATFORM_EGL );
GstGLContext* gstcontext = gst_gl_context_new_wrapped( display, context, GST_GL_PLATFORM_EGL, GST_GL_API_ANY ); ...

whereas *gstcontext* ist stored and afterwards injected via bus callback in gstreamer.

Here is my respond to the bus callback:
...
case GST_MESSAGE_NEED_CONTEXT:
{
const gchar* context_type;
GstContext* context = NULL;
gst_message_parse_context_type( message, &context_type );
g_print( "got need context %s\n", context_type );
if( g_strcmp0( context_type, "gst.gl.app_context" ) == 0 )
{
GstGLContext* gl_context = gstcontext; // *context from above*
GstStructure* s;
context = gst_context_new( "gst.gl.app_context", TRUE );
s = gst_context_writable_structure( context );
gst_structure_set( s, "context", GST_TYPE_GL_CONTEXT, gl_context, NULL );
gst_element_set_context( GST_ELEMENT( message->src ), context );
}
if( context )
{
gst_context_unref( context );
}
break;
}
...

When i'm trying to pull a frame, i'm getting a texure id. Furthermore, the provided texture ids increase by every single call. (They start with 0).
I pass this id to my another part of my application where i'm binding it to a texture.

And here i encounter the problem:

The uploaded video frames are not available in the rendering context. The provided ids are bound, but they have a different meaning in rendering thread.
For example i receive the frame with id 2, bind this and get a previously uploaded item from the rendering thread displayed.

I'm pretty sure, that there is a mistake within the context setup.
Could some provide an example, how the context of the GstGLContext can be retrieved from the current thread with gstreamer 1.14?

The debug log says:
672 got need context gst.gl.GLDisplay
673 got need context gst.gl.app_context
675 ** (myApp:172): CRITICAL **: 02:47:37.191: gst_gl_context_get_display: assertion 'GST_IS_GL_CONTEXT (context)' failed
677 ** (myApp:172): CRITICAL **: 02:47:37.191: gst_gl_display_get_handle_type: assertion 'GST_IS_GL_DISPLAY (display)' failed
(I've attached the full log below)

Thx in advance!

Best regards
Michael

### Appendix ###

Pipeline:

"udpsrc port=55555 caps=\"application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264, payload=(int)96\" "
"! rtph264depay "
"! vaapih264dec "
"! vaapipostproc name=postproc "
"! glupload "
"! video/x-raw(memory:GLMemory), format=(string)RGBA "
"! appsink name=sink emit-signals=true sync=false max-buffers=1 drop=true"

Debug-Log:

523 0:00:00.987126921 172 0x5bbe00 DEBUG glupload gstglupload.c:1599:gst_gl_upload_new:<glupload0> Created new GLUpload for context (NULL)
524 0:00:01.001294399 172 0x5bbe00 DEBUG glbasefilter gstglbasefilter.c:429:gst_gl_base_filter_change_state:<gluploadelement0> changing state: NULL => READY
525 0:00:01.001501817 172 0x5bbe00 INFO gldisplay gstgldisplay.c:289:gst_gl_display_new: creating a display, user choice:(NULL) (platform: (NULL))
526 0:00:01.002189708 172 0x5bbe00 DEBUG gldisplay gstgldisplay_egl.c:116:gst_gl_display_egl_get_from_native: egl no display extensions: EGL_EXT_client_extensions EGL_EXT_device_base EGL_EXT_device_enumeration EGL_EXT_device_query EGL_EXT_platform_base EGL_KHR_client_get_all_proc_addresses EGL_KHR_debug EGL_MESA_platform_gbm
527 0:00:01.008901079 172 0x5bbe00 DEBUG glbasefilter gstglbasefilter.c:429:gst_gl_base_filter_change_state:<gluploadelement0> changing state: READY => PAUSED
528 0:00:01.009128869 172 0x5bbe00 LOG glutils gstglutils.c:438:gst_gl_handle_context_query:<gluploadelement0> handle context query context query: 0xc780f0, GstQueryContext, context-type=(string)gst.vaapi.Display;
529 0:00:01.014013717 172 0x5bbe00 DEBUG glbasefilter gstglbasefilter.c:429:gst_gl_base_filter_change_state:<gluploadelement0> changing state: PAUSED => PLAYING
530 0:00:01.108233349 172 0xfb68a0 LOG glutils gstglutils.c:438:gst_gl_handle_context_query:<gluploadelement0> handle context query context query: 0x7f6694007850, GstQueryContext, context-type=(string)gst.vaapi.Display;
531 0:00:01.110263863 172 0xfb68a0 DEBUG gldisplay gstgldisplay.c:676:_get_gl_context_for_thread_unlocked:<gldisplayegl0> No GL context for thread (nil)
532 0:00:01.110311709 172 0xfb68a0 DEBUG gldisplay gstgldisplay.c:701:gst_gl_display_get_gl_context_for_thread:<gldisplayegl0> returning context (NULL) for thread (nil)
533 0:00:01.110375791 172 0xfb68a0 INFO glcontext gstglcontext.c:337:gst_gl_context_new: creating a context for display <gldisplayegl0>, user choice:(null)
534 0:00:01.110464937 172 0xfb68a0 DEBUG glcontext gstglcontext.c:371:gst_gl_context_new:<glcontextegl0> Done creating context for display <gldisplayegl0> (user_choice:(null))
535 0:00:01.110481115 172 0xfb68a0 DEBUG gldisplay gstgldisplay.c:534:gst_gl_display_create_context:<gldisplayegl0> creating context <glcontextegl0> from other context (NULL)
536 0:00:01.110500431 172 0xfb68a0 DEBUG glcontext gstglcontext.c:1025:gst_gl_context_create:<glcontextegl0> other_context:(NULL)
537 0:00:01.110520730 172 0xfb68a0 INFO glwindow gstglwindow.c:251:gst_gl_window_new: creating a window, user choice:(null)
538 0:00:01.110530438 172 0xfb68a0 WARN glwindow gstglwindow.c:293:gst_gl_window_new: Could not create window. user specified (null), creating dummy window
539 0:00:01.110744842 172 0xfb68a0 DEBUG glcontext gstglcontext.c:934:gst_gl_context_set_window:<glcontextegl0> window:<gldummywindow0>
540 0:00:01.110884115 172 0x7f66940078a0 DEBUG glcontext gstglcontext.c:1183:gst_gl_context_create_thread:<glcontextegl0> Creating thread
541 0:00:01.110943648 172 0x7f66940078a0 INFO glcontext gstglcontext.c:1240:gst_gl_context_create_thread:<glcontextegl0> Attempting to create opengl context. user chosen api(s) (any), compiled api support (gles2) display api (any)
542 0:00:01.110956788 172 0x7f66940078a0 DEBUG glcontext gstglcontext_egl.c:301:gst_gl_context_egl_create_context:<glcontextegl0> Creating EGL context
543 0:00:01.110971742 172 0x7f66940078a0 LOG gldisplay gstgldisplay_egl.c:260:gst_gl_display_egl_from_gl_display:<gldisplayegl0> display <gldisplayegl0>is already a GstGLDisplayEGL
544 0:00:01.123070353 172 0x7f66940078a0 INFO glcontext gstglcontext_egl.c:339:gst_gl_context_egl_create_context: egl initialized, version: 1.4
545 0:00:01.123126820 172 0x7f66940078a0 INFO glcontext gstglcontext_egl.c:451:gst_gl_context_egl_create_context: Bound OpenGL|ES
546 0:00:01.123199378 172 0x7f66940078a0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 140078144964064, 1
547 0:00:01.123247242 172 0x7f66940078a0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 3.2 flags 1 profile 0
548 0:00:01.124847761 172 0x7f66940078a0 INFO glcontext gstglcontext_egl.c:492:gst_gl_context_egl_create_context: gl context created: 140078144949584
549 0:00:01.124892990 172 0x7f66940078a0 DEBUG glcontext gstglcontext_egl.c:566:gst_gl_context_egl_create_context: No surface/handle !
550 0:00:01.124913056 172 0x7f66940078a0 INFO glcontext gstglcontext.c:1251:gst_gl_context_create_thread:<glcontextegl0> created context
551 0:00:01.124925813 172 0x7f66940078a0 DEBUG glcontext gstglcontext.c:754:gst_gl_context_activate:<glcontextegl0> activate:1
552 0:00:01.125056339 172 0x7f66940078a0 INFO glcontext gstglcontext.c:1267:gst_gl_context_create_thread:<glcontextegl0> available GL APIs: gles2
553 0:00:01.125074643 172 0x7f66940078a0 DEBUG glcontext gstglcontext.c:1286:gst_gl_context_create_thread:<glcontextegl0> Filling info
554 0:00:01.125612559 172 0x7f66940078a0 INFO glcontext gstglcontext.c:1080:_create_context_info:<glcontextegl0> GL_VERSION: OpenGL ES 3.2 Mesa 18.3.3
555 0:00:01.125636705 172 0x7f66940078a0 INFO glcontext gstglcontext.c:1083:_create_context_info:<glcontextegl0> GL_SHADING_LANGUAGE_VERSION: OpenGL ES GLSL ES 3.20
556 0:00:01.125648309 172 0x7f66940078a0 INFO glcontext gstglcontext.c:1085:_create_context_info:<glcontextegl0> GL_VENDOR: Intel Open Source Technology Center
557 0:00:01.125663588 172 0x7f66940078a0 INFO glcontext gstglcontext.c:1087:_create_context_info:<glcontextegl0> GL_RENDERER: Mesa DRI Intel(R) HD Graphics 500 (Broxton 2x6)
558 0:00:01.126069606 172 0x7f66940078a0 DEBUG glcontext gstglcontext.c:1424:gst_gl_context_fill_info:<glcontextegl0> GL_EXTENSIONS: GL_ANDROID_extension_pack_es31a GL_ANGLE_texture_compression_dxt3 GL_ANGLE_texture_compression_dxt5 GL_APPLE_texture_max_level GL_EXT_base_instance GL_EXT_blend_func_extended GL_EXT_blend_minmax GL_EXT_buffer_storage GL_EXT_clip_cull_distance GL_EXT_color_buffer_float GL_EXT_compressed_ETC1_RGB8_sub_texture GL_EXT_copy_image GL_EXT_discard_framebuffer GL_EXT_disjoint_timer_query GL_EXT_draw_buffers GL_EXT_draw_buffers_indexed GL_EXT_draw_elements_base_vertex GL_EXT_frag_depth GL_EXT_geometry_point_size GL_EXT_geometry_shader GL_EXT_gpu_shader5 GL_EXT_map_buffer_range GL_EXT_multi_draw_arrays GL_EXT_occlusion_query_boolean GL_EXT_polygon_offset_clamp GL_EXT_primitive_bounding_box GL_EXT_read_format_bgra GL_EXT_render_snorm GL_EXT_robustness GL_EXT_separate_shader_objects GL_EXT_shader_framebuffer_fetch GL_EXT_shader_framebuffer_fetch_non_coherent GL_EXT_shader_integer_mix GL_EXT_shader_io_blocks GL_EXT_shader_samples_identical GL_EXT_tessellation_point_size GL_EXT_tessellation_shader GL_EXT_texture_border_clamp GL_EXT_texture_buffer GL_EXT_texture_compression_dxt1 GL_EXT_texture_compression_s3tc GL_EXT_texture_cube_map_array GL_EXT_texture_filter_anisotropic GL_EXT_texture_format_BGRA8888 GL_EXT_texture_norm16 GL_EXT_texture_rg GL_EXT_texture_sRGB_decode GL_EXT_texture_type_2_10_10_10_REV GL_EXT_unpack_subimage GL_INTEL_conservative_rasterization GL_INTEL_performance_query GL_KHR_blend_equation_advanced GL_KHR_blend_equation_advanced_coherent GL_KHR_context_flush_control GL_KHR_debug GL_KHR_no_error GL_KHR_robust_buffer_access_behavior GL_KHR_robustness GL_KHR_texture_compression_astc_hdr GL_KHR_texture_compression_astc_ldr GL_KHR_texture_compression_astc_sliced_3d GL_MESA_framebuffer_flip_y GL_MESA_shader_integer_functions GL_NV_draw_buffers GL_NV_fbo_color_attachments GL_NV_fragment_shader_interlock GL_NV_image_formats GL_NV_read_buffer GL_NV_read_depth GL_NV_read_depth_stencil GL_NV_read_stencil GL_OES_EGL_image GL_OES_EGL_image_external GL_OES_EGL_image_external_essl3 GL_OES_EGL_sync GL_OES_compressed_ETC1_RGB8_texture GL_OES_copy_image GL_OES_depth24 GL_OES_depth_texture GL_OES_depth_texture_cube_map GL_OES_draw_buffers_indexed GL_OES_draw_elements_base_vertex GL_OES_element_index_uint GL_OES_fbo_render_mipmap GL_OES_geometry_point_size GL_OES_geometry_shader GL_OES_get_program_binary GL_OES_gpu_shader5 GL_OES_mapbuffer GL_OES_packed_depth_stencil GL_OES_primitive_bounding_box GL_OES_required_internalformat GL_OES_rgb8_rgba8 GL_OES_sample_shading GL_OES_sample_variables GL_OES_shader_image_atomic GL_OES_shader_io_blocks GL_OES_shader_multisample_interpolation GL_OES_standard_derivatives GL_OES_stencil8 GL_OES_surfaceless_context GL_OES_tessellation_point_size GL_OES_tessellation_shader GL_OES_texture_3D GL_OES_texture_border_clamp GL_OES_texture_buffer GL_OES_texture_cube_map_array GL_OES_texture_float GL_OES_texture_float_linear GL_OES_texture_half_float GL_OES_texture_half_float_linear GL_OES_texture_npot GL_OES_texture_stencil8 GL_OES_texture_storage_multisample_2d_array GL_OES_texture_view GL_OES_vertex_array_object GL_OES_vertex_half_float GL_OES_viewport_array
...
617 0:00:01.128329630 172 0x7f66940078a0 INFO glcontext gstgldebug.c:352:_gst_gl_debug_enable:<glcontextegl0> Enabling GL context debugging
618 0:00:01.128402461 172 0x7f66940078a0 INFO glcontext gstglcontext.c:1140:_unlock_create_thread:<glcontextegl0> gl thread running
619 0:00:01.128447966 172 0xfb68a0 INFO glcontext gstglcontext.c:1046:gst_gl_context_create:<glcontextegl0> gl thread created
620 0:00:01.128475728 172 0xfb68a0 DEBUG gldisplay gstgldisplay.c:676:_get_gl_context_for_thread_unlocked:<gldisplayegl0> No GL context for thread 0x7f66940078a0
621 0:00:01.128502670 172 0xfb68a0 DEBUG gldisplay gstgldisplay.c:789:gst_gl_display_add_context:<gldisplayegl0> Adding GL context <glcontextegl0>
622 0:00:01.128517007 172 0xfb68a0 DEBUG gldisplay gstgldisplay.c:797:gst_gl_display_add_context:<gldisplayegl0> successfully inserted context <glcontextegl0>
623 0:00:01.128572606 172 0x7f66940078a0 DEBUG gldebug gstgldebug.c:320:_gst_gl_debug_callback:<glcontextegl0> low: GL debug marker from third party id:0, starting element gluploadelement0
624 0:00:01.129411049 172 0xfb68a0 LOG glbufferpool gstglbufferpool.c:319:gst_gl_buffer_pool_new:<glbufferpool0> new GL buffer pool for context <glcontextegl0>
625 0:00:01.129602003 172 0xfb68a0 LOG glbufferpool gstglbufferpool.c:111:gst_gl_buffer_pool_set_config:<glbufferpool0> 1280x720, caps video/x-raw(memory:DMABuf), format=(string)RGBA, width=(int)1280, height=(int)720, framerate=(fraction)0/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono
626 0:00:01.132893570 172 0xfb68a0 LOG glbufferpool gstglbufferpool.c:360:gst_gl_buffer_pool_finalize:<glbufferpool0> finalize GL buffer pool 0x7f66940bc0b0
627 0:00:01.135439530 172 0xfb68a0 LOG glbufferpool gstglbufferpool.c:319:gst_gl_buffer_pool_new:<glbufferpool1> new GL buffer pool for context <glcontextegl0>
628 0:00:01.135521277 172 0xfb68a0 LOG glbufferpool gstglbufferpool.c:111:gst_gl_buffer_pool_set_config:<glbufferpool1> 1280x720, caps video/x-raw(memory:DMABuf), format=(string)RGBA, width=(int)1280, height=(int)720, framerate=(fraction)0/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono
629 0:00:01.135664205 172 0xfb68a0 LOG glbufferpool gstglbufferpool.c:360:gst_gl_buffer_pool_finalize:<glbufferpool1> finalize GL buffer pool 0x7f66940bc220
630 0:00:01.137504804 172 0xfb68a0 DEBUG glupload gstglupload.c:1776:_upload_find_method:<glupload0> attempting upload with uploader GLMemory
631 0:00:01.137552259 172 0xfb68a0 DEBUG glupload gstglupload.c:1776:_upload_find_method:<glupload0> attempting upload with uploader Dmabuf
632 0:00:01.137768199 172 0xfb68a0 DEBUG gleglimage gsteglimage.c:370:_drm_fourcc_from_info: Getting DRM fourcc for RGBA plane 0
633 0:00:01.137802118 172 0xfb68a0 DEBUG gleglimage gsteglimage.c:445:gst_egl_image_from_dmabuf: fourcc AB24 (875708993) plane 0 (1280x720)
634 0:00:01.137813565 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 0: 12375
635 0:00:01.137824948 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 1: 1280
636 0:00:01.137833311 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 2: 12374
637 0:00:01.137841486 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 3: 720
638 0:00:01.137849645 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 4: 12913
639 0:00:01.137857970 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 5: 875708993
640 0:00:01.137866623 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 6: 12914
641 0:00:01.137874949 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 7: 76
642 0:00:01.137883493 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 8: 12915
643 0:00:01.137891694 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 9: 0
644 0:00:01.137899847 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 10: 12916
645 0:00:01.137908007 172 0xfb68a0 LOG gleglimage gsteglimage.c:462:gst_egl_image_from_dmabuf: attr 11: 5120
646 0:00:01.137924516 172 0xfb68a0 LOG gldisplay gstgldisplay_egl.c:260:gst_gl_display_egl_from_gl_display:<gldisplayegl0> display <gldisplayegl0>is already a GstGLDisplayEGL
667 0:00:01.152973210 172 0xfb68a0 LOG gldisplay gstgldisplay_egl.c:260:gst_gl_display_egl_from_gl_display:<gldisplayegl0> display <gldisplayegl0>is already a GstGLDisplayEGL
668 0:00:01.153412185 172 0x7f66940078a0 DEBUG glbasememory gstglbasememory.c:178:gst_gl_base_memory_init: new GL buffer memory:0x7f667c1a4a80 size:3686400
669 0:00:01.153453864 172 0x7f66940078a0 DEBUG glbasetexture gstglmemory.c:340:gst_gl_memory_init: new GL texture context:<glcontextegl0> memory:0x7f667c1a4a80 target:2D format:6408 dimensions:1280x720 stride:5120 size:3686400
672 got need context gst.gl.GLDisplay
673 got need context gst.gl.app_context
675 ** (myApp:172): CRITICAL **: 02:47:37.191: gst_gl_context_get_display: assertion 'GST_IS_GL_CONTEXT (context)' failed
677 ** (myApp:172): CRITICAL **: 02:47:37.191: gst_gl_display_get_handle_type: assertion 'GST_IS_GL_DISPLAY (display)' failed
678 0:00:01.162750514 172 0x5bbe00 WARN glutils gstglutils.c:384:gst_gl_handle_set_context:<gluploadelement0> warning: Cannot set a GL context with a different display type
679 0:00:01.162842863 172 0x5bbe00 WARN glutils gstglutils.c:384:gst_gl_handle_set_context:<gluploadelement0> warning: Cannot set a GL context with a different display type
684 0:00:01.171573162 172 0x7f66c4004890 INFO gldisplay gstgldisplay.c:289:gst_gl_display_new: creating a display, user choice:(NULL) (platform: (NULL))
685 0:00:01.172184559 172 0x7f66c4004890 DEBUG gldisplay gstgldisplay_egl.c:116:gst_gl_display_egl_get_from_native: egl no display extensions: EGL_EXT_client_extensions EGL_EXT_device_base EGL_EXT_device_enumeration EGL_EXT_device_query EGL_EXT_platform_base EGL_KHR_client_get_all_proc_addresses EGL_KHR_debug EGL_MESA_platform_gbm
687 0:00:01.246980731 172 0xfb68a0 LOG glbufferpool gstglbufferpool.c:319:gst_gl_buffer_pool_new:<glbufferpool2> new GL buffer pool for context <glcontextegl0>
688 0:00:01.247122421 172 0xfb68a0 LOG glbufferpool gstglbufferpool.c:111:gst_gl_buffer_pool_set_config:<glbufferpool2> 1280x720, caps video/x-raw(memory:DMABuf), format=(string)RGBA, width=(int)1280, height=(int)720, framerate=(fraction)0/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono
689 0:00:01.247543458 172 0xfb68a0 LOG glbufferpool gstglbufferpool.c:360:gst_gl_buffer_pool_finalize:<glbufferpool2> finalize GL buffer pool 0x7f66940bc390

-----Ursprüngliche Nachricht-----
Von: gstreamer-devel [mailto:[hidden email]] Im Auftrag von Víctor Jáquez
Gesendet: Mittwoch, 5. Februar 2020 11:25
An: Discussion of the development of and with GStreamer <[hidden email]>
Betreff: [External] Re: ZeroCopy + AppSink + VAAPI + Qt

On Wed, 05 Feb 2020 at 11:15, Víctor Jáquez wrote:

Another option would be to use the glupload element, so you appsink would retrieve gl-based buffer which you can "map" with GST_MAP_GL flag and it will return a texture ready to use. But, to achieve that, you must pass your application's GL context, wrapping it inside a GstGLContext, to the pipeline through the sync bus.

In gst-plugins-base code there are examples of this.

vmjl
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

Bitte beachten / Please note!

*******************************************************************************

AGCO GmbH
Sitz der AGCO GmbH: Johann-Georg-Fendt-Str.4, 87616 Marktoberdorf, Germany Registergericht Amtsgericht Kempten HRB 10327
Geschäftsführer: Christoph Groeblinghoff, Ingrid Bussjaeger-Martin, Dr. Heribert Reiter, Ekkehart Glaeser Vorsitzender des Aufsichtsrates: Torsten Dehner

*******************************************************************************

Diese E-Mail ist nur für den Empfänger bestimmt, an den es gerichtet ist und kann vertrauliches bzw. unter das Berufsgeheimnis fallendes Material enthalten. Jegliche darin enthaltene Ansicht oder Meinungsäußerung ist die des Autors und stellt nicht notwendigerweise die Ansicht oder Meinung von AGCO dar. Sind Sie nicht der Empfänger, so haben Sie diese E-Mail irrtümlich erhalten und jegliche Verwendung, Veröffentlichung, Weiterleitung, Abschrift oder jeglicher Druck dieser E-Mail ist strengstens untersagt. Weder AGCO noch der Absender übernehmen die Haftung für Viren; es obliegt Ihrer Verantwortung, die E-Mail und deren angehängte Dateien (sofern vorhanden) auf Viren zu überprüfen.

*******************************************************************************

This email is intended solely for the use of the individual to whom it is addressed and may contain confidential and/or privileged material. Any views or opinions presented are solely those of the author and do not necessarily represent those of AGCO. If you are not the intended recipient, be advised that you have received this email in error and that any use, dissemination, forwarding, printing or copying of this email is strictly prohibited. Neither AGCO nor the sender accepts any responsibility for viruses and it is your responsibility to scan and virus check the email and its
attachment(s) (if any).

*******************************************************************************
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

This email is intended solely for the use of the individual to whom it is addressed and may contain confidential and/or privileged material. Any views or opinions presented are solely those of the author and do not necessarily represent those of AGCO. If you are not the intended recipient, be advised that you have received this email in error and that any use, dissemination, forwarding, printing or copying of this email is strictly prohibited. Neither AGCO nor the sender accepts any responsibility for viruses and it is your responsibility to scan and virus check the e-mail and its attachment(s) (if any).
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

Victor Jaquez

Re: AW: [External] Re: ZeroCopy + AppSink + VAAPI + Qt

On Mon, 10 Feb 2020 at 12:30, Timtchenko, Michael wrote:
>
> I'll summarize my situation:
>
> - Setup: udpsrc -> vaapi -> glupload -> appsink
> - Pulling Frames with retrieving texture ids (ids are increased by every
> frame) via appsink

They shouldn't increase forever. That would mean you're leaking textures.

> - Mapped texture ids are propagated to rendering code, but they are not mapped
> properly

What does that mean?

>
> My guess is, that there is sth wrong with content sharing. But unfortunately i
> don't know what.
>
> Am i right, that gstreamer creates its own gl context, and the passed context
> by the bus-message "GST_MESSAGE_NEED_CONTEXT" is merely used for sharing
> textures between both? In the case that this is correct, should it be possible
> to bind an textureid in Thread/Context A, which has been created in
> Thread/Context B?

gl pipeline will create is own context, but you can pass, with that bus message,
*your application's gl context*, thus gl pipeline's thread will create a shared
GL context with your application's one (where both context can share objects),

>
> Furthermore i get three context requests over the bus with the following types:
>
> gst.gl.app_context
> gst.gl.GLDisplay
> gst.vaapi.Display
>
> Is it nescessary to provide all three contexts, or is the application context
> sufficient for appsink?

No. Only app_context will be enough.

>
> Does anybody has suggestions towards this issue? I really appreciate any
> help/advice or coding examples. Unfortunately i cannot find any complete
> example :-/

https://gitlab.freedesktop.org/gstreamer/gst-plugins-base/blob/master/tests/examples/gl/sdl/sdlshare.c

vmjl

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

signature.asc (849 bytes) Download Attachment

Timtchenko, Michael

AW: AW: [External] Re: ZeroCopy + AppSink + VAAPI + Qt

Hi,

thx 4 response!

> >I'll summarize my situation:
>>
> >- Setup: udpsrc -> vaapi -> glupload -> appsink
> >- Pulling Frames with retrieving texture ids (ids are increased by every
>> frame) via appsink

> They shouldn't increase forever. That would mean you're leaking textures.

>> - Mapped texture ids are propagated to rendering code, but they are not mapped
>> properly

> What does that mean?

I'm receiving a textureId within my new_sample callback and passing this to my application. In my application I'm using this textureId for creating a Qt-ScreneGraph-Node. The problem I'm facing is, that I got obviously two opengl contexts (the context from gstreamer and those from my application). When I'm receiving a textureId from new_sample, this textureId has a different meaning in my application context. For example I'm receiving the textureId 2 in my new_sample callback, which should be a frame... in my application context, this can be an icon or sth else, what was previously uploaded. (at least this is what I see).

Is my assumption right, that I should be able to use/reference a texture by the textureId within my application context? Or is this approach invalid?

Kind regards,
Michael

-----Ursprüngliche Nachricht-----
Von: gstreamer-devel [mailto:[hidden email]] Im Auftrag von Víctor Jáquez
Gesendet: Montag, 10. Februar 2020 17:18
An: Discussion of the development of and with GStreamer <[hidden email]>
Betreff: Re: AW: [External] Re: ZeroCopy + AppSink + VAAPI + Qt

On Mon, 10 Feb 2020 at 12:30, Timtchenko, Michael wrote:
>
> I'll summarize my situation:
>
> - Setup: udpsrc -> vaapi -> glupload -> appsink
> - Pulling Frames with retrieving texture ids (ids are increased by every
> frame) via appsink

They shouldn't increase forever. That would mean you're leaking textures.

> - Mapped texture ids are propagated to rendering code, but they are not mapped
> properly

What does that mean?

>
> My guess is, that there is sth wrong with content sharing. But
> unfortunately i don't know what.
>
> Am i right, that gstreamer creates its own gl context, and the passed
> context by the bus-message "GST_MESSAGE_NEED_CONTEXT" is merely used
> for sharing textures between both? In the case that this is correct,
> should it be possible to bind an textureid in Thread/Context A, which
> has been created in Thread/Context B?

gl pipeline will create is own context, but you can pass, with that bus message, *your application's gl context*, thus gl pipeline's thread will create a shared GL context with your application's one (where both context can share objects),

>
> Furthermore i get three context requests over the bus with the following types:
>
> gst.gl.app_context
> gst.gl.GLDisplay
> gst.vaapi.Display
>
> Is it nescessary to provide all three contexts, or is the application
> context sufficient for appsink?

No. Only app_context will be enough.

>
> Does anybody has suggestions towards this issue? I really appreciate
> any help/advice or coding examples. Unfortunately i cannot find any
> complete example :-/

https://gitlab.freedesktop.org/gstreamer/gst-plugins-base/blob/master/tests/examples/gl/sdl/sdlshare.c

vmjl

Bitte beachten / Please note!

*******************************************************************************

AGCO GmbH
Sitz der AGCO GmbH: Johann-Georg-Fendt-Str.4, 87616 Marktoberdorf, Germany
Registergericht Amtsgericht Kempten HRB 10327
Geschäftsführer: Christoph Groeblinghoff, Ingrid Bussjaeger-Martin, Dr. Heribert Reiter, Ekkehart Glaeser
Vorsitzender des Aufsichtsrates: Torsten Dehner

*******************************************************************************

Diese E-Mail ist nur für den Empfänger bestimmt, an den es gerichtet ist und kann vertrauliches
bzw. unter das Berufsgeheimnis fallendes Material enthalten. Jegliche darin enthaltene Ansicht
oder Meinungsäußerung ist die des Autors und stellt nicht notwendigerweise die Ansicht oder
Meinung von AGCO dar. Sind Sie nicht der Empfänger, so haben Sie diese E-Mail irrtümlich
erhalten und jegliche Verwendung, Veröffentlichung, Weiterleitung, Abschrift oder jeglicher
Druck dieser E-Mail ist strengstens untersagt. Weder AGCO noch der Absender übernehmen die
Haftung für Viren; es obliegt Ihrer Verantwortung, die E-Mail und deren angehängte
Dateien (sofern vorhanden) auf Viren zu überprüfen.

*******************************************************************************

This email is intended solely for the use of the individual to whom it is addressed and may contain
confidential and/or privileged material. Any views or opinions presented are solely those of the
author and do not necessarily represent those of AGCO. If you are not the intended recipient, be
advised that you have received this email in error and that any use, dissemination, forwarding,
printing or copying of this email is strictly prohibited. Neither AGCO nor the sender accepts any
responsibility for viruses and it is your responsibility to scan and virus check the email and its
attachment(s) (if any).

*******************************************************************************
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

Timtchenko, Michael

AW: AW: [External] Re: ZeroCopy + AppSink + VAAPI + Qt

In reply to this post by Victor Jaquez

Hi again,

[Subjects: Appsink - ZeroCopy - EGL (without X) - glupload]

i've now implemented the suggested solution and encountered several minor problems, especially with the "GST_MESSAGE_NEED_CONTEXT"-message. I assumed that there
is only on possibility to retrieve bus-callbacks from gstreamer, now i know, that there is a synchronous as well as an asynchronous callback.

However, after reading (1), i tried to setup the GstGlContext before launching the pipeline. This caused a interesting situation. Without the context setup, i
received increasing textureIds over time. Right now, with configured context i run into several errors. When i'm trying to pull the a sample from appsink,
i face an endless loop, which causes the following debug print:

"Failed to create a OpenGL context: EGL_BAD_CONTEXT". I've attached the related log files below and categorized them in

A: Retrieving context
B: Setup GStreamer
C: Pulling Frame

Also i see that, the glcontextXX increases over the time from 0 to 197 (I dont think that this is valid, isn't it?)

glcontext gstglcontext.c:1244:gst_gl_context_create_thread:<glcontextegl97> Failed to create context

I'm receiving my OpenGl-Context by the following methods:

auto platform = GST_GL_PLATFORM_EGL;
auto api = gst_gl_context_get_current_gl_api( platform, NULL, NULL )
auto ctx = gst_gl_context_get_current_gl_context( platform );
auto disp = gst_gl_display_egl_new_with_egl_display( eglDisplay );
auto context = gst_gl_context_new_wrapped( ( GstGLDisplay* )disp, ctx, platform, api );

GError* error;

gst_gl_context_activate( context, TRUE );

if( !gst_gl_context_fill_info( context, &error ) )
{
qDebug() << "error:" << error->code << error->domain << error->message;
}

and this code is executed on the Renderer-Thread which has an valid OpenGl-Context (context is not null). I think this should gonna work, shouldn't it?

Could someone provide some advice on this? It seems like a general problem, which only appears in some corner cases. (2) is suffering the same issues, probably due to a different reason.

(1) http://gstreamer-devel.966125.n4.nabble.com/Problem-with-context-sharing-glupload-with-an-OVR-thread-Oculus-Mobile-SDK-td4685964.html
(2) https://forum.qt.io/topic/104824/qmlglsink-fails-with-egl_bad_context-or-fails-to-retrieve-wrapped-context-on-creation-on-jetson-tx1

Thanks in advance,
Help is really appreciated :)

Michael

A: Retrieving Context:

0:00:11.502866090 10473 0x7f4e50004890 TRACE gldisplay gstgldisplay.c:205:gst_gl_display_init: init 0x7f4e380c6850
0:00:11.503288599 10473 0x7f4e50004890 DEBUG glcontext gstglcontext.c:754:gst_gl_context_activate:<glwrappedcontext0> activate:1
0:00:11.535806814 10473 0x7f4e50004890 INFO glcontext gstglcontext.c:1080:_create_context_info:<glwrappedcontext0> GL_VERSION: OpenGL ES 3.2 Mesa 18.3.3
0:00:11.535862809 10473 0x7f4e50004890 INFO glcontext gstglcontext.c:1083:_create_context_info:<glwrappedcontext0> GL_SHADING_LANGUAGE_VERSION: OpenGL ES GLSL ES 3.20
0:00:11.535881346 10473 0x7f4e50004890 INFO glcontext gstglcontext.c:1085:_create_context_info:<glwrappedcontext0> GL_VENDOR: Intel Open Source Technology Center
0:00:11.535901756 10473 0x7f4e50004890 INFO glcontext gstglcontext.c:1087:_create_context_info:<glwrappedcontext0> GL_RENDERER: Mesa DRI Intel(R) HD Graphics 500 (Broxton 2x6)
0:00:11.536465506 10473 0x7f4e50004890 DEBUG glcontext gstglcontext.c:1424:gst_gl_context_fill_info:<glwrappedcontext0> GL_EXTENSIONS: GL_ANDROID_extension_pack_es31a GL_ANGLE_texture_compression_dxt3 GL_ANGLE_texture_compression_dxt5 GL_APPLE_texture_max_level GL_EXT_base_instance GL_EXT_blend_func_extended GL_EXT_blend_minmax GL_EXT_buffer_storage GL_EXT_clip_cull_distance GL_EXT_color_buffer_float GL_EXT_compressed_ETC1_RGB8_sub_texture GL_EXT_copy_image GL_EXT_discard_framebuffer GL_EXT_disjoint_timer_query GL_EXT_draw_buffers GL_EXT_draw_buffers_indexed GL_EXT_draw_elements_base_vertex GL_EXT_frag_depth GL_EXT_geometry_point_size GL_EXT_geometry_shader GL_EXT_gpu_shader5 GL_EXT_map_buffer_range GL_EXT_multi_draw_arrays GL_EXT_occlusion_query_boolean GL_EXT_polygon_offset_clamp GL_EXT_primitive_bounding_box GL_EXT_read_format_bgra GL_EXT_render_snorm GL_EXT_robustness GL_EXT_separate_shader_objects GL_EXT_shader_framebuffer_fetch GL_EXT_shader_framebuffer_fetch_non_coherent GL_EXT_shader_integer_mix GL_EXT_shader_io_blocks GL_EXT_shader_samples_identical GL_EXT_tessellation_point_size GL_EXT_tessellation_shader GL_EXT_texture_border_clamp GL_EXT_texture_buffer GL_EXT_texture_compression_dxt1 GL_EXT_texture_compression_s3tc GL_EXT_texture_cube_map_array GL_EXT_texture_filter_anisotropic GL_EXT_texture_format_BGRA8888 GL_EXT_texture_norm16 GL_EXT_texture_rg GL_EXT_texture_sRGB_decode GL_EXT_texture_type_2_10_10_10_REV GL_EXT_unpack_subimage GL_INTEL_conservative_rasterization GL_INTEL_performance_query GL_KHR_blend_equation_advanced GL_KHR_blend_equation_advanced_coherent GL_KHR_context_flush_control GL_KHR_debug GL_KHR_no_error GL_KHR_robust_buffer_access_behavior GL_KHR_robustness GL_KHR_texture_compression_astc_hdr GL_KHR_texture_compression_astc_ldr GL_KHR_texture_compression_astc_sliced_3d GL_MESA_framebuffer_flip_y GL_MESA_shader_integer_functions GL_NV_draw_buffers GL_NV_fbo_color_attachments GL_NV_fragment_shader_interlock GL_NV_image_formats GL_NV_read_buffer GL_NV_read_depth GL_NV_read_depth_stencil GL_NV_read_stencil GL_OES_EGL_image GL_OES_EGL_image_external GL_OES_EGL_image_external_essl3 GL_OES_EGL_sync GL_OES_compressed_ETC1_RGB8_texture GL_OES_copy_image GL_OES_depth24 GL_OES_depth_texture GL_OES_depth_texture_cube_map GL_OES_draw_buffers_indexed GL_OES_draw_elements_base_vertex GL_OES_element_index_uint GL_OES_fbo_render_mipmap GL_OES_geometry_point_size GL_OES_geometry_shader GL_OES_get_program_binary GL_OES_gpu_shader5 GL_OES_mapbuffer GL_OES_packed_depth_stencil GL_OES_primitive_bounding_box GL_OES_required_internalformat GL_OES_rgb8_rgba8 GL_OES_sample_shading GL_OES_sample_variables GL_OES_shader_image_atomic GL_OES_shader_io_blocks GL_OES_shader_multisample_interpolation GL_OES_standard_derivatives GL_OES_stencil8 GL_OES_surfaceless_context GL_OES_tessellation_point_size GL_OES_tessellation_shader GL_OES_texture_3D GL_OES_texture_border_clamp GL_OES_texture_buffer GL_OES_texture_cube_map_array GL_OES_texture_float GL_OES_texture_float_linear GL_OES_texture_half_float GL_OES_texture_half_float_linear GL_OES_texture_npot GL_OES_texture_stencil8 GL_OES_texture_storage_multisample_2d_array GL_OES_texture_view GL_OES_vertex_array_object GL_OES_vertex_half_float GL_OES_viewport_array
0:00:11.536557429 10473 0x7f4e50004890 DEBUG glfeature gstglfeature.c:193:_gst_gl_feature_check: core, 0x18003, 1.0 vs 0x10000, 3.2
0:00:11.536593596 10473 0x7f4e50004890 TRACE glfeature gstglfeature.c:222:_gst_gl_feature_check: glBindTexture should be in core
0:00:11.536619421 10473 0x7f4e50004890 TRACE glfeature gstglfeature.c:222:_gst_gl_feature_check: glBlendFunc should be in core
0:00:11.536640541 10473 0x7f4e50004890 TRACE glfeature gstglfeature.c:222:_gst_gl_feature_check: glClear should be in core
...

B: Start

0:00:15.202714608 10473 0x5bbe00 DEBUG glupload gstglupload.c:1599:gst_gl_upload_new:<glupload0> Created new GLUpload for context (NULL)
0:00:17.874761733 10473 0x5bbe00 LOG GST_CONTEXT gstcontext.c:170:gst_context_new: creating new context 0x7f4e380022a0
0:00:17.874974260 10473 0x5bbe00 DEBUG GST_CONTEXT gstelement.c:3460:gst_element_set_context:<upload> set context 0x7f4e380022a0 context, context=(GstGLContext)"\(GstGLWrappedContext\)\ glwrappedcontext0";
0:00:17.875583556 10473 0x5bbe00 DEBUG glbasefilter gstglbasefilter.c:429:gst_gl_base_filter_change_state:<upload> changing state: NULL => READY
0:00:17.875874598 10473 0x5bbe00 INFO GST_CONTEXT gstglutils.c:115:pad_query:<upload:src> pad peer query failed
0:00:17.875977611 10473 0x5bbe00 INFO GST_CONTEXT gstglutils.c:115:pad_query:<upload:sink> pad peer query failed
0:00:17.876006475 10473 0x5bbe00 INFO GST_CONTEXT gstglutils.c:177:_gst_context_query:<upload> posting need context message
0:00:17.876262358 10473 0x5bbe00 INFO gldisplay gstgldisplay.c:289:gst_gl_display_new: creating a display, user choice:(NULL) (platform: (NULL))
0:00:17.877011751 10473 0x5bbe00 TRACE gldisplay gstgldisplay.c:205:gst_gl_display_init: init 0x7f4e380c6df0
0:00:17.877212958 10473 0x5bbe00 DEBUG gldisplay gstgldisplay_egl.c:116:gst_gl_display_egl_get_from_native: egl no display extensions: EGL_EXT_client_extensions EGL_EXT_device_base EGL_EXT_device_enumeration EGL_EXT_device_query EGL_EXT_platform_base EGL_KHR_client_get_all_proc_addresses EGL_KHR_debug EGL_MESA_platform_gbm
0:00:17.877470593 10473 0x5bbe00 LOG GST_CONTEXT gstcontext.c:170:gst_context_new: creating new context 0x7f4e38002360
0:00:17.877536255 10473 0x5bbe00 LOG GST_CONTEXT gstgldisplay.c:458:gst_context_set_gl_display: setting GstGLDisplay(<gldisplayegl1>) on context(context 'gst.gl.GLDisplay'='context;')
0:00:17.877738913 10473 0x5bbe00 DEBUG GST_CONTEXT gstelement.c:3460:gst_element_set_context:<upload> set context 0x7f4e38002360 context, gst.gl.GLDisplay=(GstGLDisplay)"\(GstGLDisplayEGL\)\ gldisplayegl1";
0:00:17.877783804 10473 0x5bbe00 LOG GST_CONTEXT gstgldisplay.c:488:gst_context_get_gl_display: got GstGLDisplay(0x7f4e380c6df0) from context(0x7f4e38002360)
0:00:17.877815007 10473 0x5bbe00 TRACE gldisplay gstgldisplay.c:385:gst_gl_display_filter_gl_api:<gldisplayegl1> filtering with api any
0:00:17.877845791 10473 0x5bbe00 INFO GST_CONTEXT gstglutils.c:241:gst_gl_element_propagate_display_context:<upload> posting have context (0x7f4e38002360) message with display (0x7f4e380c6df0)
0:00:17.877932934 10473 0x5bbe00 TRACE gldisplay gstgldisplay.c:385:gst_gl_display_filter_gl_api:<gldisplayegl1> filtering with api any
0:00:17.878893460 10473 0x5bbe00 DEBUG glbasefilter gstglbasefilter.c:429:gst_gl_base_filter_change_state:<upload> changing state: READY => PAUSED
0:00:17.879149074 10473 0x5bbe00 LOG glutils gstglutils.c:438:gst_gl_handle_context_query:<upload> handle context query context query: 0xc77230, GstQueryContext, context-type=(string)gst.vaapi.Display;
0:00:17.879250655 10473 0x5bbe00 INFO GST_CONTEXT gstvaapivideocontext.c:136:context_pad_query:<postproc:src> context pad peer query failed
0:00:17.879289997 10473 0x5bbe00 INFO GST_CONTEXT gstvaapivideocontext.c:136:context_pad_query:<postproc:sink> context pad peer query failed
0:00:17.879314265 10473 0x5bbe00 INFO GST_CONTEXT gstvaapivideocontext.c:210:_gst_context_query:<postproc> posting `need-context' message
0:00:17.885944734 10473 0x5bbe00 LOG GST_CONTEXT gstcontext.c:170:gst_context_new: creating new context 0xfb6460
0:00:17.886173661 10473 0x5bbe00 DEBUG GST_CONTEXT gstelement.c:3460:gst_element_set_context:<postproc> set context 0xfb6460 context, gst.vaapi.Display=(GstVaapiDisplay)"\(GstVaapiDisplayDRM\)\ vaapidisplaydrm2";
0:00:17.886212029 10473 0x5bbe00 INFO GST_CONTEXT gstvaapivideocontext.c:299:gst_vaapi_video_context_propagate:<postproc> posting `have-context' (0xfb6460) message with display <vaapidisplaydrm2>
0:00:17.886444482 10473 0x5bbe00 LOG GST_CONTEXT gstcontext.c:170:gst_context_new: creating new context 0xfb64c0
0:00:17.886484999 10473 0x5bbe00 INFO GST_CONTEXT gstvaapivideocontext.c:179:_gst_context_get_from_query:<dec> found context (context 'gst.vaapi.Display'='context, gst.vaapi.Display=(GstVaapiDisplay)"\(GstVaapiDisplayDRM\)\ vaapidisplaydrm2";') in downstream query
0:00:17.886507328 10473 0x5bbe00 DEBUG GST_CONTEXT gstelement.c:3460:gst_element_set_context:<dec> set context 0xfb64c0 context, gst.vaapi.Display=(GstVaapiDisplay)"\(GstVaapiDisplayDRM\)\ vaapidisplaydrm2";
0:00:17.887390066 10473 0x5bbe00 DEBUG glbasefilter gstglbasefilter.c:429:gst_gl_base_filter_change_state:<upload> changing state: PAUSED => PLAYING

C:

Pulling frame

0:02:32.240269522 10473 0xc698a0 LOG glutils gstglutils.c:438:gst_gl_handle_context_query:<upload> handle context query context query: 0x7f4e14046800, GstQueryContext, context-type=(string)gst.vaapi.Display;
0:02:32.240322167 10473 0xc698a0 INFO GST_CONTEXT gstvaapivideocontext.c:136:context_pad_query:<postproc:src> context pad peer query failed
0:02:32.240342256 10473 0xc698a0 LOG GST_CONTEXT gstcontext.c:170:gst_context_new: creating new context 0x7f4e2c007240
0:02:32.240377292 10473 0xc698a0 INFO GST_CONTEXT gstvaapivideocontext.c:179:_gst_context_get_from_query:<postproc> found context (context 'gst.vaapi.Display'='context, gst.vaapi.Display=(GstVaapiDisplay)"\(GstVaapiDisplayDRM\)\ vaapidisplaydrm2";') in upstream query
0:02:32.240401205 10473 0xc698a0 DEBUG GST_CONTEXT gstelement.c:3460:gst_element_set_context:<postproc> set context 0x7f4e2c007240 context, gst.vaapi.Display=(GstVaapiDisplay)"\(GstVaapiDisplayDRM\)\ vaapidisplaydrm2";
0:02:32.242163439 10473 0xc698a0 INFO GST_CONTEXT gstglutils.c:115:pad_query:<upload:src> pad peer query failed
0:02:32.242217147 10473 0xc698a0 INFO GST_CONTEXT gstglutils.c:115:pad_query:<upload:sink> pad peer query failed
0:02:32.242239391 10473 0xc698a0 DEBUG gldisplay gstgldisplay.c:676:_get_gl_context_for_thread_unlocked:<gldisplayegl1> No GL context for thread (nil)
0:02:32.242254050 10473 0xc698a0 DEBUG gldisplay gstgldisplay.c:701:gst_gl_display_get_gl_context_for_thread:<gldisplayegl1> returning context (NULL) for thread (nil)
0:02:32.242288055 10473 0xc698a0 INFO glcontext gstglcontext.c:337:gst_gl_context_new: creating a context for display <gldisplayegl1>, user choice:(null)
0:02:32.242355961 10473 0xc698a0 DEBUG glcontext gstglcontext.c:371:gst_gl_context_new:<glcontextegl0> Done creating context for display <gldisplayegl1> (user_choice:(null))
0:02:32.242372507 10473 0xc698a0 DEBUG gldisplay gstgldisplay.c:534:gst_gl_display_create_context:<gldisplayegl1> creating context <glcontextegl0> from other context <glwrappedcontext0>
0:02:32.242384687 10473 0xc698a0 DEBUG glcontext gstglcontext.c:1025:gst_gl_context_create:<glcontextegl0> other_context:<glwrappedcontext0>
0:02:32.242421842 10473 0xc698a0 INFO glwindow gstglwindow.c:251:gst_gl_window_new: creating a window, user choice:(null)
0:02:32.242431197 10473 0xc698a0 WARN glwindow gstglwindow.c:293:gst_gl_window_new: Could not create window. user specified (null), creating dummy window
0:02:32.242664687 10473 0xc698a0 DEBUG glcontext gstglcontext.c:934:gst_gl_context_set_window:<glcontextegl0> window:<gldummywindow0>
0:02:32.243176652 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext.c:1183:gst_gl_context_create_thread:<glcontextegl0> Creating thread
0:02:32.243304472 10473 0x7f4e140469e0 INFO glcontext gstglcontext.c:1240:gst_gl_context_create_thread:<glcontextegl0> Attempting to create opengl context. user chosen api(s) (any), compiled api support (gles2) display api (any)
0:02:32.243319454 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:301:gst_gl_context_egl_create_context:<glcontextegl0> Creating EGL context
0:02:32.243362048 10473 0x7f4e140469e0 LOG gldisplay gstgldisplay_egl.c:260:gst_gl_display_egl_from_gl_display:<gldisplayegl1> display <gldisplayegl1>is already a GstGLDisplayEGL
0:02:32.257483977 10473 0x7f4e140469e0 INFO glcontext gstglcontext_egl.c:339:gst_gl_context_egl_create_context: egl initialized, version: 1.4
0:02:32.257542511 10473 0x7f4e140469e0 INFO glcontext gstglcontext_egl.c:451:gst_gl_context_egl_create_context: Bound OpenGL|ES
0:02:32.257615773 10473 0x7f4e140469e0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.257640213 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 3.2 flags 1 profile 0
0:02:32.257723735 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 3.2 flags 0 profile 0
0:02:32.257805533 10473 0x7f4e140469e0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.257844593 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 3.1 flags 1 profile 0
0:02:32.257861734 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 3.1 flags 0 profile 0
0:02:32.257908268 10473 0x7f4e140469e0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.257924042 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 3.0 flags 1 profile 0
0:02:32.257953974 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 3.0 flags 0 profile 0
0:02:32.258008836 10473 0x7f4e140469e0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.258038004 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 2.0 flags 1 profile 0
0:02:32.258055534 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 2.0 flags 0 profile 0
0:02:32.258214645 10473 0x7f4e140469e0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.258234785 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 0.0 flags 1 profile 0
0:02:32.258267139 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 0.0 flags 0 profile 0
0:02:32.258357512 10473 0x7f4e140469e0 WARN glcontext gstglcontext.c:1244:gst_gl_context_create_thread:<glcontextegl0> Failed to create context
0:02:32.258545818 10473 0xc698a0 INFO glcontext gstglcontext.c:1046:gst_gl_context_create:<glcontextegl0> gl thread created
0:02:32.258658378 10473 0xc698a0 WARN glbasefilter gstglbasefilter.c:395:gst_gl_base_filter_decide_allocation:<upload> error: Failed to create a OpenGL context: EGL_BAD_CONTEXT
0:02:32.259370113 10473 0xc698a0 INFO GST_CONTEXT gstglutils.c:115:pad_query:<upload:src> pad peer query failed
0:02:32.259411468 10473 0xc698a0 INFO GST_CONTEXT gstglutils.c:115:pad_query:<upload:sink> pad peer query failed
0:02:32.259430838 10473 0xc698a0 DEBUG gldisplay gstgldisplay.c:676:_get_gl_context_for_thread_unlocked:<gldisplayegl1> No GL context for thread (nil)
0:02:32.259444400 10473 0xc698a0 DEBUG gldisplay gstgldisplay.c:701:gst_gl_display_get_gl_context_for_thread:<gldisplayegl1> returning context (NULL) for thread (nil)
0:02:32.259464785 10473 0xc698a0 INFO glcontext gstglcontext.c:337:gst_gl_context_new: creating a context for display <gldisplayegl1>, user choice:(null)
0:02:32.259522079 10473 0xc698a0 DEBUG glcontext gstglcontext.c:371:gst_gl_context_new:<glcontextegl1> Done creating context for display <gldisplayegl1> (user_choice:(null))
0:02:32.259538396 10473 0xc698a0 DEBUG gldisplay gstgldisplay.c:534:gst_gl_display_create_context:<gldisplayegl1> creating context <glcontextegl1> from other context <glwrappedcontext0>
0:02:32.259549911 10473 0xc698a0 DEBUG glcontext gstglcontext.c:1025:gst_gl_context_create:<glcontextegl1> other_context:<glwrappedcontext0>
0:02:32.259560678 10473 0xc698a0 INFO glwindow gstglwindow.c:251:gst_gl_window_new: creating a window, user choice:(null)
0:02:32.259569883 10473 0xc698a0 WARN glwindow gstglwindow.c:293:gst_gl_window_new: Could not create window. user specified (null), creating dummy window
0:02:32.259618574 10473 0xc698a0 DEBUG glcontext gstglcontext.c:934:gst_gl_context_set_window:<glcontextegl1> window:<gldummywindow1>
0:02:32.260003122 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext.c:1183:gst_gl_context_create_thread:<glcontextegl1> Creating thread
0:02:32.260118220 10473 0x7f4e140468f0 INFO glcontext gstglcontext.c:1240:gst_gl_context_create_thread:<glcontextegl1> Attempting to create opengl context. user chosen api(s) (any), compiled api support (gles2) display api (any)
0:02:32.260134220 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:301:gst_gl_context_egl_create_context:<glcontextegl1> Creating EGL context
0:02:32.260171794 10473 0x7f4e140468f0 LOG gldisplay gstgldisplay_egl.c:260:gst_gl_display_egl_from_gl_display:<gldisplayegl1> display <gldisplayegl1>is already a GstGLDisplayEGL
0:02:32.260200245 10473 0x7f4e140468f0 INFO glcontext gstglcontext_egl.c:339:gst_gl_context_egl_create_context: egl initialized, version: 1.4
0:02:32.260210446 10473 0x7f4e140468f0 INFO glcontext gstglcontext_egl.c:451:gst_gl_context_egl_create_context: Bound OpenGL|ES
0:02:32.260283470 10473 0x7f4e140468f0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.260319738 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 3.2 flags 1 profile 0
0:02:32.260339703 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 3.2 flags 0 profile 0
0:02:32.260395647 10473 0x7f4e140468f0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.260423743 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 3.1 flags 1 profile 0
0:02:32.260441567 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 3.1 flags 0 profile 0
0:02:32.260486237 10473 0x7f4e140468f0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.260502877 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 3.0 flags 1 profile 0
0:02:32.260529545 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 3.0 flags 0 profile 0
0:02:32.260625711 10473 0x7f4e140468f0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.260648525 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 2.0 flags 1 profile 0
0:02:32.260666305 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 2.0 flags 0 profile 0
0:02:32.260728561 10473 0x7f4e140468f0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.260748118 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 0.0 flags 1 profile 0
0:02:32.260765578 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 0.0 flags 0 profile

...

compiled api support (gles2) display api (any)
0:02:35.303389619 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:301:gst_gl_context_egl_create_context:<glcontextegl96> Creating EGL context
0:02:35.303427520 10473 0x7f4e14157b20 LOG gldisplay gstgldisplay_egl.c:260:gst_gl_display_egl_from_gl_display:<gldisplayegl1> display <gldisplayegl1>is already a GstGLDisplayEGL
0:02:35.303454332 10473 0x7f4e14157b20 INFO glcontext gstglcontext_egl.c:339:gst_gl_context_egl_create_context: egl initialized, version: 1.4
0:02:35.303469176 10473 0x7f4e14157b20 INFO glcontext gstglcontext_egl.c:451:gst_gl_context_egl_create_context: Bound OpenGL|ES
0:02:35.303550747 10473 0x7f4e14157b20 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.303576749 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 3.2 flags 1 profile 0
0:02:35.303603708 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 3.2 flags 0 profile 0
0:02:35.303672315 10473 0x7f4e14157b20 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.303696830 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 3.1 flags 1 profile 0
0:02:35.303722198 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 3.1 flags 0 profile 0
0:02:35.303791393 10473 0x7f4e14157b20 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.303815452 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 3.0 flags 1 profile 0
0:02:35.303840089 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 3.0 flags 0 profile 0
0:02:35.303905358 10473 0x7f4e14157b20 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.303931712 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 2.0 flags 1 profile 0
0:02:35.303956453 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 2.0 flags 0 profile 0
0:02:35.304021428 10473 0x7f4e14157b20 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.304059736 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 0.0 flags 1 profile 0
0:02:35.304116501 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 0.0 flags 0 profile 0
0:02:35.304142499 10473 0x7f4e14157b20 WARN glcontext gstglcontext.c:1244:gst_gl_context_create_thread:<glcontextegl96> Failed to create context
0:02:35.304426728 10473 0xc698a0 INFO glcontext gstglcontext.c:1046:gst_gl_context_create:<glcontextegl96> gl thread created
0:02:35.304482599 10473 0xc698a0 WARN glbasefilter gstglbasefilter.c:395:gst_gl_base_filter_decide_allocation:<upload> error: Failed to create a OpenGL context: EGL_BAD_CONTEXT
0:02:35.335604841 10473 0xc698a0 INFO GST_CONTEXT gstglutils.c:115:pad_query:<upload:src> pad peer query failed
0:02:35.335669893 10473 0xc698a0 INFO GST_CONTEXT gstglutils.c:115:pad_query:<upload:sink> pad peer query failed
0:02:35.335746605 10473 0xc698a0 DEBUG gldisplay gstgldisplay.c:676:_get_gl_context_for_thread_unlocked:<gldisplayegl1> No GL context for thread (nil)
0:02:35.335770159 10473 0xc698a0 DEBUG gldisplay gstgldisplay.c:701:gst_gl_display_get_gl_context_for_thread:<gldisplayegl1> returning context (NULL) for thread (nil)
0:02:35.335801748 10473 0xc698a0 INFO glcontext gstglcontext.c:337:gst_gl_context_new: creating a context for display <gldisplayegl1>, user choice:(null)
0:02:35.335869290 10473 0xc698a0 DEBUG glcontext gstglcontext.c:371:gst_gl_context_new:<glcontextegl97> Done creating context for display <gldisplayegl1> (user_choice:(null))
0:02:35.335898708 10473 0xc698a0 DEBUG gldisplay gstgldisplay.c:534:gst_gl_display_create_context:<gldisplayegl1> creating context <glcontextegl97> from other context <glwrappedcontext0>
0:02:35.335916602 10473 0xc698a0 DEBUG glcontext gstglcontext.c:1025:gst_gl_context_create:<glcontextegl97> other_context:<glwrappedcontext0>
0:02:35.335932902 10473 0xc698a0 INFO glwindow gstglwindow.c:251:gst_gl_window_new: creating a window, user choice:(null)
0:02:35.335946595 10473 0xc698a0 WARN glwindow gstglwindow.c:293:gst_gl_window_new: Could not create window. user specified (null), creating dummy window
0:02:35.336139888 10473 0xc698a0 DEBUG glcontext gstglcontext.c:934:gst_gl_context_set_window:<glcontextegl97> window:<gldummywindow97>
0:02:35.336818707 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext.c:1183:gst_gl_context_create_thread:<glcontextegl97> Creating thread
0:02:35.336945996 10473 0x7f4e1414d800 INFO glcontext gstglcontext.c:1240:gst_gl_context_create_thread:<glcontextegl97> Attempting to create opengl context. user chosen api(s) (any), compiled api support (gles2) display api (any)
0:02:35.336966148 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:301:gst_gl_context_egl_create_context:<glcontextegl97> Creating EGL context
0:02:35.337000226 10473 0x7f4e1414d800 LOG gldisplay gstgldisplay_egl.c:260:gst_gl_display_egl_from_gl_display:<gldisplayegl1> display <gldisplayegl1>is already a GstGLDisplayEGL
0:02:35.337025655 10473 0x7f4e1414d800 INFO glcontext gstglcontext_egl.c:339:gst_gl_context_egl_create_context: egl initialized, version: 1.4
0:02:35.337040154 10473 0x7f4e1414d800 INFO glcontext gstglcontext_egl.c:451:gst_gl_context_egl_create_context: Bound OpenGL|ES
0:02:35.337156290 10473 0x7f4e1414d800 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.337186898 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 3.2 flags 1 profile 0
0:02:35.337216145 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 3.2 flags 0 profile 0
0:02:35.337284964 10473 0x7f4e1414d800 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.337316426 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 3.1 flags 1 profile 0
0:02:35.337342571 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 3.1 flags 0 profile 0
0:02:35.337408722 10473 0x7f4e1414d800 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.337438338 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 3.0 flags 1 profile 0
0:02:35.337464028 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 3.0 flags 0 profile 0
0:02:35.337529383 10473 0x7f4e1414d800 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.337553211 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 2.0 flags 1 profile 0
0:02:35.337578807 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 2.0 flags 0 profile 0
0:02:35.337643594 10473 0x7f4e1414d800 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.337669105 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 0.0 flags 1 profile 0
0:02:35.337694013 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 0.0 flags 0 profile 0
0:02:35.337717361 10473 0x7f4e1414d800 WARN glcontext gstglcontext.c:1244:gst_gl_context_create_thread:<glcontextegl97> Failed to create context
0:02:35.337800474 10473 0xc698a0 INFO glcontext gstglcontext.c:1046:gst_gl_context_create:<glcontextegl97> gl thread created
0:02:35.337912740 10473 0xc698a0 WARN glbasefilter gstglbasefilter.c:395:gst_gl_base_filter_decide_allocation:<upload> error: Failed to create a OpenGL context: EGL_BAD_CONTEXT

-----Ursprüngliche Nachricht-----
Von: Timtchenko, Michael
Gesendet: Dienstag, 11. Februar 2020 07:33
An: 'Discussion of the development of and with GStreamer' <[hidden email]>
Betreff: AW: AW: [External] Re: ZeroCopy + AppSink + VAAPI + Qt

Hi,

thx 4 response!

> >I'll summarize my situation:
>>
> >- Setup: udpsrc -> vaapi -> glupload -> appsink
> >- Pulling Frames with retrieving texture ids (ids are increased by
> >every
>> frame) via appsink

> They shouldn't increase forever. That would mean you're leaking textures.

>> - Mapped texture ids are propagated to rendering code, but they are not mapped
>> properly

> What does that mean?

I'm receiving a textureId within my new_sample callback and passing this to my application. In my application I'm using this textureId for creating a Qt-ScreneGraph-Node. The problem I'm facing is, that I got obviously two opengl contexts (the context from gstreamer and those from my application). When I'm receiving a textureId from new_sample, this textureId has a different meaning in my application context. For example I'm receiving the textureId 2 in my new_sample callback, which should be a frame... in my application context, this can be an icon or sth else, what was previously uploaded. (at least this is what I see).

Is my assumption right, that I should be able to use/reference a texture by the textureId within my application context? Or is this approach invalid?

Kind regards,
Michael

-----Ursprüngliche Nachricht-----
Von: gstreamer-devel [mailto:[hidden email]] Im Auftrag von Víctor Jáquez
Gesendet: Montag, 10. Februar 2020 17:18
An: Discussion of the development of and with GStreamer <[hidden email]>
Betreff: Re: AW: [External] Re: ZeroCopy + AppSink + VAAPI + Qt

On Mon, 10 Feb 2020 at 12:30, Timtchenko, Michael wrote:
>
> I'll summarize my situation:
>
> - Setup: udpsrc -> vaapi -> glupload -> appsink
> - Pulling Frames with retrieving texture ids (ids are increased by every
> frame) via appsink

They shouldn't increase forever. That would mean you're leaking textures.

> - Mapped texture ids are propagated to rendering code, but they are not mapped
> properly

What does that mean?

>
> My guess is, that there is sth wrong with content sharing. But
> unfortunately i don't know what.
>
> Am i right, that gstreamer creates its own gl context, and the passed
> context by the bus-message "GST_MESSAGE_NEED_CONTEXT" is merely used
> for sharing textures between both? In the case that this is correct,
> should it be possible to bind an textureid in Thread/Context A, which
> has been created in Thread/Context B?

gl pipeline will create is own context, but you can pass, with that bus message, *your application's gl context*, thus gl pipeline's thread will create a shared GL context with your application's one (where both context can share objects),

>
> Furthermore i get three context requests over the bus with the following types:
>
> gst.gl.app_context
> gst.gl.GLDisplay
> gst.vaapi.Display
>
> Is it nescessary to provide all three contexts, or is the application
> context sufficient for appsink?

No. Only app_context will be enough.

>
> Does anybody has suggestions towards this issue? I really appreciate
> any help/advice or coding examples. Unfortunately i cannot find any
> complete example :-/

https://gitlab.freedesktop.org/gstreamer/gst-plugins-base/blob/master/tests/examples/gl/sdl/sdlshare.c

vmjl

Bitte beachten / Please note!

*******************************************************************************

AGCO GmbH
Sitz der AGCO GmbH: Johann-Georg-Fendt-Str.4, 87616 Marktoberdorf, Germany
Registergericht Amtsgericht Kempten HRB 10327
Geschäftsführer: Christoph Groeblinghoff, Ingrid Bussjaeger-Martin, Dr. Heribert Reiter, Ekkehart Glaeser
Vorsitzender des Aufsichtsrates: Torsten Dehner

*******************************************************************************

Diese E-Mail ist nur für den Empfänger bestimmt, an den es gerichtet ist und kann vertrauliches
bzw. unter das Berufsgeheimnis fallendes Material enthalten. Jegliche darin enthaltene Ansicht
oder Meinungsäußerung ist die des Autors und stellt nicht notwendigerweise die Ansicht oder
Meinung von AGCO dar. Sind Sie nicht der Empfänger, so haben Sie diese E-Mail irrtümlich
erhalten und jegliche Verwendung, Veröffentlichung, Weiterleitung, Abschrift oder jeglicher
Druck dieser E-Mail ist strengstens untersagt. Weder AGCO noch der Absender übernehmen die
Haftung für Viren; es obliegt Ihrer Verantwortung, die E-Mail und deren angehängte
Dateien (sofern vorhanden) auf Viren zu überprüfen.

*******************************************************************************

This email is intended solely for the use of the individual to whom it is addressed and may contain
confidential and/or privileged material. Any views or opinions presented are solely those of the
author and do not necessarily represent those of AGCO. If you are not the intended recipient, be
advised that you have received this email in error and that any use, dissemination, forwarding,
printing or copying of this email is strictly prohibited. Neither AGCO nor the sender accepts any
responsibility for viruses and it is your responsibility to scan and virus check the email and its
attachment(s) (if any).

*******************************************************************************
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

Timtchenko, Michael

AW: AW: [External] Re: ZeroCopy + AppSink + VAAPI + Qt

Hi all,

ok.. now i handled the previous issue. It seems like the context, which I received from Qt was not valid. Right now I'm using the eglDisplay as well as the eglContext from the native system. This seems to work. At least I'm not getting any errors within the gstreamer log.

Unfortunately I still have trouble with the element glupload. When I'm trying to display the texture, it's completely black. Any ideas what can cause this?

This textureIds are now really big, they have about 8 ciphers... don't know if this is a problem?

I tried to evaluate if the textures are existent in my target context by calling "GLboolean glIsTexture(GLuint texture);". The method always returns true.

I'm providing the following filter caps for appsink

"video/x-raw(memory:GLMemory), format=(string)RGBA, texture-target=2D".

Is this a valid color format for GlTextures?

Help is *really* appreciated. :)

TIA,
Michael

-----Ursprüngliche Nachricht-----
Von: gstreamer-devel [mailto:[hidden email]] Im Auftrag von Timtchenko, Michael
Gesendet: Mittwoch, 12. Februar 2020 15:49
An: Discussion of the development of and with GStreamer <[hidden email]>
Betreff: AW: AW: [External] Re: ZeroCopy + AppSink + VAAPI + Qt

Hi again,

[Subjects: Appsink - ZeroCopy - EGL (without X) - glupload]

i've now implemented the suggested solution and encountered several minor problems, especially with the "GST_MESSAGE_NEED_CONTEXT"-message. I assumed that there is only on possibility to retrieve bus-callbacks from gstreamer, now i know, that there is a synchronous as well as an asynchronous callback.

However, after reading (1), i tried to setup the GstGlContext before launching the pipeline. This caused a interesting situation. Without the context setup, i received increasing textureIds over time. Right now, with configured context i run into several errors. When i'm trying to pull the a sample from appsink, i face an endless loop, which causes the following debug print:

"Failed to create a OpenGL context: EGL_BAD_CONTEXT". I've attached the related log files below and categorized them in

A: Retrieving context
B: Setup GStreamer
C: Pulling Frame

Also i see that, the glcontextXX increases over the time from 0 to 197 (I dont think that this is valid, isn't it?)

glcontext gstglcontext.c:1244:gst_gl_context_create_thread:<glcontextegl97> Failed to create context

I'm receiving my OpenGl-Context by the following methods:

auto platform = GST_GL_PLATFORM_EGL;
auto api = gst_gl_context_get_current_gl_api( platform, NULL, NULL )
auto ctx = gst_gl_context_get_current_gl_context( platform );
auto disp = gst_gl_display_egl_new_with_egl_display( eglDisplay );
auto context = gst_gl_context_new_wrapped( ( GstGLDisplay* )disp, ctx, platform, api );

GError* error;

gst_gl_context_activate( context, TRUE );

if( !gst_gl_context_fill_info( context, &error ) )
{
qDebug() << "error:" << error->code << error->domain << error->message;
}

and this code is executed on the Renderer-Thread which has an valid OpenGl-Context (context is not null). I think this should gonna work, shouldn't it?

Could someone provide some advice on this? It seems like a general problem, which only appears in some corner cases. (2) is suffering the same issues, probably due to a different reason.

(1) http://gstreamer-devel.966125.n4.nabble.com/Problem-with-context-sharing-glupload-with-an-OVR-thread-Oculus-Mobile-SDK-td4685964.html
(2) https://forum.qt.io/topic/104824/qmlglsink-fails-with-egl_bad_context-or-fails-to-retrieve-wrapped-context-on-creation-on-jetson-tx1

Thanks in advance,
Help is really appreciated :)

Michael

A: Retrieving Context:

0:00:11.502866090 10473 0x7f4e50004890 TRACE gldisplay gstgldisplay.c:205:gst_gl_display_init: init 0x7f4e380c6850
0:00:11.503288599 10473 0x7f4e50004890 DEBUG glcontext gstglcontext.c:754:gst_gl_context_activate:<glwrappedcontext0> activate:1
0:00:11.535806814 10473 0x7f4e50004890 INFO glcontext gstglcontext.c:1080:_create_context_info:<glwrappedcontext0> GL_VERSION: OpenGL ES 3.2 Mesa 18.3.3
0:00:11.535862809 10473 0x7f4e50004890 INFO glcontext gstglcontext.c:1083:_create_context_info:<glwrappedcontext0> GL_SHADING_LANGUAGE_VERSION: OpenGL ES GLSL ES 3.20
0:00:11.535881346 10473 0x7f4e50004890 INFO glcontext gstglcontext.c:1085:_create_context_info:<glwrappedcontext0> GL_VENDOR: Intel Open Source Technology Center
0:00:11.535901756 10473 0x7f4e50004890 INFO glcontext gstglcontext.c:1087:_create_context_info:<glwrappedcontext0> GL_RENDERER: Mesa DRI Intel(R) HD Graphics 500 (Broxton 2x6)
0:00:11.536465506 10473 0x7f4e50004890 DEBUG glcontext gstglcontext.c:1424:gst_gl_context_fill_info:<glwrappedcontext0> GL_EXTENSIONS: GL_ANDROID_extension_pack_es31a GL_ANGLE_texture_compression_dxt3 GL_ANGLE_texture_compression_dxt5 GL_APPLE_texture_max_level GL_EXT_base_instance GL_EXT_blend_func_extended GL_EXT_blend_minmax GL_EXT_buffer_storage GL_EXT_clip_cull_distance GL_EXT_color_buffer_float GL_EXT_compressed_ETC1_RGB8_sub_texture GL_EXT_copy_image GL_EXT_discard_framebuffer GL_EXT_disjoint_timer_query GL_EXT_draw_buffers GL_EXT_draw_buffers_indexed GL_EXT_draw_elements_base_vertex GL_EXT_frag_depth GL_EXT_geometry_point_size GL_EXT_geometry_shader GL_EXT_gpu_shader5 GL_EXT_map_buffer_range GL_EXT_multi_draw_arrays GL_EXT_occlusion_query_boolean GL_EXT_polygon_offset_clamp GL_EXT_primitive_bounding_box GL_EXT_read_format_bgra GL_EXT_render_snorm GL_EXT_robustness GL_EXT_separate_shader_objects GL_EXT_shader_framebuffer_fetch GL_EXT_shader_framebuffer_fetch_non_coherent GL_EXT_shader_integer_mix GL_EXT_shader_io_blocks GL_EXT_shader_samples_identical GL_EXT_tessellation_point_size GL_EXT_tessellation_shader GL_EXT_texture_border_clamp GL_EXT_texture_buffer GL_EXT_texture_compression_dxt1 GL_EXT_texture_compression_s3tc GL_EXT_texture_cube_map_array GL_EXT_texture_filter_anisotropic GL_EXT_texture_format_BGRA8888 GL_EXT_texture_norm16 GL_EXT_texture_rg GL_EXT_texture_sRGB_decode GL_EXT_texture_type_2_10_10_10_REV GL_EXT_unpack_subimage GL_INTEL_conservative_rasterization GL_INTEL_performance_query GL_KHR_blend_equation_advanced GL_KHR_blend_equation_advanced_coherent GL_KHR_context_flush_control GL_KHR_debug GL_KHR_no_error GL_KHR_robust_buffer_access_behavior GL_KHR_robustness GL_KHR_texture_compression_astc_hdr GL_KHR_texture_compression_astc_ldr GL_KHR_texture_compression_astc_sliced_3d GL_MESA_framebuffer_flip_y GL_MESA_shader_integer_functions GL_NV_draw_buffers GL_NV_fbo_color_attachments GL_NV_fragment_shader_interlock GL_NV_image_formats GL_NV_read_buffer GL_NV_read_depth GL_NV_read_depth_stencil GL_NV_read_stencil GL_OES_EGL_image GL_OES_EGL_image_external GL_OES_EGL_image_external_essl3 GL_OES_EGL_sync GL_OES_compressed_ETC1_RGB8_texture GL_OES_copy_image GL_OES_depth24 GL_OES_depth_texture GL_OES_depth_texture_cube_map GL_OES_draw_buffers_indexed GL_OES_draw_elements_base_vertex GL_OES_element_index_uint GL_OES_fbo_render_mipmap GL_OES_geometry_point_size GL_OES_geometry_shader GL_OES_get_program_binary GL_OES_gpu_shader5 GL_OES_mapbuffer GL_OES_packed_depth_stencil GL_OES_primitive_bounding_box GL_OES_required_internalformat GL_OES_rgb8_rgba8 GL_OES_sample_shading GL_OES_sample_variables GL_OES_shader_image_atomic GL_OES_shader_io_blocks GL_OES_shader_multisample_interpolation GL_OES_standard_derivatives GL_OES_stencil8 GL_OES_surfaceless_context GL_OES_tessellation_point_size GL_OES_tessellation_shader GL_OES_texture_3D GL_OES_texture_border_clamp GL_OES_texture_buffer GL_OES_texture_cube_map_array GL_OES_texture_float GL_OES_texture_float_linear GL_OES_texture_half_float GL_OES_texture_half_float_linear GL_OES_texture_npot GL_OES_texture_stencil8 GL_OES_texture_storage_multisample_2d_array GL_OES_texture_view GL_OES_vertex_array_object GL_OES_vertex_half_float GL_OES_viewport_array
0:00:11.536557429 10473 0x7f4e50004890 DEBUG glfeature gstglfeature.c:193:_gst_gl_feature_check: core, 0x18003, 1.0 vs 0x10000, 3.2
0:00:11.536593596 10473 0x7f4e50004890 TRACE glfeature gstglfeature.c:222:_gst_gl_feature_check: glBindTexture should be in core
0:00:11.536619421 10473 0x7f4e50004890 TRACE glfeature gstglfeature.c:222:_gst_gl_feature_check: glBlendFunc should be in core
0:00:11.536640541 10473 0x7f4e50004890 TRACE glfeature gstglfeature.c:222:_gst_gl_feature_check: glClear should be in core
...

B: Start

0:00:15.202714608 10473 0x5bbe00 DEBUG glupload gstglupload.c:1599:gst_gl_upload_new:<glupload0> Created new GLUpload for context (NULL)
0:00:17.874761733 10473 0x5bbe00 LOG GST_CONTEXT gstcontext.c:170:gst_context_new: creating new context 0x7f4e380022a0
0:00:17.874974260 10473 0x5bbe00 DEBUG GST_CONTEXT gstelement.c:3460:gst_element_set_context:<upload> set context 0x7f4e380022a0 context, context=(GstGLContext)"\(GstGLWrappedContext\)\ glwrappedcontext0";
0:00:17.875583556 10473 0x5bbe00 DEBUG glbasefilter gstglbasefilter.c:429:gst_gl_base_filter_change_state:<upload> changing state: NULL => READY
0:00:17.875874598 10473 0x5bbe00 INFO GST_CONTEXT gstglutils.c:115:pad_query:<upload:src> pad peer query failed
0:00:17.875977611 10473 0x5bbe00 INFO GST_CONTEXT gstglutils.c:115:pad_query:<upload:sink> pad peer query failed
0:00:17.876006475 10473 0x5bbe00 INFO GST_CONTEXT gstglutils.c:177:_gst_context_query:<upload> posting need context message
0:00:17.876262358 10473 0x5bbe00 INFO gldisplay gstgldisplay.c:289:gst_gl_display_new: creating a display, user choice:(NULL) (platform: (NULL))
0:00:17.877011751 10473 0x5bbe00 TRACE gldisplay gstgldisplay.c:205:gst_gl_display_init: init 0x7f4e380c6df0
0:00:17.877212958 10473 0x5bbe00 DEBUG gldisplay gstgldisplay_egl.c:116:gst_gl_display_egl_get_from_native: egl no display extensions: EGL_EXT_client_extensions EGL_EXT_device_base EGL_EXT_device_enumeration EGL_EXT_device_query EGL_EXT_platform_base EGL_KHR_client_get_all_proc_addresses EGL_KHR_debug EGL_MESA_platform_gbm
0:00:17.877470593 10473 0x5bbe00 LOG GST_CONTEXT gstcontext.c:170:gst_context_new: creating new context 0x7f4e38002360
0:00:17.877536255 10473 0x5bbe00 LOG GST_CONTEXT gstgldisplay.c:458:gst_context_set_gl_display: setting GstGLDisplay(<gldisplayegl1>) on context(context 'gst.gl.GLDisplay'='context;')
0:00:17.877738913 10473 0x5bbe00 DEBUG GST_CONTEXT gstelement.c:3460:gst_element_set_context:<upload> set context 0x7f4e38002360 context, gst.gl.GLDisplay=(GstGLDisplay)"\(GstGLDisplayEGL\)\ gldisplayegl1";
0:00:17.877783804 10473 0x5bbe00 LOG GST_CONTEXT gstgldisplay.c:488:gst_context_get_gl_display: got GstGLDisplay(0x7f4e380c6df0) from context(0x7f4e38002360)
0:00:17.877815007 10473 0x5bbe00 TRACE gldisplay gstgldisplay.c:385:gst_gl_display_filter_gl_api:<gldisplayegl1> filtering with api any
0:00:17.877845791 10473 0x5bbe00 INFO GST_CONTEXT gstglutils.c:241:gst_gl_element_propagate_display_context:<upload> posting have context (0x7f4e38002360) message with display (0x7f4e380c6df0)
0:00:17.877932934 10473 0x5bbe00 TRACE gldisplay gstgldisplay.c:385:gst_gl_display_filter_gl_api:<gldisplayegl1> filtering with api any
0:00:17.878893460 10473 0x5bbe00 DEBUG glbasefilter gstglbasefilter.c:429:gst_gl_base_filter_change_state:<upload> changing state: READY => PAUSED
0:00:17.879149074 10473 0x5bbe00 LOG glutils gstglutils.c:438:gst_gl_handle_context_query:<upload> handle context query context query: 0xc77230, GstQueryContext, context-type=(string)gst.vaapi.Display;
0:00:17.879250655 10473 0x5bbe00 INFO GST_CONTEXT gstvaapivideocontext.c:136:context_pad_query:<postproc:src> context pad peer query failed
0:00:17.879289997 10473 0x5bbe00 INFO GST_CONTEXT gstvaapivideocontext.c:136:context_pad_query:<postproc:sink> context pad peer query failed
0:00:17.879314265 10473 0x5bbe00 INFO GST_CONTEXT gstvaapivideocontext.c:210:_gst_context_query:<postproc> posting `need-context' message
0:00:17.885944734 10473 0x5bbe00 LOG GST_CONTEXT gstcontext.c:170:gst_context_new: creating new context 0xfb6460
0:00:17.886173661 10473 0x5bbe00 DEBUG GST_CONTEXT gstelement.c:3460:gst_element_set_context:<postproc> set context 0xfb6460 context, gst.vaapi.Display=(GstVaapiDisplay)"\(GstVaapiDisplayDRM\)\ vaapidisplaydrm2";
0:00:17.886212029 10473 0x5bbe00 INFO GST_CONTEXT gstvaapivideocontext.c:299:gst_vaapi_video_context_propagate:<postproc> posting `have-context' (0xfb6460) message with display <vaapidisplaydrm2>
0:00:17.886444482 10473 0x5bbe00 LOG GST_CONTEXT gstcontext.c:170:gst_context_new: creating new context 0xfb64c0
0:00:17.886484999 10473 0x5bbe00 INFO GST_CONTEXT gstvaapivideocontext.c:179:_gst_context_get_from_query:<dec> found context (context 'gst.vaapi.Display'='context, gst.vaapi.Display=(GstVaapiDisplay)"\(GstVaapiDisplayDRM\)\ vaapidisplaydrm2";') in downstream query
0:00:17.886507328 10473 0x5bbe00 DEBUG GST_CONTEXT gstelement.c:3460:gst_element_set_context:<dec> set context 0xfb64c0 context, gst.vaapi.Display=(GstVaapiDisplay)"\(GstVaapiDisplayDRM\)\ vaapidisplaydrm2";
0:00:17.887390066 10473 0x5bbe00 DEBUG glbasefilter gstglbasefilter.c:429:gst_gl_base_filter_change_state:<upload> changing state: PAUSED => PLAYING

C:

Pulling frame

0:02:32.240269522 10473 0xc698a0 LOG glutils gstglutils.c:438:gst_gl_handle_context_query:<upload> handle context query context query: 0x7f4e14046800, GstQueryContext, context-type=(string)gst.vaapi.Display;
0:02:32.240322167 10473 0xc698a0 INFO GST_CONTEXT gstvaapivideocontext.c:136:context_pad_query:<postproc:src> context pad peer query failed
0:02:32.240342256 10473 0xc698a0 LOG GST_CONTEXT gstcontext.c:170:gst_context_new: creating new context 0x7f4e2c007240
0:02:32.240377292 10473 0xc698a0 INFO GST_CONTEXT gstvaapivideocontext.c:179:_gst_context_get_from_query:<postproc> found context (context 'gst.vaapi.Display'='context, gst.vaapi.Display=(GstVaapiDisplay)"\(GstVaapiDisplayDRM\)\ vaapidisplaydrm2";') in upstream query
0:02:32.240401205 10473 0xc698a0 DEBUG GST_CONTEXT gstelement.c:3460:gst_element_set_context:<postproc> set context 0x7f4e2c007240 context, gst.vaapi.Display=(GstVaapiDisplay)"\(GstVaapiDisplayDRM\)\ vaapidisplaydrm2";
0:02:32.242163439 10473 0xc698a0 INFO GST_CONTEXT gstglutils.c:115:pad_query:<upload:src> pad peer query failed
0:02:32.242217147 10473 0xc698a0 INFO GST_CONTEXT gstglutils.c:115:pad_query:<upload:sink> pad peer query failed
0:02:32.242239391 10473 0xc698a0 DEBUG gldisplay gstgldisplay.c:676:_get_gl_context_for_thread_unlocked:<gldisplayegl1> No GL context for thread (nil)
0:02:32.242254050 10473 0xc698a0 DEBUG gldisplay gstgldisplay.c:701:gst_gl_display_get_gl_context_for_thread:<gldisplayegl1> returning context (NULL) for thread (nil)
0:02:32.242288055 10473 0xc698a0 INFO glcontext gstglcontext.c:337:gst_gl_context_new: creating a context for display <gldisplayegl1>, user choice:(null)
0:02:32.242355961 10473 0xc698a0 DEBUG glcontext gstglcontext.c:371:gst_gl_context_new:<glcontextegl0> Done creating context for display <gldisplayegl1> (user_choice:(null))
0:02:32.242372507 10473 0xc698a0 DEBUG gldisplay gstgldisplay.c:534:gst_gl_display_create_context:<gldisplayegl1> creating context <glcontextegl0> from other context <glwrappedcontext0>
0:02:32.242384687 10473 0xc698a0 DEBUG glcontext gstglcontext.c:1025:gst_gl_context_create:<glcontextegl0> other_context:<glwrappedcontext0>
0:02:32.242421842 10473 0xc698a0 INFO glwindow gstglwindow.c:251:gst_gl_window_new: creating a window, user choice:(null)
0:02:32.242431197 10473 0xc698a0 WARN glwindow gstglwindow.c:293:gst_gl_window_new: Could not create window. user specified (null), creating dummy window
0:02:32.242664687 10473 0xc698a0 DEBUG glcontext gstglcontext.c:934:gst_gl_context_set_window:<glcontextegl0> window:<gldummywindow0>
0:02:32.243176652 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext.c:1183:gst_gl_context_create_thread:<glcontextegl0> Creating thread
0:02:32.243304472 10473 0x7f4e140469e0 INFO glcontext gstglcontext.c:1240:gst_gl_context_create_thread:<glcontextegl0> Attempting to create opengl context. user chosen api(s) (any), compiled api support (gles2) display api (any)
0:02:32.243319454 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:301:gst_gl_context_egl_create_context:<glcontextegl0> Creating EGL context
0:02:32.243362048 10473 0x7f4e140469e0 LOG gldisplay gstgldisplay_egl.c:260:gst_gl_display_egl_from_gl_display:<gldisplayegl1> display <gldisplayegl1>is already a GstGLDisplayEGL
0:02:32.257483977 10473 0x7f4e140469e0 INFO glcontext gstglcontext_egl.c:339:gst_gl_context_egl_create_context: egl initialized, version: 1.4
0:02:32.257542511 10473 0x7f4e140469e0 INFO glcontext gstglcontext_egl.c:451:gst_gl_context_egl_create_context: Bound OpenGL|ES
0:02:32.257615773 10473 0x7f4e140469e0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.257640213 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 3.2 flags 1 profile 0
0:02:32.257723735 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 3.2 flags 0 profile 0
0:02:32.257805533 10473 0x7f4e140469e0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.257844593 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 3.1 flags 1 profile 0
0:02:32.257861734 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 3.1 flags 0 profile 0
0:02:32.257908268 10473 0x7f4e140469e0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.257924042 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 3.0 flags 1 profile 0
0:02:32.257953974 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 3.0 flags 0 profile 0
0:02:32.258008836 10473 0x7f4e140469e0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.258038004 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 2.0 flags 1 profile 0
0:02:32.258055534 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 2.0 flags 0 profile 0
0:02:32.258214645 10473 0x7f4e140469e0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.258234785 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 0.0 flags 1 profile 0
0:02:32.258267139 10473 0x7f4e140469e0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl0> attempting to create OpenGL ES context version 0.0 flags 0 profile 0
0:02:32.258357512 10473 0x7f4e140469e0 WARN glcontext gstglcontext.c:1244:gst_gl_context_create_thread:<glcontextegl0> Failed to create context
0:02:32.258545818 10473 0xc698a0 INFO glcontext gstglcontext.c:1046:gst_gl_context_create:<glcontextegl0> gl thread created
0:02:32.258658378 10473 0xc698a0 WARN glbasefilter gstglbasefilter.c:395:gst_gl_base_filter_decide_allocation:<upload> error: Failed to create a OpenGL context: EGL_BAD_CONTEXT
0:02:32.259370113 10473 0xc698a0 INFO GST_CONTEXT gstglutils.c:115:pad_query:<upload:src> pad peer query failed
0:02:32.259411468 10473 0xc698a0 INFO GST_CONTEXT gstglutils.c:115:pad_query:<upload:sink> pad peer query failed
0:02:32.259430838 10473 0xc698a0 DEBUG gldisplay gstgldisplay.c:676:_get_gl_context_for_thread_unlocked:<gldisplayegl1> No GL context for thread (nil)
0:02:32.259444400 10473 0xc698a0 DEBUG gldisplay gstgldisplay.c:701:gst_gl_display_get_gl_context_for_thread:<gldisplayegl1> returning context (NULL) for thread (nil)
0:02:32.259464785 10473 0xc698a0 INFO glcontext gstglcontext.c:337:gst_gl_context_new: creating a context for display <gldisplayegl1>, user choice:(null)
0:02:32.259522079 10473 0xc698a0 DEBUG glcontext gstglcontext.c:371:gst_gl_context_new:<glcontextegl1> Done creating context for display <gldisplayegl1> (user_choice:(null))
0:02:32.259538396 10473 0xc698a0 DEBUG gldisplay gstgldisplay.c:534:gst_gl_display_create_context:<gldisplayegl1> creating context <glcontextegl1> from other context <glwrappedcontext0>
0:02:32.259549911 10473 0xc698a0 DEBUG glcontext gstglcontext.c:1025:gst_gl_context_create:<glcontextegl1> other_context:<glwrappedcontext0>
0:02:32.259560678 10473 0xc698a0 INFO glwindow gstglwindow.c:251:gst_gl_window_new: creating a window, user choice:(null)
0:02:32.259569883 10473 0xc698a0 WARN glwindow gstglwindow.c:293:gst_gl_window_new: Could not create window. user specified (null), creating dummy window
0:02:32.259618574 10473 0xc698a0 DEBUG glcontext gstglcontext.c:934:gst_gl_context_set_window:<glcontextegl1> window:<gldummywindow1>
0:02:32.260003122 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext.c:1183:gst_gl_context_create_thread:<glcontextegl1> Creating thread
0:02:32.260118220 10473 0x7f4e140468f0 INFO glcontext gstglcontext.c:1240:gst_gl_context_create_thread:<glcontextegl1> Attempting to create opengl context. user chosen api(s) (any), compiled api support (gles2) display api (any)
0:02:32.260134220 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:301:gst_gl_context_egl_create_context:<glcontextegl1> Creating EGL context
0:02:32.260171794 10473 0x7f4e140468f0 LOG gldisplay gstgldisplay_egl.c:260:gst_gl_display_egl_from_gl_display:<gldisplayegl1> display <gldisplayegl1>is already a GstGLDisplayEGL
0:02:32.260200245 10473 0x7f4e140468f0 INFO glcontext gstglcontext_egl.c:339:gst_gl_context_egl_create_context: egl initialized, version: 1.4
0:02:32.260210446 10473 0x7f4e140468f0 INFO glcontext gstglcontext_egl.c:451:gst_gl_context_egl_create_context: Bound OpenGL|ES
0:02:32.260283470 10473 0x7f4e140468f0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.260319738 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 3.2 flags 1 profile 0
0:02:32.260339703 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 3.2 flags 0 profile 0
0:02:32.260395647 10473 0x7f4e140468f0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.260423743 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 3.1 flags 1 profile 0
0:02:32.260441567 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 3.1 flags 0 profile 0
0:02:32.260486237 10473 0x7f4e140468f0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.260502877 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 3.0 flags 1 profile 0
0:02:32.260529545 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 3.0 flags 0 profile 0
0:02:32.260625711 10473 0x7f4e140468f0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.260648525 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 2.0 flags 1 profile 0
0:02:32.260666305 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 2.0 flags 0 profile 0
0:02:32.260728561 10473 0x7f4e140468f0 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:32.260748118 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 0.0 flags 1 profile 0
0:02:32.260765578 10473 0x7f4e140468f0 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl1> attempting to create OpenGL ES context version 0.0 flags 0 profile

...

compiled api support (gles2) display api (any)
0:02:35.303389619 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:301:gst_gl_context_egl_create_context:<glcontextegl96> Creating EGL context
0:02:35.303427520 10473 0x7f4e14157b20 LOG gldisplay gstgldisplay_egl.c:260:gst_gl_display_egl_from_gl_display:<gldisplayegl1> display <gldisplayegl1>is already a GstGLDisplayEGL
0:02:35.303454332 10473 0x7f4e14157b20 INFO glcontext gstglcontext_egl.c:339:gst_gl_context_egl_create_context: egl initialized, version: 1.4
0:02:35.303469176 10473 0x7f4e14157b20 INFO glcontext gstglcontext_egl.c:451:gst_gl_context_egl_create_context: Bound OpenGL|ES
0:02:35.303550747 10473 0x7f4e14157b20 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.303576749 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 3.2 flags 1 profile 0
0:02:35.303603708 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 3.2 flags 0 profile 0
0:02:35.303672315 10473 0x7f4e14157b20 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.303696830 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 3.1 flags 1 profile 0
0:02:35.303722198 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 3.1 flags 0 profile 0
0:02:35.303791393 10473 0x7f4e14157b20 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.303815452 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 3.0 flags 1 profile 0
0:02:35.303840089 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 3.0 flags 0 profile 0
0:02:35.303905358 10473 0x7f4e14157b20 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.303931712 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 2.0 flags 1 profile 0
0:02:35.303956453 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 2.0 flags 0 profile 0
0:02:35.304021428 10473 0x7f4e14157b20 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.304059736 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 0.0 flags 1 profile 0
0:02:35.304116501 10473 0x7f4e14157b20 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl96> attempting to create OpenGL ES context version 0.0 flags 0 profile 0
0:02:35.304142499 10473 0x7f4e14157b20 WARN glcontext gstglcontext.c:1244:gst_gl_context_create_thread:<glcontextegl96> Failed to create context
0:02:35.304426728 10473 0xc698a0 INFO glcontext gstglcontext.c:1046:gst_gl_context_create:<glcontextegl96> gl thread created
0:02:35.304482599 10473 0xc698a0 WARN glbasefilter gstglbasefilter.c:395:gst_gl_base_filter_decide_allocation:<upload> error: Failed to create a OpenGL context: EGL_BAD_CONTEXT
0:02:35.335604841 10473 0xc698a0 INFO GST_CONTEXT gstglutils.c:115:pad_query:<upload:src> pad peer query failed
0:02:35.335669893 10473 0xc698a0 INFO GST_CONTEXT gstglutils.c:115:pad_query:<upload:sink> pad peer query failed
0:02:35.335746605 10473 0xc698a0 DEBUG gldisplay gstgldisplay.c:676:_get_gl_context_for_thread_unlocked:<gldisplayegl1> No GL context for thread (nil)
0:02:35.335770159 10473 0xc698a0 DEBUG gldisplay gstgldisplay.c:701:gst_gl_display_get_gl_context_for_thread:<gldisplayegl1> returning context (NULL) for thread (nil)
0:02:35.335801748 10473 0xc698a0 INFO glcontext gstglcontext.c:337:gst_gl_context_new: creating a context for display <gldisplayegl1>, user choice:(null)
0:02:35.335869290 10473 0xc698a0 DEBUG glcontext gstglcontext.c:371:gst_gl_context_new:<glcontextegl97> Done creating context for display <gldisplayegl1> (user_choice:(null))
0:02:35.335898708 10473 0xc698a0 DEBUG gldisplay gstgldisplay.c:534:gst_gl_display_create_context:<gldisplayegl1> creating context <glcontextegl97> from other context <glwrappedcontext0>
0:02:35.335916602 10473 0xc698a0 DEBUG glcontext gstglcontext.c:1025:gst_gl_context_create:<glcontextegl97> other_context:<glwrappedcontext0>
0:02:35.335932902 10473 0xc698a0 INFO glwindow gstglwindow.c:251:gst_gl_window_new: creating a window, user choice:(null)
0:02:35.335946595 10473 0xc698a0 WARN glwindow gstglwindow.c:293:gst_gl_window_new: Could not create window. user specified (null), creating dummy window
0:02:35.336139888 10473 0xc698a0 DEBUG glcontext gstglcontext.c:934:gst_gl_context_set_window:<glcontextegl97> window:<gldummywindow97>
0:02:35.336818707 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext.c:1183:gst_gl_context_create_thread:<glcontextegl97> Creating thread
0:02:35.336945996 10473 0x7f4e1414d800 INFO glcontext gstglcontext.c:1240:gst_gl_context_create_thread:<glcontextegl97> Attempting to create opengl context. user chosen api(s) (any), compiled api support (gles2) display api (any)
0:02:35.336966148 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:301:gst_gl_context_egl_create_context:<glcontextegl97> Creating EGL context
0:02:35.337000226 10473 0x7f4e1414d800 LOG gldisplay gstgldisplay_egl.c:260:gst_gl_display_egl_from_gl_display:<gldisplayegl1> display <gldisplayegl1>is already a GstGLDisplayEGL
0:02:35.337025655 10473 0x7f4e1414d800 INFO glcontext gstglcontext_egl.c:339:gst_gl_context_egl_create_context: egl initialized, version: 1.4
0:02:35.337040154 10473 0x7f4e1414d800 INFO glcontext gstglcontext_egl.c:451:gst_gl_context_egl_create_context: Bound OpenGL|ES
0:02:35.337156290 10473 0x7f4e1414d800 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.337186898 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 3.2 flags 1 profile 0
0:02:35.337216145 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 3.2 flags 0 profile 0
0:02:35.337284964 10473 0x7f4e1414d800 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.337316426 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 3.1 flags 1 profile 0
0:02:35.337342571 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 3.1 flags 0 profile 0
0:02:35.337408722 10473 0x7f4e1414d800 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.337438338 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 3.0 flags 1 profile 0
0:02:35.337464028 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 3.0 flags 0 profile 0
0:02:35.337529383 10473 0x7f4e1414d800 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.337553211 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 2.0 flags 1 profile 0
0:02:35.337578807 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 2.0 flags 0 profile 0
0:02:35.337643594 10473 0x7f4e1414d800 INFO glcontext gstglcontext_egl.c:206:gst_gl_context_egl_choose_config: config set: 139973119593440, 1
0:02:35.337669105 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 0.0 flags 1 profile 0
0:02:35.337694013 10473 0x7f4e1414d800 DEBUG glcontext gstglcontext_egl.c:250:_create_context_with_flags:<glcontextegl97> attempting to create OpenGL ES context version 0.0 flags 0 profile 0
0:02:35.337717361 10473 0x7f4e1414d800 WARN glcontext gstglcontext.c:1244:gst_gl_context_create_thread:<glcontextegl97> Failed to create context
0:02:35.337800474 10473 0xc698a0 INFO glcontext gstglcontext.c:1046:gst_gl_context_create:<glcontextegl97> gl thread created
0:02:35.337912740 10473 0xc698a0 WARN glbasefilter gstglbasefilter.c:395:gst_gl_base_filter_decide_allocation:<upload> error: Failed to create a OpenGL context: EGL_BAD_CONTEXT

-----Ursprüngliche Nachricht-----
Von: Timtchenko, Michael
Gesendet: Dienstag, 11. Februar 2020 07:33
An: 'Discussion of the development of and with GStreamer' <[hidden email]>
Betreff: AW: AW: [External] Re: ZeroCopy + AppSink + VAAPI + Qt

Hi,

thx 4 response!

> >I'll summarize my situation:
>>
> >- Setup: udpsrc -> vaapi -> glupload -> appsink
> >- Pulling Frames with retrieving texture ids (ids are increased by
> >every
>> frame) via appsink

> They shouldn't increase forever. That would mean you're leaking textures.

>> - Mapped texture ids are propagated to rendering code, but they are not mapped
>> properly

> What does that mean?

I'm receiving a textureId within my new_sample callback and passing this to my application. In my application I'm using this textureId for creating a Qt-ScreneGraph-Node. The problem I'm facing is, that I got obviously two opengl contexts (the context from gstreamer and those from my application). When I'm receiving a textureId from new_sample, this textureId has a different meaning in my application context. For example I'm receiving the textureId 2 in my new_sample callback, which should be a frame... in my application context, this can be an icon or sth else, what was previously uploaded. (at least this is what I see).

Is my assumption right, that I should be able to use/reference a texture by the textureId within my application context? Or is this approach invalid?

Kind regards,
Michael

-----Ursprüngliche Nachricht-----
Von: gstreamer-devel [mailto:[hidden email]] Im Auftrag von Víctor Jáquez
Gesendet: Montag, 10. Februar 2020 17:18
An: Discussion of the development of and with GStreamer <[hidden email]>
Betreff: Re: AW: [External] Re: ZeroCopy + AppSink + VAAPI + Qt

On Mon, 10 Feb 2020 at 12:30, Timtchenko, Michael wrote:
>
> I'll summarize my situation:
>
> - Setup: udpsrc -> vaapi -> glupload -> appsink
> - Pulling Frames with retrieving texture ids (ids are increased by every
> frame) via appsink

They shouldn't increase forever. That would mean you're leaking textures.

> - Mapped texture ids are propagated to rendering code, but they are not mapped
> properly

What does that mean?

>
> My guess is, that there is sth wrong with content sharing. But
> unfortunately i don't know what.
>
> Am i right, that gstreamer creates its own gl context, and the passed
> context by the bus-message "GST_MESSAGE_NEED_CONTEXT" is merely used
> for sharing textures between both? In the case that this is correct,
> should it be possible to bind an textureid in Thread/Context A, which
> has been created in Thread/Context B?

gl pipeline will create is own context, but you can pass, with that bus message, *your application's gl context*, thus gl pipeline's thread will create a shared GL context with your application's one (where both context can share objects),

>
> Furthermore i get three context requests over the bus with the following types:
>
> gst.gl.app_context
> gst.gl.GLDisplay
> gst.vaapi.Display
>
> Is it nescessary to provide all three contexts, or is the application
> context sufficient for appsink?

No. Only app_context will be enough.

>
> Does anybody has suggestions towards this issue? I really appreciate
> any help/advice or coding examples. Unfortunately i cannot find any
> complete example :-/

https://gitlab.freedesktop.org/gstreamer/gst-plugins-base/blob/master/tests/examples/gl/sdl/sdlshare.c

vmjl

Bitte beachten / Please note!

*******************************************************************************

AGCO GmbH
Sitz der AGCO GmbH: Johann-Georg-Fendt-Str.4, 87616 Marktoberdorf, Germany Registergericht Amtsgericht Kempten HRB 10327
Geschäftsführer: Christoph Groeblinghoff, Ingrid Bussjaeger-Martin, Dr. Heribert Reiter, Ekkehart Glaeser Vorsitzender des Aufsichtsrates: Torsten Dehner

*******************************************************************************

Diese E-Mail ist nur für den Empfänger bestimmt, an den es gerichtet ist und kann vertrauliches bzw. unter das Berufsgeheimnis fallendes Material enthalten. Jegliche darin enthaltene Ansicht oder Meinungsäußerung ist die des Autors und stellt nicht notwendigerweise die Ansicht oder Meinung von AGCO dar. Sind Sie nicht der Empfänger, so haben Sie diese E-Mail irrtümlich erhalten und jegliche Verwendung, Veröffentlichung, Weiterleitung, Abschrift oder jeglicher Druck dieser E-Mail ist strengstens untersagt. Weder AGCO noch der Absender übernehmen die Haftung für Viren; es obliegt Ihrer Verantwortung, die E-Mail und deren angehängte Dateien (sofern vorhanden) auf Viren zu überprüfen.

*******************************************************************************

This email is intended solely for the use of the individual to whom it is addressed and may contain confidential and/or privileged material. Any views or opinions presented are solely those of the author and do not necessarily represent those of AGCO. If you are not the intended recipient, be advised that you have received this email in error and that any use, dissemination, forwarding, printing or copying of this email is strictly prohibited. Neither AGCO nor the sender accepts any responsibility for viruses and it is your responsibility to scan and virus check the email and its
attachment(s) (if any).

*******************************************************************************
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

This email is intended solely for the use of the individual to whom it is addressed and may contain confidential and/or privileged material. Any views or opinions presented are solely those of the author and do not necessarily represent those of AGCO. If you are not the intended recipient, be advised that you have received this email in error and that any use, dissemination, forwarding, printing or copying of this email is strictly prohibited. Neither AGCO nor the sender accepts any responsibility for viruses and it is your responsibility to scan and virus check the e-mail and its attachment(s) (if any).
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel