Queue Overrun

classic Classic list List threaded Threaded
10 messages Options
Reply | Threaded
Open this post in threaded view
|

Queue Overrun

Duchassin Frederic

Hello,

 

I use this pipeline on Imx6 :

 

gst-launch-1.0  udpsrc address=239.0.0.1 port=1234 ! queue max-size_bytes=20000000 min-threshold-bytes=100 ! tsdemux name=d program-number=275 ! multiqueue name=q use-buffering=1 d. ! q.  q. ! queue ! decodebin ! queue ! imxg2dvideosink q. ! queue ! decodebin ! queue ! audioconvert ! volume volume=10 ! alsasink

 

 

And i get queue OVERRUN signal on queue before decodebin.

I try to search why this queue has overflow by reading level and I get this :

 

OVER_RUN :  bufferdecodebinvideo : Max buffer size : 100000000

OVER_RUN :  bufferdecodebinvideo : Number of bytes in buffer : 1159086

 

???

 

Why I get overrun whereas the max-size of queue is not reached ?

 

BR.

 

Frederic

 


_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: Queue Overrun

Nicolas Dufresne-5
Le mardi 10 octobre 2017 à 08:42 +0000, Duchassin Frédéric a écrit :

> And i get queue OVERRUN signal on queue before decodebin.
> I try to search why this queue has overflow by reading level and I
> get this :
>  
> OVER_RUN :  bufferdecodebinvideo : Max buffer size : 100000000
> OVER_RUN :  bufferdecodebinvideo : Number of bytes in buffer :
> 1159086
>  
> ???
>  
> Why I get overrun whereas the max-size of queue is not reached ?
Likely because you didn't disable the "max-size-time" and/or "max-size-
buffers" property. It is set to 10s and 200 buffers respectively by
default. Set these to 0 to disable.

regards,
Nicolas
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

signature.asc (201 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Queue Overrun

Nicolas Dufresne-5
In reply to this post by Duchassin Frederic
Le mardi 10 octobre 2017 à 08:42 +0000, Duchassin Frédéric a écrit :
> Hello,
>  
> I use this pipeline on Imx6 :
>  
> gst-launch-1.0  udpsrc address=239.0.0.1 port=1234 ! queue max-
> size_bytes=20000000 min-threshold-bytes=100 ! tsdemux name=d program-

Please notice your typo here, It's "max-size-bytes" with a - not a _.

> number=275 ! multiqueue name=q use-buffering=1 d. ! q.  q. ! queue !
> decodebin ! queue ! imxg2dvideosink q. ! queue ! decodebin ! queue !
> audioconvert ! volume volume=10 ! alsasink
>  
>  
> And i get queue OVERRUN signal on queue before decodebin.
> I try to search why this queue has overflow by reading level and I
> get this :
>  
> OVER_RUN :  bufferdecodebinvideo : Max buffer size : 100000000
> OVER_RUN :  bufferdecodebinvideo : Number of bytes in buffer :
> 1159086
>  
> ???
>  
> Why I get overrun whereas the max-size of queue is not reached ?
>  
> BR.
>  
> Frederic
>  
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

signature.asc (201 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

RE: Queue Overrun

Duchassin Frederic
Hello Nicolas,

You're right about tipo. It's a mistake when I copy/paste and rewrite the pipeline on this post.
In fact my pipeline is well written....

If I replace the queue element by queue2, I doesn't get anymore OVER_RUN. (like if queue element doesn't accept max-size-bytes parameter.)
Have you got an idea about why queue doesn't accept max-size-bytes ? and always gives overrun.

Frederic



-----Message d'origine-----
De : gstreamer-devel [mailto:[hidden email]] De la part de Nicolas Dufresne
Envoyé : mardi 10 octobre 2017 15:47
À : Discussion of the development of and with GStreamer
Objet : Re: Queue Overrun

Le mardi 10 octobre 2017 à 08:42 +0000, Duchassin Frédéric a écrit :
> Hello,
>  
> I use this pipeline on Imx6 :
>  
> gst-launch-1.0  udpsrc address=239.0.0.1 port=1234 ! queue max-
> size_bytes=20000000 min-threshold-bytes=100 ! tsdemux name=d program-

Please notice your typo here, It's "max-size-bytes" with a - not a _.

> number=275 ! multiqueue name=q use-buffering=1 d. ! q.  q. ! queue !
> decodebin ! queue ! imxg2dvideosink q. ! queue ! decodebin ! queue !
> audioconvert ! volume volume=10 ! alsasink
>  
>  
> And i get queue OVERRUN signal on queue before decodebin.
> I try to search why this queue has overflow by reading level and I get
> this :
>  
> OVER_RUN :  bufferdecodebinvideo : Max buffer size : 100000000
> OVER_RUN :  bufferdecodebinvideo : Number of bytes in buffer :
> 1159086
>  
> ???
>  
> Why I get overrun whereas the max-size of queue is not reached ?
>  
> BR.
>  
> Frederic
>  
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: Queue Overrun

Nicolas Dufresne-5
Le mardi 10 octobre 2017 à 17:09 +0200, Duchassin Frederic a écrit :

> Hello Nicolas,
>
> You're right about tipo. It's a mistake when I copy/paste and rewrite
> the pipeline on this post.
> In fact my pipeline is well written....
>
> If I replace the queue element by queue2, I doesn't get anymore
> OVER_RUN. (like if queue element doesn't accept max-size-bytes
> parameter.)
> Have you got an idea about why queue doesn't accept max-size-bytes ?
> and always gives overrun.
You seem to have missed my first reply:

    Likely because you didn't disable the "max-size-time" and/or "max-size-
    buffers" property. It is set to 10s and 200 buffers respectively by
    default. Set these to 0 to disable.

Queue2 default configuration is different, as it targets a different use case.

regards,
Nicolas

>
> Frederic
>
>
>
> -----Message d'origine-----
> De : gstreamer-devel [mailto:[hidden email]
> p.org] De la part de Nicolas Dufresne
> Envoyé : mardi 10 octobre 2017 15:47
> À : Discussion of the development of and with GStreamer
> Objet : Re: Queue Overrun
>
> Le mardi 10 octobre 2017 à 08:42 +0000, Duchassin Frédéric a écrit :
> > Hello,
> >  
> > I use this pipeline on Imx6 :
> >  
> > gst-launch-1.0  udpsrc address=239.0.0.1 port=1234 ! queue max-
> > size_bytes=20000000 min-threshold-bytes=100 ! tsdemux name=d
> > program-
>
> Please notice your typo here, It's "max-size-bytes" with a - not a _.
>
> > number=275 ! multiqueue name=q use-buffering=1 d. ! q.  q. ! queue
> > !
> > decodebin ! queue ! imxg2dvideosink q. ! queue ! decodebin ! queue
> > !
> > audioconvert ! volume volume=10 ! alsasink
> >  
> >  
> > And i get queue OVERRUN signal on queue before decodebin.
> > I try to search why this queue has overflow by reading level and I
> > get
> > this :
> >  
> > OVER_RUN :  bufferdecodebinvideo : Max buffer size : 100000000
> > OVER_RUN :  bufferdecodebinvideo : Number of bytes in buffer :
> > 1159086
> >  
> > ???
> >  
> > Why I get overrun whereas the max-size of queue is not reached ?
> >  
> > BR.
> >  
> > Frederic
> >  
> > _______________________________________________
> > gstreamer-devel mailing list
> > [hidden email]
> > https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
>
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

signature.asc (201 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

RE: Queue Overrun

Duchassin Frederic
Yes I already read what you said.
The problem is that even if I set a big queue size (100 MB) I get OVERRRUN.
So I read the "current-level-bytes" parameter and this parameter is lower than max-size-bytes.
(I don't want to disable queue depth by setting max-size-bytes and max-size-time to 0 )
Do you really believe that it is a normal behavior ?


Frederic





-----Message d'origine-----
De : gstreamer-devel [mailto:[hidden email]] De la part de Nicolas Dufresne
Envoyé : mardi 10 octobre 2017 17:50
À : Discussion of the development of and with GStreamer
Objet : Re: Queue Overrun

Le mardi 10 octobre 2017 à 17:09 +0200, Duchassin Frederic a écrit :

> Hello Nicolas,
>
> You're right about tipo. It's a mistake when I copy/paste and rewrite
> the pipeline on this post.
> In fact my pipeline is well written....
>
> If I replace the queue element by queue2, I doesn't get anymore
> OVER_RUN. (like if queue element doesn't accept max-size-bytes
> parameter.)
> Have you got an idea about why queue doesn't accept max-size-bytes ?
> and always gives overrun.

You seem to have missed my first reply:

    Likely because you didn't disable the "max-size-time" and/or "max-size-
    buffers" property. It is set to 10s and 200 buffers respectively by
    default. Set these to 0 to disable.

Queue2 default configuration is different, as it targets a different use case.

regards,
Nicolas

>
> Frederic
>
>
>
> -----Message d'origine-----
> De : gstreamer-devel [mailto:[hidden email]
> p.org] De la part de Nicolas Dufresne
> Envoyé : mardi 10 octobre 2017 15:47
> À : Discussion of the development of and with GStreamer Objet : Re:
> Queue Overrun
>
> Le mardi 10 octobre 2017 à 08:42 +0000, Duchassin Frédéric a écrit :
> > Hello,
> >  
> > I use this pipeline on Imx6 :
> >  
> > gst-launch-1.0  udpsrc address=239.0.0.1 port=1234 ! queue max-
> > size_bytes=20000000 min-threshold-bytes=100 ! tsdemux name=d
> > program-
>
> Please notice your typo here, It's "max-size-bytes" with a - not a _.
>
> > number=275 ! multiqueue name=q use-buffering=1 d. ! q.  q. ! queue !
> > decodebin ! queue ! imxg2dvideosink q. ! queue ! decodebin ! queue !
> > audioconvert ! volume volume=10 ! alsasink
> >  
> >  
> > And i get queue OVERRUN signal on queue before decodebin.
> > I try to search why this queue has overflow by reading level and I
> > get this :
> >  
> > OVER_RUN :  bufferdecodebinvideo : Max buffer size : 100000000
> > OVER_RUN :  bufferdecodebinvideo : Number of bytes in buffer :
> > 1159086
> >  
> > ???
> >  
> > Why I get overrun whereas the max-size of queue is not reached ?
> >  
> > BR.
> >  
> > Frederic
> >  
> > _______________________________________________
> > gstreamer-devel mailing list
> > [hidden email]
> > https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
>
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: Queue Overrun

Mailing List SVR
Il 10/10/2017 18:55, Duchassin Frederic ha scritto:
> Yes I already read what you said.
> The problem is that even if I set a big queue size (100 MB) I get OVERRRUN.
> So I read the "current-level-bytes" parameter and this parameter is lower than max-size-bytes.
> (I don't want to disable queue depth by setting max-size-bytes and max-size-time to 0 )
> Do you really believe that it is a normal behavior ?

the queue overrun if at least one of the limit is reached, so if you set
only max-size-bytes, the queue can overrun because it reach max buffers
size or max time size,

if you want to set the limit only in bytes then set the other limits to 0,

Nicola

>
>
> Frederic
>
>
>
>
>
> -----Message d'origine-----
> De : gstreamer-devel [mailto:[hidden email]] De la part de Nicolas Dufresne
> Envoyé : mardi 10 octobre 2017 17:50
> À : Discussion of the development of and with GStreamer
> Objet : Re: Queue Overrun
>
> Le mardi 10 octobre 2017 à 17:09 +0200, Duchassin Frederic a écrit :
>> Hello Nicolas,
>>
>> You're right about tipo. It's a mistake when I copy/paste and rewrite
>> the pipeline on this post.
>> In fact my pipeline is well written....
>>
>> If I replace the queue element by queue2, I doesn't get anymore
>> OVER_RUN. (like if queue element doesn't accept max-size-bytes
>> parameter.)
>> Have you got an idea about why queue doesn't accept max-size-bytes ?
>> and always gives overrun.
> You seem to have missed my first reply:
>
>      Likely because you didn't disable the "max-size-time" and/or "max-size-
>      buffers" property. It is set to 10s and 200 buffers respectively by
>      default. Set these to 0 to disable.
>
> Queue2 default configuration is different, as it targets a different use case.
>
> regards,
> Nicolas
>
>> Frederic
>>
>>
>>
>> -----Message d'origine-----
>> De : gstreamer-devel [mailto:[hidden email]
>> p.org] De la part de Nicolas Dufresne
>> Envoyé : mardi 10 octobre 2017 15:47
>> À : Discussion of the development of and with GStreamer Objet : Re:
>> Queue Overrun
>>
>> Le mardi 10 octobre 2017 à 08:42 +0000, Duchassin Frédéric a écrit :
>>> Hello,
>>>  
>>> I use this pipeline on Imx6 :
>>>  
>>> gst-launch-1.0  udpsrc address=239.0.0.1 port=1234 ! queue max-
>>> size_bytes=20000000 min-threshold-bytes=100 ! tsdemux name=d
>>> program-
>> Please notice your typo here, It's "max-size-bytes" with a - not a _.
>>
>>> number=275 ! multiqueue name=q use-buffering=1 d. ! q.  q. ! queue !
>>> decodebin ! queue ! imxg2dvideosink q. ! queue ! decodebin ! queue !
>>> audioconvert ! volume volume=10 ! alsasink
>>>  
>>>  
>>> And i get queue OVERRUN signal on queue before decodebin.
>>> I try to search why this queue has overflow by reading level and I
>>> get this :
>>>  
>>> OVER_RUN :  bufferdecodebinvideo : Max buffer size : 100000000
>>> OVER_RUN :  bufferdecodebinvideo : Number of bytes in buffer :
>>> 1159086
>>>  
>>> ???
>>>  
>>> Why I get overrun whereas the max-size of queue is not reached ?
>>>  
>>> BR.
>>>  
>>> Frederic
>>>  
>>> _______________________________________________
>>> gstreamer-devel mailing list
>>> [hidden email]
>>> https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
>> _______________________________________________
>> gstreamer-devel mailing list
>> [hidden email]
>> https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: Queue Overrun

Nicolas Dufresne-5
In reply to this post by Duchassin Frederic
Le mardi 10 octobre 2017 à 18:55 +0200, Duchassin Frederic a écrit :
> Yes I already read what you said.
> The problem is that even if I set a big queue size (100 MB) I get OVERRRUN.
> So I read the "current-level-bytes" parameter and this parameter is lower than max-size-bytes.
> (I don't want to disable queue depth by setting max-size-bytes and max-size-time to 0 )
> Do you really believe that it is a normal behavior ?

It is normal behaviour to overrun when max-size-time, or max-size-
buffers is reached even if that's much smaller then max-size-bytes. Set
them all to 0 EXCEPT the metric you want to support, this will fix your
issues.

regards,
Nicolas
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

signature.asc (201 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

RE: Queue Overrun

Duchassin Frederic
Ok i understand now.
Many many many thanks for the explanation.
It's great.

BR

Frederic


-----Message d'origine-----
De : gstreamer-devel [mailto:[hidden email]] De la part de Nicolas Dufresne
Envoyé : mardi 10 octobre 2017 19:37
À : Discussion of the development of and with GStreamer
Objet : Re: Queue Overrun

Le mardi 10 octobre 2017 à 18:55 +0200, Duchassin Frederic a écrit :
> Yes I already read what you said.
> The problem is that even if I set a big queue size (100 MB) I get OVERRRUN.
> So I read the "current-level-bytes" parameter and this parameter is lower than max-size-bytes.
> (I don't want to disable queue depth by setting max-size-bytes and
> max-size-time to 0 ) Do you really believe that it is a normal behavior ?

It is normal behaviour to overrun when max-size-time, or max-size- buffers is reached even if that's much smaller then max-size-bytes. Set them all to 0 EXCEPT the metric you want to support, this will fix your issues.

regards,
Nicolas

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

RE: Queue Overrun

Duchassin Frederic
In reply to this post by Mailing List SVR
Many many many thanks for the explanation.
It's great.

BR

Frederic

-----Message d'origine-----
De : gstreamer-devel [mailto:[hidden email]] De la part de Mailing List SVR
Envoyé : mardi 10 octobre 2017 18:59
À : [hidden email]
Objet : Re: Queue Overrun

Il 10/10/2017 18:55, Duchassin Frederic ha scritto:
> Yes I already read what you said.
> The problem is that even if I set a big queue size (100 MB) I get OVERRRUN.
> So I read the "current-level-bytes" parameter and this parameter is lower than max-size-bytes.
> (I don't want to disable queue depth by setting max-size-bytes and
> max-size-time to 0 ) Do you really believe that it is a normal behavior ?

the queue overrun if at least one of the limit is reached, so if you set only max-size-bytes, the queue can overrun because it reach max buffers size or max time size,

if you want to set the limit only in bytes then set the other limits to 0,

Nicola

>
>
> Frederic
>
>
>
>
>
> -----Message d'origine-----
> De : gstreamer-devel
> [mailto:[hidden email]] De la part de
> Nicolas Dufresne Envoyé : mardi 10 octobre 2017 17:50 À : Discussion
> of the development of and with GStreamer Objet : Re: Queue Overrun
>
> Le mardi 10 octobre 2017 à 17:09 +0200, Duchassin Frederic a écrit :
>> Hello Nicolas,
>>
>> You're right about tipo. It's a mistake when I copy/paste and rewrite
>> the pipeline on this post.
>> In fact my pipeline is well written....
>>
>> If I replace the queue element by queue2, I doesn't get anymore
>> OVER_RUN. (like if queue element doesn't accept max-size-bytes
>> parameter.)
>> Have you got an idea about why queue doesn't accept max-size-bytes ?
>> and always gives overrun.
> You seem to have missed my first reply:
>
>      Likely because you didn't disable the "max-size-time" and/or "max-size-
>      buffers" property. It is set to 10s and 200 buffers respectively by
>      default. Set these to 0 to disable.
>
> Queue2 default configuration is different, as it targets a different use case.
>
> regards,
> Nicolas
>
>> Frederic
>>
>>
>>
>> -----Message d'origine-----
>> De : gstreamer-devel [mailto:[hidden email]
>> p.org] De la part de Nicolas Dufresne Envoyé : mardi 10 octobre 2017
>> 15:47 À : Discussion of the development of and with GStreamer Objet :
>> Re:
>> Queue Overrun
>>
>> Le mardi 10 octobre 2017 à 08:42 +0000, Duchassin Frédéric a écrit :
>>> Hello,
>>>  
>>> I use this pipeline on Imx6 :
>>>  
>>> gst-launch-1.0  udpsrc address=239.0.0.1 port=1234 ! queue max-
>>> size_bytes=20000000 min-threshold-bytes=100 ! tsdemux name=d
>>> program-
>> Please notice your typo here, It's "max-size-bytes" with a - not a _.
>>
>>> number=275 ! multiqueue name=q use-buffering=1 d. ! q.  q. ! queue !
>>> decodebin ! queue ! imxg2dvideosink q. ! queue ! decodebin ! queue !
>>> audioconvert ! volume volume=10 ! alsasink
>>>  
>>>  
>>> And i get queue OVERRUN signal on queue before decodebin.
>>> I try to search why this queue has overflow by reading level and I
>>> get this :
>>>  
>>> OVER_RUN :  bufferdecodebinvideo : Max buffer size : 100000000
>>> OVER_RUN :  bufferdecodebinvideo : Number of bytes in buffer :
>>> 1159086
>>>  
>>> ???
>>>  
>>> Why I get overrun whereas the max-size of queue is not reached ?
>>>  
>>> BR.
>>>  
>>> Frederic
>>>  
>>> _______________________________________________
>>> gstreamer-devel mailing list
>>> [hidden email]
>>> https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
>> _______________________________________________
>> gstreamer-devel mailing list
>> [hidden email]
>> https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel