GStreamer VA-API not displaying from cameras when they are set to H264 "Baseline" profile

[Daniel Vernon]

Hello,

 

Does anyone know if it's possible to get GStreamer VA-API decoding working with H264 Baseline profile?

 

Here is the problem we have:-

 

We are using GStreamer with VA-API elements under Ubuntu 18.04.2 LTS to display H264 from a selection of IP cameras.  When the cameras are set to H264 Main Profile, GStreamer displays fine.  But when we change the cameras to H264 Baseline Profile, we get no display.

 

We have tested with three different makes of camera so far (an Axis, DynaColor and Sunell) and all with the same result.

 

This gst-launch example shows the pipeline we are using:-

 

                gst-launch-1.0 rtspsrc location=rtsp://192.168.80.217/h264 ! rtph264depay ! vaapidecodebin ! ximagesink

 

 

Note that if we replace “vaapidecodebin” with “avdec_h264” in the above, this works fine with H264 Baseline.  But we'd much rather use VA-API (to take advantage of hardware decode and thus reduce the system's CPU load).

 

By running command 'vainfo', we see that it lists H264 profiles "ConstrainedBaseline", "Main" and "High".  Does this mean that VA-API is deliberately not supporting H264 Baseline, or could it have a fault?

 

 

If anyone can help with this problem or has more information this would be much appreciated.

 

Thanks,

 

Daniel Vernon

 

 

Daniel Vernon

Development Engineer

 

 

---

Registered Office:
3 - 4 Broadfield Close Sheffield South Yorkshire S8 0XN UK	T [phone]
	F [phone]
	E [hidden email]
	W synecticsglobal.com

Would you like to keep up-to-date with the latest news and white papers from Synectics?
Subscribe to our news updates here

Connect with us

Registered in England and Wales No. 5815524

Trading as Synectic Systems Group Limited

This email is confidential and may also be legally privileged or exempt from disclosure under applicable law. It is intended solely for the use of the individual to whom it is addressed. If you are not the intended recipient, please destroy it immediately without reading the contents of the e-mail or opening attachments. Any use, dissemination, forwarding, printing or copying of this e-mail is strictly prohibited. If you have received this e-mail in error please notify the sender by e-mail, telephone or fax. Replies to this e-mail may be monitored by Synectic Systems Group Limited for operational or business reasons, within the scope of the law. Any opinions or information presented in this e-mail or any attachments that do not relate to the business of Synectic Systems Group Limited are solely those of the author and do not represent or are endorsed by Synectic Systems Group Limited. No contract or intention to create a binding contract may be construed by this e-mail or any attachments, unless specifically expressed therein. Security Warning: Internet communications are not guaranteed to be secure or virus-free. Except to the extent Synectic Systems Group Limited may not exclude its liability under law Synectic Systems Group Limited does not accept responsibility for any loss whatsoever arising from unauthorised access to, or interference with, any communications over the internet by any third party, or from the transmission of any viruses.

Please consider the environment – do you really need to print this email?

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

[David Manpearl-2]

Suggest try "qtdemux ! queue ! vaapidecocdebin" or "qtdemux ! queue ! vaapih264dec" instead of just "vaapidecodebin" an "h264parse" after the "rtph264depay" may help too. Good luck!

 - David

On Aug 27, 2019, at 12:53 AM, Daniel Vernon <[hidden email]> wrote:

Hello,

 

Does anyone know if it's possible to get GStreamer VA-API decoding working with H264 Baseline profile?

 

Here is the problem we have:-

 

We are using GStreamer with VA-API elements under Ubuntu 18.04.2 LTS to display H264 from a selection of IP cameras.  When the cameras are set to H264 Main Profile, GStreamer displays fine.  But when we change the cameras to H264 Baseline Profile, we get no display.

 

We have tested with three different makes of camera so far (an Axis, DynaColor and Sunell) and all with the same result.

 

This gst-launch example shows the pipeline we are using:-

 

                gst-launch-1.0 rtspsrc location=<a href="rtsp://192.168.80.217/h264" style="color: rgb(149, 79, 114); text-decoration: underline;" class="">rtsp://192.168.80.217/h264 ! rtph264depay ! vaapidecodebin ! ximagesink

 

 

Note that if we replace “vaapidecodebin” with “avdec_h264” in the above, this works fine with H264 Baseline.  But we'd much rather use VA-API (to take advantage of hardware decode and thus reduce the system's CPU load).

 

By running command 'vainfo', we see that it lists H264 profiles "ConstrainedBaseline", "Main" and "High".  Does this mean that VA-API is deliberately not supporting H264 Baseline, or could it have a fault?

 

 

If anyone can help with this problem or has more information this would be much appreciated.

 

Thanks,

 

Daniel Vernon

 

 

Daniel Vernon

Development Engineer

 

 

---

<synectics_GSX_600x250_2ae6dd0d-8157-4e11-b3b2-eb59c250dd27.png>

Registered Office:
3 - 4 Broadfield Close Sheffield South Yorkshire S8 0XN UK	T [phone]
	F [phone]
	E [hidden email]
	W synecticsglobal.com

Would you like to keep up-to-date with the latest news and white papers from Synectics?
Subscribe to our news updates here

Connect with us

<twitter-icon_e986cdf3-24c4-40f0-a1af-1860fff04dd4.jpg><transparent_4dbbf2ba-01fc-4d13-a518-4de9251b8fb7.gif><facebook-icon_202bb877-95b3-43f2-8a78-ae05983bb657.jpg><transparent2_f0bec857-b18c-487d-a313-402ec0657469.gif><linkedin-icon_5a41239f-b19e-45ff-a669-194751b19c12.jpg>

Registered in England and Wales No. 5815524

Trading as Synectic Systems Group Limited

This email is confidential and may also be legally privileged or exempt from disclosure under applicable law. It is intended solely for the use of the individual to whom it is addressed. If you are not the intended recipient, please destroy it immediately without reading the contents of the e-mail or opening attachments. Any use, dissemination, forwarding, printing or copying of this e-mail is strictly prohibited. If you have received this e-mail in error please notify the sender by e-mail, telephone or fax. Replies to this e-mail may be monitored by Synectic Systems Group Limited for operational or business reasons, within the scope of the law. Any opinions or information presented in this e-mail or any attachments that do not relate to the business of Synectic Systems Group Limited are solely those of the author and do not represent or are endorsed by Synectic Systems Group Limited. No contract or intention to create a binding contract may be construed by this e-mail or any attachments, unless specifically expressed therein. Security Warning: Internet communications are not guaranteed to be secure or virus-free. Except to the extent Synectic Systems Group Limited may not exclude its liability under law Synectic Systems Group Limited does not accept responsibility for any loss whatsoever arising from unauthorised access to, or interference with, any communications over the internet by any third party, or from the transmission of any viruses.

Please consider the environment – do you really need to print this email?

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

[Nicolas Dufresne-5]

Le mardi 27 août 2019 à 07:53 +0000, Daniel Vernon a écrit :
> Hello,
>  
> Does anyone know if it's possible to get GStreamer VA-API decoding working with H264 Baseline profile?

VA-API only support constrained-baseline. If your stream was
accidentally marked as baseline while being constrained, I made a patch
to allow this, but we haven't decided if we are to upstream it.

https://gitlab.freedesktop.org/gstreamer/gstreamer-vaapi/merge_requests/118

>  
> Here is the problem we have:-
>  
> We are using GStreamer with VA-API elements under Ubuntu 18.04.2 LTS to display H264 from a selection of IP cameras.  When the cameras are set to H264 Main Profile, GStreamer displays fine.  But when we change the cameras to H264 Baseline Profile, we get no display.
>  
> We have tested with three different makes of camera so far (an Axis, DynaColor and Sunell) and all with the same result.
>  
> This gst-launch example shows the pipeline we are using:-
>  
>                 gst-launch-1.0 rtspsrc location=rtsp://192.168.80.217/h264 ! rtph264depay ! vaapidecodebin ! ximagesink
>  
>  
> Note that if we replace “vaapidecodebin” with “avdec_h264” in the above, this works fine with H264 Baseline.  But we'd much rather use VA-API (to take advantage of hardware decode and thus reduce the system's CPU load).
>  
> By running command 'vainfo', we see that it lists H264 profiles "ConstrainedBaseline", "Main" and "High".  Does this mean that VA-API is deliberately not supporting H264 Baseline, or could it have a fault?
>  
>  
> If anyone can help with this problem or has more information this would be much appreciated.
>  
> Thanks,
>  
> Daniel Vernon
>  
>  
> Daniel Vernon
> Development Engineer
>  
>
>  
>
>
> Registered Office:
> 3 - 4 Broadfield Close
> Sheffield
> South Yorkshire
> S8 0XN UK
> T [phone]
> F [phone]
> E [hidden email]
> W synecticsglobal.com
> Would you like to keep up-to-date with the latest news and white papers from Synectics?
> Subscribe to our news updates here
> Connect with us
>
> Registered in England and Wales No. 5815524
>
> Trading as Synectic Systems Group Limited
>
> This email is confidential and may also be legally privileged or exempt from disclosure under applicable law. It is intended solely for the use of the individual to whom it is addressed. If you are not the intended recipient, please destroy it immediately without reading the contents of the e-mail or opening attachments. Any use, dissemination, forwarding, printing or copying of this e-mail is strictly prohibited. If you have received this e-mail in error please notify the sender by e-mail, telephone or fax. Replies to this e-mail may be monitored by Synectic Systems Group Limited for operational or business reasons, within the scope of the law. Any opinions or information presented in this e-mail or any attachments that do not relate to the business of Synectic Systems Group Limited are solely those of the author and do not represent or are endorsed by Synectic Systems Group Limited. No contract or intention to create a binding contract may be construed by this e-mail or any attachments, unless specifically expressed therein. Security Warning: Internet communications are not guaranteed to be secure or virus-free. Except to the extent Synectic Systems Group Limited may not exclude its liability under law Synectic Systems Group Limited does not accept responsibility for any loss whatsoever arising from unauthorised access to, or interference with, any communications over the internet by any third party, or from the transmission of any viruses.
>
> Please consider the environment – do you really need to print this email?
>
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

[Daniel Vernon]

Hi David,

 

Thanks for the reply.

 

Unfortunately when I try the “qtdemux” suggestions, I get “WARNING: erroneous pipeline: could not link rtph264depay0 to qtdemux0.  Please can you help?

 

• I tried “gst-launch-1.0 rtspsrc location=<a href="rtsp://192.168.80.217/h264">rtsp://192.168.80.217/h264 ! rtph264depay ! qtdemux ! queue ! vaapidecodebin ! ximagesink”
• And also “gst-launch-1.0 rtspsrc location=<a href="rtsp://192.168.80.217/h264">rtsp://192.168.80.217/h264 ! rtph264depay ! qtdemux ! queue ! vaapih264dec ! ximagesink”

 

I also tried “h264parse” after “rtph264depay”, which didn’t error, but this didn’t fix the problem either.

 

Daniel

 

 

Daniel Vernon

Development Engineer

 

 

From: gstreamer-devel <[hidden email]> On Behalf Of David Manpearl
Sent: 28 August 2019 00:01
To: Discussion of the development of and with GStreamer <[hidden email]>
Subject: Re: GStreamer VA-API not displaying from cameras when they are set to H264 "Baseline" profile

 

Suggest try "qtdemux ! queue ! vaapidecocdebin" or "qtdemux ! queue ! vaapih264dec" instead of just "vaapidecodebin" an "h264parse" after the "rtph264depay" may help too. Good luck!

 - David

On Aug 27, 2019, at 12:53 AM, Daniel Vernon <[hidden email]> wrote:

 

Hello,

 

Does anyone know if it's possible to get GStreamer VA-API decoding working with H264 Baseline profile?

 

Here is the problem we have:-

 

We are using GStreamer with VA-API elements under Ubuntu 18.04.2 LTS to display H264 from a selection of IP cameras.  When the cameras are set to H264 Main Profile, GStreamer displays fine.  But when we change the cameras to H264 Baseline Profile, we get no display.

 

We have tested with three different makes of camera so far (an Axis, DynaColor and Sunell) and all with the same result.

 

This gst-launch example shows the pipeline we are using:-

 

                gst-launch-1.0 rtspsrc location=<a href="rtsp://192.168.80.217/h264">rtsp://192.168.80.217/h264 ! rtph264depay ! vaapidecodebin ! ximagesink

 

 

Note that if we replace “vaapidecodebin” with “avdec_h264” in the above, this works fine with H264 Baseline.  But we'd much rather use VA-API (to take advantage of hardware decode and thus reduce the system's CPU load).

 

By running command 'vainfo', we see that it lists H264 profiles "ConstrainedBaseline", "Main" and "High".  Does this mean that VA-API is deliberately not supporting H264 Baseline, or could it have a fault?

 

 

If anyone can help with this problem or has more information this would be much appreciated.

 

Thanks,

 

Daniel Vernon

 

 

Daniel Vernon

Development Engineer

 

 

---

<synectics_GSX_600x250_2ae6dd0d-8157-4e11-b3b2-eb59c250dd27.png>

Registered Office:
3 - 4 Broadfield Close Sheffield South Yorkshire S8 0XN UK	T [phone]
	F [phone]
	E [hidden email]
	W synecticsglobal.com

Would you like to keep up-to-date with the latest news and white papers from Synectics?
Subscribe to our news updates here

Connect with us

<twitter-icon_e986cdf3-24c4-40f0-a1af-1860fff04dd4.jpg><transparent_4dbbf2ba-01fc-4d13-a518-4de9251b8fb7.gif><facebook-icon_202bb877-95b3-43f2-8a78-ae05983bb657.jpg><transparent2_f0bec857-b18c-487d-a313-402ec0657469.gif><linkedin-icon_5a41239f-b19e-45ff-a669-194751b19c12.jpg>

Registered in England and Wales No. 5815524

Trading as Synectic Systems Group Limited

This email is confidential and may also be legally privileged or exempt from disclosure under applicable law. It is intended solely for the use of the individual to whom it is addressed. If you are not the intended recipient, please destroy it immediately without reading the contents of the e-mail or opening attachments. Any use, dissemination, forwarding, printing or copying of this e-mail is strictly prohibited. If you have received this e-mail in error please notify the sender by e-mail, telephone or fax. Replies to this e-mail may be monitored by Synectic Systems Group Limited for operational or business reasons, within the scope of the law. Any opinions or information presented in this e-mail or any attachments that do not relate to the business of Synectic Systems Group Limited are solely those of the author and do not represent or are endorsed by Synectic Systems Group Limited. No contract or intention to create a binding contract may be construed by this e-mail or any attachments, unless specifically expressed therein. Security Warning: Internet communications are not guaranteed to be secure or virus-free. Except to the extent Synectic Systems Group Limited may not exclude its liability under law Synectic Systems Group Limited does not accept responsibility for any loss whatsoever arising from unauthorised access to, or interference with, any communications over the internet by any third party, or from the transmission of any viruses.

Please consider the environment – do you really need to print this email?

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

 

---

Registered Office:
3 - 4 Broadfield Close Sheffield South Yorkshire S8 0XN UK	T [phone]
	F [phone]
	E [hidden email]
	W synecticsglobal.com

Would you like to keep up-to-date with the latest news and white papers from Synectics?
Subscribe to our news updates here

Connect with us

Registered in England and Wales No. 5815524

Trading as Synectic Systems Group Limited

This email is confidential and may also be legally privileged or exempt from disclosure under applicable law. It is intended solely for the use of the individual to whom it is addressed. If you are not the intended recipient, please destroy it immediately without reading the contents of the e-mail or opening attachments. Any use, dissemination, forwarding, printing or copying of this e-mail is strictly prohibited. If you have received this e-mail in error please notify the sender by e-mail, telephone or fax. Replies to this e-mail may be monitored by Synectic Systems Group Limited for operational or business reasons, within the scope of the law. Any opinions or information presented in this e-mail or any attachments that do not relate to the business of Synectic Systems Group Limited are solely those of the author and do not represent or are endorsed by Synectic Systems Group Limited. No contract or intention to create a binding contract may be construed by this e-mail or any attachments, unless specifically expressed therein. Security Warning: Internet communications are not guaranteed to be secure or virus-free. Except to the extent Synectic Systems Group Limited may not exclude its liability under law Synectic Systems Group Limited does not accept responsibility for any loss whatsoever arising from unauthorised access to, or interference with, any communications over the internet by any third party, or from the transmission of any viruses.

Please consider the environment – do you really need to print this email?

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

[Daniel Vernon]

Hello Nicolas,

Thanks for your reply.  I'd really like to try your
"baseline-as-constrained" patch.  Unfortunately I've never built GStreamer
before and have no experience with Git.  Please can you tell me if it's
possible to download a build containing your patch (for Ubuntu 18.04.2 LTS)
?

Thanks very much,

Daniel Vernon



--
Sent from: http://gstreamer-devel.966125.n4.nabble.com/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

[Nicolas Dufresne-5]

Le ven. 30 août 2019 08 h 25, Daniel Vernon <[hidden email]> a écrit :

Hello Nicolas,

Thanks for your reply.  I'd really like to try your
"baseline-as-constrained" patch.  Unfortunately I've never built GStreamer
before and have no experience with Git.  Please can you tell me if it's
possible to download a build containing your patch (for Ubuntu 18.04.2 LTS)
?

I'm a Fedora user, and didn't event try and package this. Note that I'm sure you can learn enough git and meson to build with gst-build. Another option is that I can rebase and re-run the CI and the the build is available from there as tarball.

Thanks very much,

Daniel Vernon



--
Sent from: http://gstreamer-devel.966125.n4.nabble.com/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

[Daniel Vernon]

Hello Nicolas,

Thanks for your reply last week.  I've tried to build your
"baseline-as-constrained" patch under Ubuntu 18.04.2 LTS, but without
success.  I've now decided to try with Fedora instead of Ubuntu.  Please can
you tell me which version of Fedora to use?

Thanks again,

Daniel Vernon




--
Sent from: http://gstreamer-devel.966125.n4.nabble.com/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

[Nicolas Dufresne-5]

Le jeudi 05 septembre 2019 à 08:36 -0500, Daniel Vernon a écrit :
> Hello Nicolas,
>
> Thanks for your reply last week.  I've tried to build your
> "baseline-as-constrained" patch under Ubuntu 18.04.2 LTS, but without
> success.  I've now decided to try with Fedora instead of Ubuntu.  Please can
> you tell me which version of Fedora to use?

It shouldn't really matter, best is to explain how it failed for you
and then we may be able to support you. On my side, I simply use
gst-build/ and build master of GStreamer.

>
> Thanks again,
>
> Daniel Vernon
>
>
>
>
> --
> Sent from: http://gstreamer-devel.966125.n4.nabble.com/
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel