High CPU usage in ffmpegcolorspace

[Julien Isorce]

Hi

Is it normal that this pipeline :
gst-launch-0.10 videotestsrc ! "video/x-raw-yuv, format=(fourcc)YUY2, width=720, height=576, framerate=(fraction)25/1" ! ffmpegcolorspace ! video/x-raw-rgb, bpp=32, depth=24 ! fakesink sync=1
uses 50% of the CPU on a Pentium4 2.80GHz, 2 Go RAM ?

Please someone can confirm that and say us your CPU ?

Sincerely

Julien

-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://sourceforge.net/services/buy/index.php
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

[Wim Taymans]

On Mon, 2008-06-16 at 16:17 +0200, Julien Isorce wrote:
> Hi
>
> Is it normal that this pipeline :
> gst-launch-0.10 videotestsrc ! "video/x-raw-yuv, format=(fourcc)YUY2,
> width=720, height=576, framerate=(fraction)25/1" ! ffmpegcolorspace !
> video/x-raw-rgb, bpp=32, depth=24 ! fakesink sync=1
> uses 50% of the CPU on a Pentium4 2.80GHz, 2 Go RAM ?
>
> Please someone can confirm that and say us your CPU ?

24% according to top on an Intel(R) Core(TM)2 Duo CPU T7100 @ 1.80GHz.
Which would equate to filling up half a Core. Yes, ffmpegcolorspace is
slow, patches welcome.

Wim

>
> Sincerely
>
> Julien
> -------------------------------------------------------------------------
> Check out the new SourceForge.net Marketplace.
> It's the best place to buy or sell services for
> just about anything Open Source.
> http://sourceforge.net/services/buy/index.php
> _______________________________________________ gstreamer-devel mailing list [hidden email] https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://sourceforge.net/services/buy/index.php
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

[Simon Holm Thøgersen]

man, 16 06 2008 kl. 16:17 +0200, skrev Julien Isorce:
> Hi
>
> Is it normal that this pipeline :
> gst-launch-0.10 videotestsrc ! "video/x-raw-yuv, format=(fourcc)YUY2,
> width=720, height=576, framerate=(fraction)25/1" ! ffmpegcolorspace !
> video/x-raw-rgb, bpp=32, depth=24 ! fakesink sync=1
> uses 50% of the CPU on a Pentium4 2.80GHz, 2 Go RAM ?
>
> Please someone can confirm that and say us your CPU ?

~64% on a 1.5 GHz Pentium-M.


Simon Holm Thøgersen


-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://sourceforge.net/services/buy/index.php
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

[Tim-Philipp Müller-2]

> > Is it normal that this pipeline :
> > gst-launch-0.10 videotestsrc ! "video/x-raw-yuv, format=(fourcc)YUY2,
> > width=720, height=576, framerate=(fraction)25/1" ! ffmpegcolorspace !
> > video/x-raw-rgb, bpp=32, depth=24 ! fakesink sync=1
> > uses 50% of the CPU on a Pentium4 2.80GHz, 2 Go RAM ?
> >
> > Please someone can confirm that and say us your CPU ?
>
> 24% according to top on an Intel(R) Core(TM)2 Duo CPU T7100 @ 1.80GHz.
> Which would equate to filling up half a Core. Yes, ffmpegcolorspace is
> slow, patches welcome.

FWIW, videotestsrc seems to be responsible for about half the cpu cycles
burnt in this case (also see [1]).

 Cheers
  -Tim

[1] http://bugzilla.gnome.org/show_bug.cgi?id=500152



-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://sourceforge.net/services/buy/index.php
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

[Julien Isorce]

Could someone try to replace the videotestsrc by v4l2src ? with the exact same pipeline.

(on win32, with the dshwovideosrc there is the same behaviour)

Thx.

2008/6/16 Tim Müller <[hidden email]>:

> > Is it normal that this pipeline :
> > gst-launch-0.10 videotestsrc ! "video/x-raw-yuv, format=(fourcc)YUY2,
> > width=720, height=576, framerate=(fraction)25/1" ! ffmpegcolorspace !
> > video/x-raw-rgb, bpp=32, depth=24 ! fakesink sync=1
> > uses 50% of the CPU on a Pentium4 2.80GHz, 2 Go RAM ?
> >
> > Please someone can confirm that and say us your CPU ?
>
> 24% according to top on an Intel(R) Core(TM)2 Duo CPU T7100 @ 1.80GHz.
> Which would equate to filling up half a Core. Yes, ffmpegcolorspace is
> slow, patches welcome.

FWIW, videotestsrc seems to be responsible for about half the cpu cycles
burnt in this case (also see [1]).

 Cheers
 -Tim

[1] http://bugzilla.gnome.org/show_bug.cgi?id=500152

-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://sourceforge.net/services/buy/index.php
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://sourceforge.net/services/buy/index.php
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

[Sebastian Dröge]

Am Montag, den 16.06.2008, 16:52 +0200 schrieb Wim Taymans:

> On Mon, 2008-06-16 at 16:17 +0200, Julien Isorce wrote:
> > Hi
> >
> > Is it normal that this pipeline :
> > gst-launch-0.10 videotestsrc ! "video/x-raw-yuv, format=(fourcc)YUY2,
> > width=720, height=576, framerate=(fraction)25/1" ! ffmpegcolorspace !
> > video/x-raw-rgb, bpp=32, depth=24 ! fakesink sync=1
> > uses 50% of the CPU on a Pentium4 2.80GHz, 2 Go RAM ?
> >
> > Please someone can confirm that and say us your CPU ?
>
> 24% according to top on an Intel(R) Core(TM)2 Duo CPU T7100 @ 1.80GHz.
> Which would equate to filling up half a Core. Yes, ffmpegcolorspace is
> slow, patches welcome.

It doesn't make much sense to patch ffmpegcolorspace. We should better
create a new element that takes the swscale code from ffmpeg as it is
still developed (ffmpegcolorspace's base imgconvert is deprecated in
ffmpeg).

Also there's a GSoC project for writing LGPL'd assembly optimizations
for swscale (currently the optimizations are GPL).

-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://sourceforge.net/services/buy/index.php
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

[Wim Taymans]

On Mon, 2008-06-16 at 18:16 +0200, Julien Isorce wrote:
> Could someone try to replace the videotestsrc by v4l2src ? with the
> exact same pipeline.
>
> (on win32, with the dshwovideosrc there is the same behaviour)
>

gst-launch-0.10 v4l2src ! "video/x-raw-yuv, format=(fourcc)YUY2,
width=640, height=480, framerate=(fraction)30/1" ! ffmpegcolorspace !
video/x-raw-rgb, bpp=32, depth=24 ! fakesink sync=1

Gives me around 17-18% CPU usage with top. I had to reduce the frame
size but increase the framerate to match the capabilities of my camera.

Removing ffmpegcolorspace from that pipeline brings down the CPU usage
to around 1% again.

gst-launch-0.10 v4l2src ! "video/x-raw-yuv, format=(fourcc)YUY2,
width=640, height=480, framerate=(fraction)30/1" ! xvimagesink

Is around 2-3%.

gst-launch-0.10 v4l2src ! "video/x-raw-yuv, format=(fourcc)YUY2,
width=640, height=480, framerate=(fraction)30/1" ! ffmpegcolorspace !
video/x-raw-rgb, bpp=32, depth=24 ! ximagesink

Is around 16% with top.

Wim

> Thx.
>
> 2008/6/16 Tim Müller <[hidden email]>:
>         > > Is it normal that this pipeline :
>         > > gst-launch-0.10 videotestsrc ! "video/x-raw-yuv,
>         format=(fourcc)YUY2,
>         > > width=720, height=576, framerate=(fraction)25/1" !
>         ffmpegcolorspace !
>         > > video/x-raw-rgb, bpp=32, depth=24 ! fakesink sync=1
>         > > uses 50% of the CPU on a Pentium4 2.80GHz, 2 Go RAM ?
>         > >
>         > > Please someone can confirm that and say us your CPU ?
>         >
>         > 24% according to top on an Intel(R) Core(TM)2 Duo CPU T7100
>         @ 1.80GHz.
>         > Which would equate to filling up half a Core. Yes,
>         ffmpegcolorspace is
>         > slow, patches welcome.
>        
>        
>         FWIW, videotestsrc seems to be responsible for about half the
>         cpu cycles
>         burnt in this case (also see [1]).
>        
>          Cheers
>          -Tim
>        
>         [1] http://bugzilla.gnome.org/show_bug.cgi?id=500152
>        
>        
>        
>        
>         -------------------------------------------------------------------------
>         Check out the new SourceForge.net Marketplace.
>         It's the best place to buy or sell services for
>         just about anything Open Source.
>         http://sourceforge.net/services/buy/index.php
>         _______________________________________________
>         gstreamer-devel mailing list
>         [hidden email]
>         https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
>        
>
> -------------------------------------------------------------------------
> Check out the new SourceForge.net Marketplace.
> It's the best place to buy or sell services for
> just about anything Open Source.
> http://sourceforge.net/services/buy/index.php
> _______________________________________________ gstreamer-devel mailing list [hidden email] https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://sourceforge.net/services/buy/index.php
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

[Julien Isorce]

Ok thx for the tests.I have the exact same behaviour with the dshowvideosrc,
so the "slowness" comes from  ( 100% sure :P) the ffmpegcolorspace. Itseems to be good only for size <= 320*240 (5% CPU at 150 FPS),
so for now I will just do the conversion myself for my very precise needs.

J.

2008/6/16 Wim Taymans <[hidden email]>:

On Mon, 2008-06-16 at 18:16 +0200, Julien Isorce wrote:
> Could someone try to replace the videotestsrc by v4l2src ? with the
> exact same pipeline.
>
> (on win32, with the dshwovideosrc there is the same behaviour)
>

gst-launch-0.10 v4l2src ! "video/x-raw-yuv, format=(fourcc)YUY2,
width=640, height=480, framerate=(fraction)30/1" ! ffmpegcolorspace !

video/x-raw-rgb, bpp=32, depth=24 ! fakesink sync=1

Gives me around 17-18% CPU usage with top. I had to reduce the frame
size but increase the framerate to match the capabilities of my camera.

Removing ffmpegcolorspace from that pipeline brings down the CPU usage
to around 1% again.

gst-launch-0.10 v4l2src ! "video/x-raw-yuv, format=(fourcc)YUY2,
width=640, height=480, framerate=(fraction)30/1" ! xvimagesink

Is around 2-3%.

gst-launch-0.10 v4l2src ! "video/x-raw-yuv, format=(fourcc)YUY2,
width=640, height=480, framerate=(fraction)30/1" ! ffmpegcolorspace !
video/x-raw-rgb, bpp=32, depth=24 ! ximagesink

Is around 16% with top.

Wim

> Thx.
>
> 2008/6/16 Tim Müller <[hidden email]>:
>         > > Is it normal that this pipeline :
>         > > gst-launch-0.10 videotestsrc ! "video/x-raw-yuv,
>         format=(fourcc)YUY2,
>         > > width=720, height=576, framerate=(fraction)25/1" !
>         ffmpegcolorspace !
>         > > video/x-raw-rgb, bpp=32, depth=24 ! fakesink sync=1
>         > > uses 50% of the CPU on a Pentium4 2.80GHz, 2 Go RAM ?
>         > >
>         > > Please someone can confirm that and say us your CPU ?
>         >
>         > 24% according to top on an Intel(R) Core(TM)2 Duo CPU T7100
>         @ 1.80GHz.
>         > Which would equate to filling up half a Core. Yes,
>         ffmpegcolorspace is
>         > slow, patches welcome.
>
>
>         FWIW, videotestsrc seems to be responsible for about half the
>         cpu cycles
>         burnt in this case (also see [1]).
>
>          Cheers
>          -Tim
>
>         [1] http://bugzilla.gnome.org/show_bug.cgi?id=500152
>
>
>
>
>         -------------------------------------------------------------------------
>         Check out the new SourceForge.net Marketplace.
>         It's the best place to buy or sell services for
>         just about anything Open Source.
>         http://sourceforge.net/services/buy/index.php
>         _______________________________________________
>         gstreamer-devel mailing list
>         [hidden email]
>         https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
>
>
> -------------------------------------------------------------------------
> Check out the new SourceForge.net Marketplace.
> It's the best place to buy or sell services for
> just about anything Open Source.
> http://sourceforge.net/services/buy/index.php
> _______________________________________________ gstreamer-devel mailing list [hidden email] https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://sourceforge.net/services/buy/index.php
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel