GStreamer-devel

gst-plugins-gl, OpenGL and stuff

Classic

List

Threaded

4 messages Options

Richard Spindler

gst-plugins-gl, OpenGL and stuff

Hi,

I had a couple of thoughts/questions/ideas that I would like to share, feel free
to add your thoughts, doubts etc.

What I would like to do:
Drafting and eventually implementing an API for abstracting image
processing/colorspace conversion/video display in OpenGL in a reusable fashion,
framework and application independent, in the spirit of liboil or ffmpeg.

My Background:
I am hacking the "Open Movie Editor", it does simple OpenGL based compositing,
but it does not use gstreamer.

What I am interested in:

Hardware independence:
Currently working with OpenGL and Video is a mess, every Driver and Hardware has
different Features and Capabilities. There is powerful hardware available that
should be exploited. There is Mesa that has a software implementation as
fallback, but there are still gaps and circumstances under which certain
OpenGL extensions are simply not available. Somehow this needs to be worked
around.

Reusability:
Do the [ground/grunt]-work once, and enable a wide range of
applications/frameworks to reuse that work. I hope this would be in the interest
of all involved parties?

Relevant/Interesting Links:
http://www.mdk.org.pl/2007/11/17/gl-colorspace-conversions
http://macslow.thepimp.net/?p=123
http://en.wikipedia.org/wiki/Quartz_Composer

I would be interested to form some kind of Linux+Video+OpenGL working group,
with the goal of tackling on the above Problems.

So, what do you think? Interested to join that effort?

Cheers,
and have fun,
-Richard

-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

KwangYul Seo

Re: gst-plugins-gl, OpenGL and stuff

Hi,

Do you have any progress in forming a Linux+Video+OpenGL working group?

Currently I am looking for a colorspace conversion solution implemented using OpenGL. It is not hard to find one, but most solutions use high-end video card extensions and do not provide any software fallback.

I think we must build reusable software to do low level tasks such as image composition, video mixsing and colorspace conversion which are repeated over and over again in constructing various video applications.

Regards,
Kwang Yul Seo

On Tue, Jan 29, 2008 at 11:59 PM, Richard Spindler <[hidden email]> wrote:

Hi,

I had a couple of thoughts/questions/ideas that I would like to share, feel free
to add your thoughts, doubts etc.

What I would like to do:
Drafting and eventually implementing an API for abstracting image
processing/colorspace conversion/video display in OpenGL in a reusable fashion,
framework and application independent, in the spirit of liboil or ffmpeg.

My Background:
I am hacking the "Open Movie Editor", it does simple OpenGL based compositing,
but it does not use gstreamer.

What I am interested in:

Hardware independence:
Currently working with OpenGL and Video is a mess, every Driver and Hardware has
different Features and Capabilities. There is powerful hardware available that
should be exploited. There is Mesa that has a software implementation as
fallback, but there are still gaps and circumstances under which certain
OpenGL extensions are simply not available. Somehow this needs to be worked
around.

Reusability:
Do the [ground/grunt]-work once, and enable a wide range of
applications/frameworks to reuse that work. I hope this would be in the interest
of all involved parties?

Relevant/Interesting Links:
http://www.mdk.org.pl/2007/11/17/gl-colorspace-conversions
http://macslow.thepimp.net/?p=123
http://en.wikipedia.org/wiki/Quartz_Composer

I would be interested to form some kind of Linux+Video+OpenGL working group,
with the goal of tackling on the above Problems.

So, what do you think? Interested to join that effort?

Cheers,
and have fun,
-Richard

-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

Julien Isorce

Re: gst-plugins-gl, OpenGL and stuff

Hi,

I am not aware of this project but it could be interesting.

The plugin I am working on has 3 elements: glgraphicmaker, glvideomaker and glimagesink

A colorpsace converter can be made by connecting the glgraphicmaker to the glvideomaker:

{ YUY2, UYVY, I420, YV12 } -> glgraphicmaker ! glvideomaker -> { YUY2, UYVY, I420, YV12 }

It works fine on win32, I have to check all the possibility on linux.

Julien

2008/5/19 KwangYul Seo <[hidden email]>:

Hi,

Do you have any progress in forming a Linux+Video+OpenGL working group?

Currently I am looking for a colorspace conversion solution implemented using OpenGL. It is not hard to find one, but most solutions use high-end video card extensions and do not provide any software fallback.

I think we must build reusable software to do low level tasks such as image composition, video mixsing and colorspace conversion which are repeated over and over again in constructing various video applications.

Regards,
Kwang Yul Seo

On Tue, Jan 29, 2008 at 11:59 PM, Richard Spindler <[hidden email]> wrote:

Hi,

I had a couple of thoughts/questions/ideas that I would like to share, feel free
to add your thoughts, doubts etc.

What I would like to do:
Drafting and eventually implementing an API for abstracting image
processing/colorspace conversion/video display in OpenGL in a reusable fashion,
framework and application independent, in the spirit of liboil or ffmpeg.

My Background:
I am hacking the "Open Movie Editor", it does simple OpenGL based compositing,
but it does not use gstreamer.

What I am interested in:

Hardware independence:
Currently working with OpenGL and Video is a mess, every Driver and Hardware has
different Features and Capabilities. There is powerful hardware available that
should be exploited. There is Mesa that has a software implementation as
fallback, but there are still gaps and circumstances under which certain
OpenGL extensions are simply not available. Somehow this needs to be worked
around.

Reusability:
Do the [ground/grunt]-work once, and enable a wide range of
applications/frameworks to reuse that work. I hope this would be in the interest
of all involved parties?

Relevant/Interesting Links:
http://www.mdk.org.pl/2007/11/17/gl-colorspace-conversions
http://macslow.thepimp.net/?p=123
http://en.wikipedia.org/wiki/Quartz_Composer

I would be interested to form some kind of Linux+Video+OpenGL working group,
with the goal of tackling on the above Problems.

So, what do you think? Interested to join that effort?

Cheers,
and have fun,
-Richard

-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

Richard Spindler

Re: gst-plugins-gl, OpenGL and stuff

In reply to this post by KwangYul Seo

Hi,

2008/5/19 KwangYul Seo <[hidden email]>:
> Do you have any progress in forming a Linux+Video+OpenGL working group?

Not yet, but I was made aware of a very cool implementation of OpenGL
Color-Space Conversion at

http://yuvtools.wiki.sourceforge.net/

The code is very readable and flexible in regard to different color-formats.

Unfortunately I head some difficulties running this code on my ATI
hardware, due to issues with the handling of non-power-of-2 textures
on ATI Hardware. It works for some video sizes which happen to fit
into that limitation. I think it should work better on nvidia
hardware.

Other than that, I found that the "FreeFrame" Video Filter Plugin
Specification http://freeframe.sf.net/ specifies reusable OpenGL based
image processing algorithms. Eventually something similar should be
possible for "pluggable" colorspace conversion.

Currently I am using the "gavl" library for software colorspace
conversion, which has a rich collection of low-level convertors, and
could serve as a good fallback option for low-end opengl hardware.
This library is a sub-project from http://gmerlin.sf.net/

> Currently I am looking for a colorspace conversion solution implemented
> using OpenGL. It is not hard to find one, but most solutions use high-end
> video card extensions and do not provide any software fallback.

I've been playing around with creating some kind of Abstraction-Layer
for the code from yuvtools, such that it can be easily replaced by an
alternative implementation, but so far I am not quite satisfied with
my work, so I have not yet published anything.

> I think we must build reusable software to do low level tasks such as image
> composition, video mixsing and colorspace conversion which are repeated over
> and over again in constructing various video applications.

I totally agree, and in my opinion the most promising project in that
respect is gmerlin/gavl. I've been in close contact with its lead
developer, and I think it is really great. It is more "low-level" then
gstreamer, but for some types of applications this is actually an
advantage.

Cheers
-Richard

--
Don't contribute to the Y10K problem!

-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel