[GSoC] Multimedia correction plugins

[Pavel Kostyuchenko]

Sorry for such a big delay, I managed to be not subscribed to this ML.


I found that in GStreamer there's almost no ability to correct your
video/audio either in realtime (e.g. webcam) or non-realtime (e.g.
while editing movies in PiTiVi). There some external tools that
provide such functionality for audio (e.g. Audacity) and video (e.g.
filters in MPlayer, Kino or VirtualDub). But in the case of realtime
processing they are useless.
I think it's a good idea to find existing filters and integrate them
into GStreamer so any GStreamer-based program could use it.
Some words about me. As you may already know, I'm a student and that's
my second SoC. I'm not very familiar with GStreamer and I've never
written a plugin for it, but in the past I wrote some little programs
using GStreamer (e.g. the last one is for taking shots periodically on
my N810).
So, I'd like to hear some criticism of the proposal and my
participation in it. Or is it perfect or do you want to hear something
more from me?

Thanks
--
Pavel Kostyuchenko

------------------------------------------------------------------------------
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

[Donny Viszneki]

On Sat, Mar 28, 2009 at 3:16 AM, Pavel Kostyuchenko <[hidden email]> wrote:
> I found that in GStreamer there's almost no ability to correct your
> video/audio either in realtime (e.g. webcam) or non-realtime (e.g.
> while editing movies in PiTiVi). There some external tools that
> provide such functionality for audio (e.g. Audacity) and video (e.g.
> filters in MPlayer, Kino or VirtualDub). But in the case of realtime
> processing they are useless.

What do you mean by "correct?" Are you looking for some specific media
processing filters that fall under the category of "correcting"
multimedia?

> I think it's a good idea to find existing filters and integrate them
> into GStreamer so any GStreamer-based program could use it.

A wonderful idea!

> So, I'd like to hear some criticism of the proposal and my
> participation in it. Or is it perfect or do you want to hear something
> more from me?

Well it seems like you haven't done any research. Have you begun
selecting plugins to port to GStreamer? Do you have a list of what
plugins that are missing that GStreamer should have?

--
http://codebad.com/

------------------------------------------------------------------------------
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

[Edward Hervey]

On Sat, 2009-03-28 at 09:16 +0200, Pavel Kostyuchenko wrote:

> Sorry for such a big delay, I managed to be not subscribed to this ML.
>
>
> I found that in GStreamer there's almost no ability to correct your
> video/audio either in realtime (e.g. webcam) or non-realtime (e.g.
> while editing movies in PiTiVi). There some external tools that
> provide such functionality for audio (e.g. Audacity) and video (e.g.
> filters in MPlayer, Kino or VirtualDub). But in the case of realtime
> processing they are useless.
> I think it's a good idea to find existing filters and integrate them
> into GStreamer so any GStreamer-based program could use it.

   That would be an excellent goal indeed.

   But in order to make your proposal realistic, I would suggest giving
specific examples of 'correction' filters you intend to use/port.

> Some words about me. As you may already know, I'm a student and that's
> my second SoC. I'm not very familiar with GStreamer and I've never
> written a plugin for it, but in the past I wrote some little programs
> using GStreamer (e.g. the last one is for taking shots periodically on
> my N810).

   Having used part of the GStreamer API (on the application side) means
you're at least a little bit familiar, but this is going to require a
substantial amount of work to get to something functional.
   Therefore be very specific in your proposal about your
availabilities, deliverables, etc...

> So, I'd like to hear some criticism of the proposal and my
> participation in it. Or is it perfect or do you want to hear something
> more from me?

  The clock is ticking, less than a week left. You should start writing
your proposal on the soc website right now, so that mentors can comment
and give you feedback before the deadline,

  Best luck,

     Edward

>
> Thanks
> --
> Pavel Kostyuchenko
>
> ------------------------------------------------------------------------------
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

------------------------------------------------------------------------------
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

[Pavel Kostyuchenko]

On 3/28/09, Donny Viszneki <[hidden email]> wrote:
> Well it seems like you haven't done any research. Have you begun
>  selecting plugins to port to GStreamer? Do you have a list of what
>  plugins that are missing that GStreamer should have?


I found at least removing noise from video (VirtualDub filter) and
audio (Audacity), a lot of players have color/contrast/brightness
correction (I haven't seen this functionality in any GStreamer
application). Mentioned movement compensation seems to be interesting
idea but I didn't look deeply into it and its existing
implementations. Yes, I haven't done much researches, thanks for
pointing me on this defect. Well, I have some time to fix that.

--
Pavel

------------------------------------------------------------------------------
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

[Dan Taylor-6]

Pavel Kostyuchenko wrote:

> On 3/28/09, Donny Viszneki <[hidden email]> wrote:
>  
>> Well it seems like you haven't done any research. Have you begun
>>  selecting plugins to port to GStreamer? Do you have a list of what
>>  plugins that are missing that GStreamer should have?
>>    
>
>
> I found at least removing noise from video (VirtualDub filter) and
> audio (Audacity), a lot of players have color/contrast/brightness
> correction (I haven't seen this functionality in any GStreamer
> application). Mentioned movement compensation seems to be interesting
> idea but I didn't look deeply into it and its existing
> implementations. Yes, I haven't done much researches, thanks for
> pointing me on this defect. Well, I have some time to fix that.
>
>  

Color (Hue), contrast, saturation, and brightness are properties of
xvimagesink, and,
if the underlying X hardware driver supports it, has motion compensation.

gst-inspect-0.10 xvimagesink


------------------------------------------------------------------------------
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

[Stefan Sauer]

Pavel Kostyuchenko schrieb:

> On 3/28/09, Donny Viszneki <[hidden email]> wrote:
>> Well it seems like you haven't done any research. Have you begun
>>  selecting plugins to port to GStreamer? Do you have a list of what
>>  plugins that are missing that GStreamer should have?
>
>
> I found at least removing noise from video (VirtualDub filter) and
> audio (Audacity), a lot of players have color/contrast/brightness
> correction (I haven't seen this functionality in any GStreamer
> application). Mentioned movement compensation seems to be interesting
> idea but I didn't look deeply into it and its existing
> implementations. Yes, I haven't done much researches, thanks for
> pointing me on this defect. Well, I have some time to fix that.
>

There is the videobalance element for ajusting color, there is als a gama
element. Then there is effecttv (where we could indded bind more of its
effects). smpte for wipes, videomixer ...
Also there a several native audio effects plus more externeal like bpm
detection. For audio we can use ladspa plugins and buzz-machines as well (lv2 is
another soc proposal).

Despite that its not looking that bad, pelase go ahead, research and write a
proposal.

Stefan

------------------------------------------------------------------------------
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel