three cameras merged to one display

classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

three cameras merged to one display

Bert Douglas
Hi All,

I am new to gstreamer, but not new to image processing.
I seek advice on the best way to merge video streams in gstreamer.

At least I am hoping for some indication that my goal is not doomed to failure.

There are three cameras, with wide angle lenses, on a post, covering entire 360 degree field of view.
The goal is to combine video from three cameras, transform and project it so that it shows in a single window as a unified picture.

The question is not how to do the image processing.  I can manage that.  The question is how best to work with gstreamer.

The first obvious way (at least to me) is to write a new plugin that has three sink-pads and one source-pad.
But I can't find any examples to follow.  And the docs on base transform indicate that it can't handle this situation.

You experts probably know another way to do this.
Maybe there is already a plugin that can help with this, but I just don't have enough imagination to see it.

Is it possible to connect multiple source-pads to a single sink-pad?

Thanks much for your patience with a newcomer.

--Bert Douglas

------------------------------------------------------------------------------
This SF.net email is sponsored by

Make an app they can't live without
Enter the BlackBerry Developer Challenge
http://p.sf.net/sfu/RIM-dev2dev 
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: three cameras merged to one display

Martin Bisson
Look into the source of the videomixer plugin.  It takes multiple video
streams and merges them into one.  It should be a good starting point.

Martin


Bert Douglas wrote:

> Hi All,
>
> I am new to gstreamer, but not new to image processing.
> I seek advice on the best way to merge video streams in gstreamer.
>
> At least I am hoping for some indication that my goal is not doomed to
> failure.
>
> There are three cameras, with wide angle lenses, on a post, covering
> entire 360 degree field of view.
> The goal is to combine video from three cameras, transform and project
> it so that it shows in a single window as a unified picture.
>
> The question is not how to do the image processing.  I can manage
> that.  The question is how best to work with gstreamer.
>
> The first obvious way (at least to me) is to write a new plugin that
> has three sink-pads and one source-pad.
> But I can't find any examples to follow.  And the docs on base
> transform indicate that it can't handle this situation.
>
> You experts probably know another way to do this.
> Maybe there is already a plugin that can help with this, but I just
> don't have enough imagination to see it.
>
> Is it possible to connect multiple source-pads to a single sink-pad?
>
> Thanks much for your patience with a newcomer.
>
> --Bert Douglas
> ------------------------------------------------------------------------
>
> ------------------------------------------------------------------------------
> This SF.net email is sponsored by
>
> Make an app they can't live without
> Enter the BlackBerry Developer Challenge
> http://p.sf.net/sfu/RIM-dev2dev 
> ------------------------------------------------------------------------
>
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
>  


------------------------------------------------------------------------------
This SF.net email is sponsored by

Make an app they can't live without
Enter the BlackBerry Developer Challenge
http://p.sf.net/sfu/RIM-dev2dev 
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: three cameras merged to one display

Bert Douglas
Hi Martin,

Thanks much.  Videomixer looks very useful.  I can't believe I didn't see it before.

Next question:

Is there a plugin to do general image warping using a coordinate map lookup table?

Thanks,
Bert Douglas

On Sun, Aug 15, 2010 at 9:11 PM, Martin Bisson <[hidden email]> wrote:
Look into the source of the videomixer plugin.  It takes multiple video
streams and merges them into one.  It should be a good starting point.

Martin


Bert Douglas wrote:
> Hi All,
>
> I am new to gstreamer, but not new to image processing.
> I seek advice on the best way to merge video streams in gstreamer.
>
> At least I am hoping for some indication that my goal is not doomed to
> failure.
>
> There are three cameras, with wide angle lenses, on a post, covering
> entire 360 degree field of view.
> The goal is to combine video from three cameras, transform and project
> it so that it shows in a single window as a unified picture.
>
> The question is not how to do the image processing.  I can manage
> that.  The question is how best to work with gstreamer.
>
> The first obvious way (at least to me) is to write a new plugin that
> has three sink-pads and one source-pad.
> But I can't find any examples to follow.  And the docs on base
> transform indicate that it can't handle this situation.
>
> You experts probably know another way to do this.
> Maybe there is already a plugin that can help with this, but I just
> don't have enough imagination to see it.
>
> Is it possible to connect multiple source-pads to a single sink-pad?
>
> Thanks much for your patience with a newcomer.
>
> --Bert Douglas
> ------------------------------------------------------------------------
>
> ------------------------------------------------------------------------------
> This SF.net email is sponsored by
>
> Make an app they can't live without
> Enter the BlackBerry Developer Challenge
> http://p.sf.net/sfu/RIM-dev2dev
> ------------------------------------------------------------------------
>
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
>


------------------------------------------------------------------------------
This SF.net email is sponsored by

Make an app they can't live without
Enter the BlackBerry Developer Challenge
http://p.sf.net/sfu/RIM-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel


------------------------------------------------------------------------------
This SF.net email is sponsored by

Make an app they can't live without
Enter the BlackBerry Developer Challenge
http://p.sf.net/sfu/RIM-dev2dev 
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: three cameras merged to one display

Sandeep Prakash
Hi,

Check this doc:
http://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-good-plugins/html/gst-plugins-good-plugins-videomixer.html

They have used videomixer and videobox. Both might be useful in merging video streams.

Regards,
Sandeep Prakash
http://sandeepprakash.homeip.net
Reply | Threaded
Open this post in threaded view
|

Re: three cameras merged to one display

Bert Douglas
Thanks much.
Bert Douglas

On Mon, Aug 16, 2010 at 12:21 AM, Sandeep Prakash <[hidden email]> wrote:

Hi,

Check this doc:
http://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-good-plugins/html/gst-plugins-good-plugins-videomixer.html

They have used videomixer and videobox. Both might be useful in merging
video streams.

Regards,
Sandeep Prakash
http://sandeepprakash.homeip.net
--
View this message in context: http://gstreamer-devel.966125.n4.nabble.com/three-cameras-merged-to-one-display-tp2326335p2326402.html
Sent from the GStreamer-devel mailing list archive at Nabble.com.

------------------------------------------------------------------------------
This SF.net email is sponsored by

Make an app they can't live without
Enter the BlackBerry Developer Challenge
http://p.sf.net/sfu/RIM-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel


------------------------------------------------------------------------------
This SF.net email is sponsored by

Make an app they can't live without
Enter the BlackBerry Developer Challenge
http://p.sf.net/sfu/RIM-dev2dev 
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: three cameras merged to one display

Andrey Nechypurenko-2
In reply to this post by Bert Douglas
Hi,

> Thanks much.  Videomixer looks very useful.  I can't believe I didn't see it
> before.

You can also take a look at this:
http://wiki.oz9aec.net/index.php/Gstreamer_Cheat_Sheet#Video_Wall:_Live_from_Pluto
As I understand it is very close to what you are trying to achieve.

Regards,
Andrey.

>
> Next question:
>
> Is there a plugin to do general image warping using a coordinate map lookup
> table?
>
> Thanks,
> Bert Douglas
>
> On Sun, Aug 15, 2010 at 9:11 PM, Martin Bisson <[hidden email]>
> wrote:
>>
>> Look into the source of the videomixer plugin.  It takes multiple video
>> streams and merges them into one.  It should be a good starting point.
>>
>> Martin
>>
>>
>> Bert Douglas wrote:
>> > Hi All,
>> >
>> > I am new to gstreamer, but not new to image processing.
>> > I seek advice on the best way to merge video streams in gstreamer.
>> >
>> > At least I am hoping for some indication that my goal is not doomed to
>> > failure.
>> >
>> > There are three cameras, with wide angle lenses, on a post, covering
>> > entire 360 degree field of view.
>> > The goal is to combine video from three cameras, transform and project
>> > it so that it shows in a single window as a unified picture.
>> >
>> > The question is not how to do the image processing.  I can manage
>> > that.  The question is how best to work with gstreamer.
>> >
>> > The first obvious way (at least to me) is to write a new plugin that
>> > has three sink-pads and one source-pad.
>> > But I can't find any examples to follow.  And the docs on base
>> > transform indicate that it can't handle this situation.
>> >
>> > You experts probably know another way to do this.
>> > Maybe there is already a plugin that can help with this, but I just
>> > don't have enough imagination to see it.
>> >
>> > Is it possible to connect multiple source-pads to a single sink-pad?
>> >
>> > Thanks much for your patience with a newcomer.
>> >
>> > --Bert Douglas
>> > ------------------------------------------------------------------------
>> >
>> >
>> > ------------------------------------------------------------------------------
>> > This SF.net email is sponsored by
>> >
>> > Make an app they can't live without
>> > Enter the BlackBerry Developer Challenge
>> > http://p.sf.net/sfu/RIM-dev2dev
>> > ------------------------------------------------------------------------
>> >
>> > _______________________________________________
>> > gstreamer-devel mailing list
>> > [hidden email]
>> > https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
>> >
>>
>>
>>
>> ------------------------------------------------------------------------------
>> This SF.net email is sponsored by
>>
>> Make an app they can't live without
>> Enter the BlackBerry Developer Challenge
>> http://p.sf.net/sfu/RIM-dev2dev
>> _______________________________________________
>> gstreamer-devel mailing list
>> [hidden email]
>> https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
>
>
> ------------------------------------------------------------------------------
> This SF.net email is sponsored by
>
> Make an app they can't live without
> Enter the BlackBerry Developer Challenge
> http://p.sf.net/sfu/RIM-dev2dev
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
>
>

------------------------------------------------------------------------------
This SF.net email is sponsored by

Make an app they can't live without
Enter the BlackBerry Developer Challenge
http://p.sf.net/sfu/RIM-dev2dev 
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: three cameras merged to one display

Matteo Landi
On Mon, Aug 16, 2010 at 2:20 PM, Andrey Nechypurenko
<[hidden email]> wrote:
> Hi,
>
>> Thanks much.  Videomixer looks very useful.  I can't believe I didn't see it
>> before.
>
> You can also take a look at this:
> http://wiki.oz9aec.net/index.php/Gstreamer_Cheat_Sheet#Video_Wall:_Live_from_Pluto
> As I understand it is very close to what you are trying to achieve.

Very nice example!

>
> Regards,
> Andrey.
>
>>
>> Next question:
>>
>> Is there a plugin to do general image warping using a coordinate map lookup
>> table?
>>
>> Thanks,
>> Bert Douglas
>>
>> On Sun, Aug 15, 2010 at 9:11 PM, Martin Bisson <[hidden email]>
>> wrote:
>>>
>>> Look into the source of the videomixer plugin.  It takes multiple video
>>> streams and merges them into one.  It should be a good starting point.
>>>
>>> Martin
>>>
>>>
>>> Bert Douglas wrote:
>>> > Hi All,
>>> >
>>> > I am new to gstreamer, but not new to image processing.
>>> > I seek advice on the best way to merge video streams in gstreamer.
>>> >
>>> > At least I am hoping for some indication that my goal is not doomed to
>>> > failure.
>>> >
>>> > There are three cameras, with wide angle lenses, on a post, covering
>>> > entire 360 degree field of view.
>>> > The goal is to combine video from three cameras, transform and project
>>> > it so that it shows in a single window as a unified picture.
>>> >
>>> > The question is not how to do the image processing.  I can manage
>>> > that.  The question is how best to work with gstreamer.
>>> >
>>> > The first obvious way (at least to me) is to write a new plugin that
>>> > has three sink-pads and one source-pad.
>>> > But I can't find any examples to follow.  And the docs on base
>>> > transform indicate that it can't handle this situation.
>>> >
>>> > You experts probably know another way to do this.
>>> > Maybe there is already a plugin that can help with this, but I just
>>> > don't have enough imagination to see it.
>>> >
>>> > Is it possible to connect multiple source-pads to a single sink-pad?
>>> >
>>> > Thanks much for your patience with a newcomer.
>>> >
>>> > --Bert Douglas
>>> > ------------------------------------------------------------------------
>>> >
>>> >
>>> > ------------------------------------------------------------------------------
>>> > This SF.net email is sponsored by
>>> >
>>> > Make an app they can't live without
>>> > Enter the BlackBerry Developer Challenge
>>> > http://p.sf.net/sfu/RIM-dev2dev
>>> > ------------------------------------------------------------------------
>>> >
>>> > _______________________________________________
>>> > gstreamer-devel mailing list
>>> > [hidden email]
>>> > https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
>>> >
>>>
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> This SF.net email is sponsored by
>>>
>>> Make an app they can't live without
>>> Enter the BlackBerry Developer Challenge
>>> http://p.sf.net/sfu/RIM-dev2dev
>>> _______________________________________________
>>> gstreamer-devel mailing list
>>> [hidden email]
>>> https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
>>
>>
>> ------------------------------------------------------------------------------
>> This SF.net email is sponsored by
>>
>> Make an app they can't live without
>> Enter the BlackBerry Developer Challenge
>> http://p.sf.net/sfu/RIM-dev2dev
>> _______________________________________________
>> gstreamer-devel mailing list
>> [hidden email]
>> https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
>>
>>
>
> ------------------------------------------------------------------------------
> This SF.net email is sponsored by
>
> Make an app they can't live without
> Enter the BlackBerry Developer Challenge
> http://p.sf.net/sfu/RIM-dev2dev
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
>



--
Matteo Landi
http://www.matteolandi.net/

------------------------------------------------------------------------------
This SF.net email is sponsored by

Make an app they can't live without
Enter the BlackBerry Developer Challenge
http://p.sf.net/sfu/RIM-dev2dev 
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: three cameras merged to one display

Bert Douglas
In reply to this post by Andrey Nechypurenko-2
Thanks for the link.
Lots of good examples. 

--Bert Douglas

On Mon, Aug 16, 2010 at 7:20 AM, Andrey Nechypurenko <[hidden email]> wrote:
Hi,

> Thanks much.  Videomixer looks very useful.  I can't believe I didn't see it
> before.

You can also take a look at this:
http://wiki.oz9aec.net/index.php/Gstreamer_Cheat_Sheet#Video_Wall:_Live_from_Pluto
As I understand it is very close to what you are trying to achieve.

Regards,
Andrey.

>
> Next question:
>
> Is there a plugin to do general image warping using a coordinate map lookup
> table?
>
> Thanks,
> Bert Douglas
>
> On Sun, Aug 15, 2010 at 9:11 PM, Martin Bisson <[hidden email]>
> wrote:
>>
>> Look into the source of the videomixer plugin.  It takes multiple video
>> streams and merges them into one.  It should be a good starting point.
>>
>> Martin
>>
>>
>> Bert Douglas wrote:
>> > Hi All,
>> >
>> > I am new to gstreamer, but not new to image processing.
>> > I seek advice on the best way to merge video streams in gstreamer.
>> >
>> > At least I am hoping for some indication that my goal is not doomed to
>> > failure.
>> >
>> > There are three cameras, with wide angle lenses, on a post, covering
>> > entire 360 degree field of view.
>> > The goal is to combine video from three cameras, transform and project
>> > it so that it shows in a single window as a unified picture.
>> >
>> > The question is not how to do the image processing.  I can manage
>> > that.  The question is how best to work with gstreamer.
>> >
>> > The first obvious way (at least to me) is to write a new plugin that
>> > has three sink-pads and one source-pad.
>> > But I can't find any examples to follow.  And the docs on base
>> > transform indicate that it can't handle this situation.
>> >
>> > You experts probably know another way to do this.
>> > Maybe there is already a plugin that can help with this, but I just
>> > don't have enough imagination to see it.
>> >
>> > Is it possible to connect multiple source-pads to a single sink-pad?
>> >
>> > Thanks much for your patience with a newcomer.
>> >
>> > --Bert Douglas
>> > ------------------------------------------------------------------------
>> >
>> >
>> > ------------------------------------------------------------------------------
>> > This SF.net email is sponsored by
>> >
>> > Make an app they can't live without
>> > Enter the BlackBerry Developer Challenge
>> > http://p.sf.net/sfu/RIM-dev2dev
>> > ------------------------------------------------------------------------
>> >
>> > _______________________________________________
>> > gstreamer-devel mailing list
>> > [hidden email]
>> > https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
>> >
>>
>>
>>
>> ------------------------------------------------------------------------------
>> This SF.net email is sponsored by
>>
>> Make an app they can't live without
>> Enter the BlackBerry Developer Challenge
>> http://p.sf.net/sfu/RIM-dev2dev
>> _______________________________________________
>> gstreamer-devel mailing list
>> [hidden email]
>> https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
>
>
> ------------------------------------------------------------------------------
> This SF.net email is sponsored by
>
> Make an app they can't live without
> Enter the BlackBerry Developer Challenge
> http://p.sf.net/sfu/RIM-dev2dev
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
>
>

------------------------------------------------------------------------------
This SF.net email is sponsored by

Make an app they can't live without
Enter the BlackBerry Developer Challenge
http://p.sf.net/sfu/RIM-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel


------------------------------------------------------------------------------
This SF.net email is sponsored by

Make an app they can't live without
Enter the BlackBerry Developer Challenge
http://p.sf.net/sfu/RIM-dev2dev 
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel