GPP + DSPs

classic Classic list List threaded Threaded
9 messages Options
Reply | Threaded
Open this post in threaded view
|

GPP + DSPs

dbourgoyne
Hi all,

I'm considering using GStreamer for an application is which GStreamer will span a GPP and multiple DSPs.  The GPP and DSPs are connected via PCI.  So GStreamer will have to proxy buffers and messages across the PCI bus.

Can you point me to documentation, info, case studies, etc. that will help me to architect this solution?

Thanks in advance.

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: GPP + DSPs

Felipe Contreras
On Wed, Sep 24, 2008 at 9:50 PM,  <[hidden email]> wrote:
> Hi all,
>
> I'm considering using GStreamer for an application is which GStreamer will span a GPP and multiple DSPs.  The GPP and DSPs are connected via PCI.  So GStreamer will have to proxy buffers and messages across the PCI bus.
>
> Can you point me to documentation, info, case studies, etc. that will help me to architect this solution?

What kind of DSP/GPP?

We can propose different ways to do it at GStreamer level, but
ultimately you would have to communicate with the hardware, is there
code that is doing that already?

--
Felipe Contreras

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: GPP + DSPs

Duane McKinney
I am doing something similar, I created a live source to stream data out of
the DSP using existing functions.  What would be the other options for doing
this?

-----Original Message-----
From: Felipe Contreras [mailto:[hidden email]]
Sent: Thursday, September 25, 2008 5:24 AM
To: [hidden email]
Subject: Re: [gst-devel] GPP + DSPs

On Wed, Sep 24, 2008 at 9:50 PM,  <[hidden email]> wrote:
> Hi all,
>
> I'm considering using GStreamer for an application is which GStreamer will
span a GPP and multiple DSPs.  The GPP and DSPs are connected via PCI.  So
GStreamer will have to proxy buffers and messages across the PCI bus.
>
> Can you point me to documentation, info, case studies, etc. that will help
me to architect this solution?

What kind of DSP/GPP?

We can propose different ways to do it at GStreamer level, but
ultimately you would have to communicate with the hardware, is there
code that is doing that already?

--
Felipe Contreras

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great
prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel


-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: GPP + DSPs

dbourgoyne
In reply to this post by Felipe Contreras
Felipe Contreras wrote:

> On Wed, Sep 24, 2008 at 9:50 PM,  <[hidden email]> wrote:
>  
>> Hi all,
>>
>> I'm considering using GStreamer for an application is which GStreamer will span a GPP and multiple DSPs.  The GPP and DSPs are connected via PCI.  So GStreamer will have to proxy buffers and messages across the PCI bus.
>>
>> Can you point me to documentation, info, case studies, etc. that will help me to architect this solution?
>>    
>
> What kind of DSP/GPP?
>
> We can propose different ways to do it at GStreamer level, but
> ultimately you would have to communicate with the hardware, is there
> code that is doing that already?
>
>  
Assume an OMAP DSP with gst-openmax.  A GPP running Linux uses v4l as a
gstreamer src and needs to send buffers to the OMAP DSP to be encoded
which then sends buffers back to the GPP for transmission over
ethernet.  There needs to be a gstreamer proxy (marshalling) that
connects the GPP GStreamer Bin to the OMAP DSP GStreamer Bin.

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: GPP + DSPs

Felipe Contreras
On Fri, Sep 26, 2008 at 5:35 AM, David Bourgoyne
<[hidden email]> wrote:

> Felipe Contreras wrote:
>> On Wed, Sep 24, 2008 at 9:50 PM,  <[hidden email]> wrote:
>>
>>> Hi all,
>>>
>>> I'm considering using GStreamer for an application is which GStreamer will span a GPP and multiple DSPs.  The GPP and DSPs are connected via PCI.  So GStreamer will have to proxy buffers and messages across the PCI bus.
>>>
>>> Can you point me to documentation, info, case studies, etc. that will help me to architect this solution?
>>>
>>
>> What kind of DSP/GPP?
>>
>> We can propose different ways to do it at GStreamer level, but
>> ultimately you would have to communicate with the hardware, is there
>> code that is doing that already?
>>
>>
> Assume an OMAP DSP with gst-openmax.  A GPP running Linux uses v4l as a
> gstreamer src and needs to send buffers to the OMAP DSP to be encoded
> which then sends buffers back to the GPP for transmission over
> ethernet.  There needs to be a gstreamer proxy (marshalling) that
> connects the GPP GStreamer Bin to the OMAP DSP GStreamer Bin.

Well, that's the answer isn't it?

gst-openmax is a good example of how to communicate with an
asynchronous subsystem (dsp), in this case through the OpenMAX IL API.

--
Felipe Contreras

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: GPP + DSPs

dbourgoyne
Felipe Contreras wrote:

> On Fri, Sep 26, 2008 at 5:35 AM, David Bourgoyne
> <[hidden email]> wrote:
>  
>> Felipe Contreras wrote:
>>    
>>> On Wed, Sep 24, 2008 at 9:50 PM,  <[hidden email]> wrote:
>>>
>>>      
>>>> Hi all,
>>>>
>>>> I'm considering using GStreamer for an application is which GStreamer will span a GPP and multiple DSPs.  The GPP and DSPs are connected via PCI.  So GStreamer will have to proxy buffers and messages across the PCI bus.
>>>>
>>>> Can you point me to documentation, info, case studies, etc. that will help me to architect this solution?
>>>>
>>>>        
>>> What kind of DSP/GPP?
>>>
>>> We can propose different ways to do it at GStreamer level, but
>>> ultimately you would have to communicate with the hardware, is there
>>> code that is doing that already?
>>>
>>>
>>>      
>> Assume an OMAP DSP with gst-openmax.  A GPP running Linux uses v4l as a
>> gstreamer src and needs to send buffers to the OMAP DSP to be encoded
>> which then sends buffers back to the GPP for transmission over
>> ethernet.  There needs to be a gstreamer proxy (marshalling) that
>> connects the GPP GStreamer Bin to the OMAP DSP GStreamer Bin.
>>    
>
> Well, that's the answer isn't it?
>
> gst-openmax is a good example of how to communicate with an
> asynchronous subsystem (dsp), in this case through the OpenMAX IL API.
>
>  
Maybe you could elaborate.  Let's take the case of the OMAP.    I have a
main GStreamer application running on a GPP.   On the OMAP device I have
gst-openmax running on the ARM and the actual codec running on the DSP
abstracted by OpenMax.

My question is how do I connect the GStreamer pipeline on the GPP to the
GStreamer pipeline on the ARM seamlessly.  Control and bitstreams will
have to be transfered over PCI, and video perphaps over PCI or Video ports.

Has there been thought in the GStreamer community how to bridge this
heterogeneous design, or is this something I have to invent.

Thanks

David

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: GPP + DSPs

Felipe Contreras
On Sun, Oct 5, 2008 at 7:27 PM, David Bourgoyne
<[hidden email]> wrote:

> Felipe Contreras wrote:
>> On Fri, Sep 26, 2008 at 5:35 AM, David Bourgoyne
>> <[hidden email]> wrote:
>>
>>> Felipe Contreras wrote:
>>>
>>>> On Wed, Sep 24, 2008 at 9:50 PM,  <[hidden email]> wrote:
>>>>
>>>>
>>>>> Hi all,
>>>>>
>>>>> I'm considering using GStreamer for an application is which GStreamer will span a GPP and multiple DSPs.  The GPP and DSPs are connected via PCI.  So GStreamer will have to proxy buffers and messages across the PCI bus.
>>>>>
>>>>> Can you point me to documentation, info, case studies, etc. that will help me to architect this solution?
>>>>>
>>>>>
>>>> What kind of DSP/GPP?
>>>>
>>>> We can propose different ways to do it at GStreamer level, but
>>>> ultimately you would have to communicate with the hardware, is there
>>>> code that is doing that already?
>>>>
>>>>
>>>>
>>> Assume an OMAP DSP with gst-openmax.  A GPP running Linux uses v4l as a
>>> gstreamer src and needs to send buffers to the OMAP DSP to be encoded
>>> which then sends buffers back to the GPP for transmission over
>>> ethernet.  There needs to be a gstreamer proxy (marshalling) that
>>> connects the GPP GStreamer Bin to the OMAP DSP GStreamer Bin.
>>>
>>
>> Well, that's the answer isn't it?
>>
>> gst-openmax is a good example of how to communicate with an
>> asynchronous subsystem (dsp), in this case through the OpenMAX IL API.
>>
>>
> Maybe you could elaborate.  Let's take the case of the OMAP.    I have a
> main GStreamer application running on a GPP.   On the OMAP device I have
> gst-openmax running on the ARM and the actual codec running on the DSP
> abstracted by OpenMax.
>
> My question is how do I connect the GStreamer pipeline on the GPP to the
> GStreamer pipeline on the ARM seamlessly.  Control and bitstreams will
> have to be transfered over PCI, and video perphaps over PCI or Video ports.
>
> Has there been thought in the GStreamer community how to bridge this
> heterogeneous design, or is this something I have to invent.

This is a little bit confusing. ARM is a GPP, maybe by GPP you meant
an x86 machine? If that's the case then you want to connect an ARM
processor to an x86 one?

--
Felipe Contreras

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: GPP + DSPs

dbourgoyne
Felipe Contreras wrote:

> On Sun, Oct 5, 2008 at 7:27 PM, David Bourgoyne
> <[hidden email]> wrote:
>  
>> Felipe Contreras wrote:
>>    
>>> On Fri, Sep 26, 2008 at 5:35 AM, David Bourgoyne
>>> <[hidden email]> wrote:
>>>
>>>      
>>>> Felipe Contreras wrote:
>>>>
>>>>        
>>>>> On Wed, Sep 24, 2008 at 9:50 PM,  <[hidden email]> wrote:
>>>>>
>>>>>
>>>>>          
>>>>>> Hi all,
>>>>>>
>>>>>> I'm considering using GStreamer for an application is which GStreamer will span a GPP and multiple DSPs.  The GPP and DSPs are connected via PCI.  So GStreamer will have to proxy buffers and messages across the PCI bus.
>>>>>>
>>>>>> Can you point me to documentation, info, case studies, etc. that will help me to architect this solution?
>>>>>>
>>>>>>
>>>>>>            
>>>>> What kind of DSP/GPP?
>>>>>
>>>>> We can propose different ways to do it at GStreamer level, but
>>>>> ultimately you would have to communicate with the hardware, is there
>>>>> code that is doing that already?
>>>>>
>>>>>
>>>>>
>>>>>          
>>>> Assume an OMAP DSP with gst-openmax.  A GPP running Linux uses v4l as a
>>>> gstreamer src and needs to send buffers to the OMAP DSP to be encoded
>>>> which then sends buffers back to the GPP for transmission over
>>>> ethernet.  There needs to be a gstreamer proxy (marshalling) that
>>>> connects the GPP GStreamer Bin to the OMAP DSP GStreamer Bin.
>>>>
>>>>        
>>> Well, that's the answer isn't it?
>>>
>>> gst-openmax is a good example of how to communicate with an
>>> asynchronous subsystem (dsp), in this case through the OpenMAX IL API.
>>>
>>>
>>>      
>> Maybe you could elaborate.  Let's take the case of the OMAP.    I have a
>> main GStreamer application running on a GPP.   On the OMAP device I have
>> gst-openmax running on the ARM and the actual codec running on the DSP
>> abstracted by OpenMax.
>>
>> My question is how do I connect the GStreamer pipeline on the GPP to the
>> GStreamer pipeline on the ARM seamlessly.  Control and bitstreams will
>> have to be transfered over PCI, and video perphaps over PCI or Video ports.
>>
>> Has there been thought in the GStreamer community how to bridge this
>> heterogeneous design, or is this something I have to invent.
>>    
>
> This is a little bit confusing. ARM is a GPP, maybe by GPP you meant
> an x86 machine? If that's the case then you want to connect an ARM
> processor to an x86 one?
>
>  
Yes, think of it as a Master x86 GPP with several OMAP (ARM+DSP) devices
all connected via PCI.  The v4l source may be on the x86 and an encoder
on the OMAP device.  I have to create a GStreamer pipeline on the x86
and hook it to a OMAP pipeline and then back to an x86 pipeline to send
the compressed bitstream over ethernet.


David

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: GPP + DSPs

Felipe Contreras
On Mon, Oct 6, 2008 at 2:02 AM, David Bourgoyne
<[hidden email]> wrote:
> Yes, think of it as a Master x86 GPP with several OMAP (ARM+DSP) devices
> all connected via PCI.  The v4l source may be on the x86 and an encoder
> on the OMAP device.  I have to create a GStreamer pipeline on the x86
> and hook it to a OMAP pipeline and then back to an x86 pipeline to send
> the compressed bitstream over ethernet.

That sound rather complicated.

I don't know enough about that kind of setup but my feeling is that
it's best to implement some kind of server on the ARM side that uses
openmax to process the data and send it back. On the x86 side you have
a GStreamer element that communicates to that ARM server. Personally I
would do it with gst-openmax+openmax because I think it's easier to
develop the openmax component, but other people might disagree.

--
Felipe Contreras

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel