Audio Video Mixer Application

[bhavna]

Hello Guys,

Help needed on GStreamer. I don't have much info of it.
Actually my objective is to find/build the application to satisfy the
scenario as following

                        Audio-->)v4l2)
                        | |
video played===>HDMI==> | |
from Settop Rx | |
box | |=====> MIX and store the data e
                        | |
                        Video-->RGB Data


Is there any gstreamer application availble which can mix Audio data
coming from SPDIF pins of HDMI and raw RGB data from HDMI Video pins.
HDMI Rx will be supporting V4L2 framework.


--
Thanks & Regards
Bhavna Yadav
ST Microelectronics
_______________________________________________
gstreamer-devel mailing list
[hidden email]
http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

[Vineeth-2]

On Mon, May 23, 2011 at 2:21 PM, bhavna <[hidden email]> wrote:

Hello Guys,

Help needed on GStreamer. I don't have much info of it.
Actually my objective is to find/build the application to satisfy the scenario as following

                       Audio-->)v4l2)
                       |               |      
video played===>HDMI==> |               |
from Settop     Rx      |               |
box                     |               |=====> MIX and store the data e
                       |               |
                       Video-->RGB Data


Is there any gstreamer application availble which can mix Audio data coming from SPDIF pins of HDMI and raw RGB data from HDMI Video pins.
HDMI Rx will be supporting V4L2 framework.

A v4l2 video component is available in gstreamer.
As for spdif / hdmi stuff,  you will have to write the gstreamer plugins;
You can see the list available plugins here : http://gstreamer.freedesktop.org/documentation/plugins.html
 

--
Thanks & Regards
Bhavna Yadav
ST Microelectronics
_______________________________________________
gstreamer-devel mailing list
[hidden email]
http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

_______________________________________________
gstreamer-devel mailing list
[hidden email]
http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

[Stefan Sauer]

Am 31.05.2011 06:57, schrieb vineeth:

>
>
> On Mon, May 23, 2011 at 2:21 PM, bhavna <[hidden email]
> <mailto:[hidden email]>> wrote:
>
>     Hello Guys,
>
>     Help needed on GStreamer. I don't have much info of it.
>     Actually my objective is to find/build the application to satisfy the
>     scenario as following
>
>                            Audio-->)v4l2)
>                            |               |      
>     video played===>HDMI==> |               |
>     from Settop     Rx      |               |
>     box                     |               |=====> MIX and store the data e
>                            |               |
>                            Video-->RGB Data
>
>
>     Is there any gstreamer application availble which can mix Audio data coming
>     from SPDIF pins of HDMI and raw RGB data from HDMI Video pins.
>     HDMI Rx will be supporting V4L2 framework.
>
>
> A v4l2 video component is available in gstreamer.
> As for spdif / hdmi stuff,  you will have to write the gstreamer plugins;
> You can see the list available plugins here :
> http://gstreamer.freedesktop.org/documentation/plugins.html

alsasrc can record from spdif and as Bhavna wrote v4l2src will support hdmi capture.

Bhana, you will need to write a small application (using python if you want). It
will be something like:
alsasrc ! audio-encoder ! muxer name=m ! filesink v4l2src ! video-encoder ! m.

You should consider encodebin as then in becomes:
alsasrc ! encodebin name=e ! filesink v4l2src ! e.

Stefan

>  
>
>
>
>     --
>     Thanks & Regards
>     Bhavna Yadav
>     ST Microelectronics
>     _______________________________________________
>     gstreamer-devel mailing list
>     [hidden email]
>     <mailto:[hidden email]>
>     http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
>
>
>
>
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

_______________________________________________
gstreamer-devel mailing list
[hidden email]
http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

[bhavna]

Thanks for the reply
On 5/31/2011 5:04 PM, Stefan Kost wrote:

> Am 31.05.2011 06:57, schrieb vineeth:
>>
>>
>> On Mon, May 23, 2011 at 2:21 PM, bhavna<[hidden email]
>> <mailto:[hidden email]>>  wrote:
>>
>>      Hello Guys,
>>
>>      Help needed on GStreamer. I don't have much info of it.
>>      Actually my objective is to find/build the application to satisfy the
>>      scenario as following
>>
>>                             Audio-->)v4l2)
>>                             |               |
>>      video played===>HDMI==>  |               |
>>      from Settop     Rx      |               |
>>      box                     |               |=====>  MIX and store the data e
>>                             |               |
>>                             Video-->RGB Data
>>
>>
>>      Is there any gstreamer application availble which can mix Audio data coming
>>      from SPDIF pins of HDMI and raw RGB data from HDMI Video pins.
>>      HDMI Rx will be supporting V4L2 framework.
>>
>>
>> A v4l2 video component is available in gstreamer.
>> As for spdif / hdmi stuff,  you will have to write the gstreamer plugins;
>> You can see the list available plugins here :
>> http://gstreamer.freedesktop.org/documentation/plugins.html
>
> alsasrc can record from spdif and as Bhavna wrote v4l2src will support hdmi capture.
>
> Bhana, you will need to write a small application (using python if you want). It
> will be something like:
> alsasrc ! audio-encoder ! muxer name=m ! filesink v4l2src ! video-encoder ! m.
>
> You should consider encodebin as then in becomes:
> alsasrc ! encodebin name=e ! filesink v4l2src ! e.

When I will form the pipeline as suggested above will the final received
data will be in sync.
As per my understanding ALSA framework used for audio will not provide
any timestamping.


Let me explain the scenario in detail:
1. Video song played using dvd player send its output to HDMI Receiver
2. This HDMI receiver sends Audio data via spdif. Here Audio will use
ALSA framework and V4L2 framework.
How they both are linked is still not clear to me???

3. Video data i.e Raw RGB from HDMI receiver is sent to a wrapper which
is a VIDEO IN. This video IN doesn't do any processing just dump data on
DDR.

4. Now, I want to mix the output of point 2 & 3 and store on mass
storage as an avi file. SO that I can play it again to verify that
received output is correct.

>
> Stefan
>
>>
>>
>>
>>
>>      --
>>      Thanks&  Regards
>>      Bhavna Yadav
>>      ST Microelectronics
>>      _______________________________________________
>>      gstreamer-devel mailing list
>>      [hidden email]
>>      <mailto:[hidden email]>
>>      http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
>>
>>
>>
>>
>> _______________________________________________
>> gstreamer-devel mailing list
>> [hidden email]
>> http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
>
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
> .
>

--
Thanks & Regards Bhavna Yadav
_______________________________________________
gstreamer-devel mailing list
[hidden email]
http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

[Stefan Sauer]

Am 01.06.2011 08:08, schrieb bhavna:

> Thanks for the reply
> On 5/31/2011 5:04 PM, Stefan Kost wrote:
>> Am 31.05.2011 06:57, schrieb vineeth:
>>>
>>>
>>> On Mon, May 23, 2011 at 2:21 PM, bhavna<[hidden email]
>>> <mailto:[hidden email]>>  wrote:
>>>
>>>      Hello Guys,
>>>
>>>      Help needed on GStreamer. I don't have much info of it.
>>>      Actually my objective is to find/build the application to satisfy the
>>>      scenario as following
>>>
>>>                             Audio-->)v4l2)
>>>                             |               |
>>>      video played===>HDMI==>  |               |
>>>      from Settop     Rx      |               |
>>>      box                     |               |=====>  MIX and store the data e
>>>                             |               |
>>>                             Video-->RGB Data
>>>
>>>
>>>      Is there any gstreamer application availble which can mix Audio data coming
>>>      from SPDIF pins of HDMI and raw RGB data from HDMI Video pins.
>>>      HDMI Rx will be supporting V4L2 framework.
>>>
>>>
>>> A v4l2 video component is available in gstreamer.
>>> As for spdif / hdmi stuff,  you will have to write the gstreamer plugins;
>>> You can see the list available plugins here :
>>> http://gstreamer.freedesktop.org/documentation/plugins.html
>>
>> alsasrc can record from spdif and as Bhavna wrote v4l2src will support hdmi
>> capture.
>>
>> Bhana, you will need to write a small application (using python if you want). It
>> will be something like:
>> alsasrc ! audio-encoder ! muxer name=m ! filesink v4l2src ! video-encoder ! m.
>>
>> You should consider encodebin as then in becomes:
>> alsasrc ! encodebin name=e ! filesink v4l2src ! e.
> When I will form the pipeline as suggested above will the final received data
> will be in sync.
> As per my understanding ALSA framework used for audio will not provide any
> timestamping.
>
>
> Let me explain the scenario in detail:
> 1. Video song played using dvd player send its output to HDMI Receiver
> 2. This HDMI receiver sends Audio data via spdif. Here Audio will use ALSA
> framework and V4L2 framework.
> How they both are linked is still not clear to me???
>
> 3. Video data i.e Raw RGB from HDMI receiver is sent to a wrapper which is a
> VIDEO IN. This video IN doesn't do any processing just dump data on DDR.
>
> 4. Now, I want to mix the output of point 2 & 3 and store on mass storage as an
> avi file. SO that I can play it again to verify that
> received output is correct.

You are capturing data from two datasources. The resulting file with be in sync
as much as the source push the data without discontinuities and drift. Both
sources will be synced to a systemclock. Just give it a try.

Stefan

>
>
>>
>> Stefan
>>
>>>
>>>
>>>
>>>
>>>      --
>>>      Thanks&  Regards
>>>      Bhavna Yadav
>>>      ST Microelectronics
>>>      _______________________________________________
>>>      gstreamer-devel mailing list
>>>      [hidden email]
>>>      <mailto:[hidden email]>
>>>      http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> gstreamer-devel mailing list
>>> [hidden email]
>>> http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
>>
>> _______________________________________________
>> gstreamer-devel mailing list
>> [hidden email]
>> http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
>> .
>>
>
>

_______________________________________________
gstreamer-devel mailing list
[hidden email]
http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel