approach for mcu with audio mixer

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

approach for mcu with audio mixer

chakra
This post was updated on .
Hi,

I want to implement a audio conference application where each participant
sends a stream of *webrtc(browser[peerConnection(sendonly)])* audio /to/
*gstreamer(webrtcbin receiver here)* and all audio streams are mixed* (audio
mixer here)* and one combined audio stream is sent *(webrtcbin sender here)*
/to/ each participant *webrtc(browser [peerConnection(recvonly)]).*

The problem I see is that using this approach each participant will receive
full mixed audio which also has the audio which is sent by the participant
itself causing inconvenience.

Basically if there are 3 participants 1,2,3 in MCU,

1 - listens audio from 2,3 and also 1's own
2 - listens audio from 1,3 and also 2's own
3 - listens audio from 2,1 and also 3's own

I want to avoid this where participant only listens audio of all other
participants except audio from himself

Is there an approach to implement this kind of use case?

I found a similar example at http://gstreamer-devel.966125.n4.nabble.com/audiomixer-implementation-for-audio-conference-cancel-user-1-contribution-when-streaming-to-user-1-td4659790.html

but if its the only way or better approach is more welcome

I was thinking if I can somehow filter / remove audio for each
webrtcbin(while sending) after audio mixer which came from same participant,
but not sure if its a valid/actual approach

Please suggest some way of doing this or any pointers to start with...

Thanks





--
Sent from: http://gstreamer-devel.966125.n4.nabble.com/
_______________________________________________
gstreamer-devel mailing list
gstreamer-devel@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: approach for mcu with audio mixer

mhassan
chakra wrote

> Hi,
>
> I want to implement a audio conference application where each participant
> sends a stream of *webrtc(browser[peerConnection(sendonly)])* audio /to/
> *gstreamer(webrtcbin receiver here)* and all audio streams are mixed*
> (audio
> mixer here)* and one combined audio stream is sent *(webrtcbin sender
> here)*
> /to/ each participant *webrtc(browser [peerConnection(recvonly)]).*
>
> The problem I see is that using this approach each participant will
> receive
> full mixed audio which also has the audio which is sent by the participant
> itself causing inconvenience.
>
> Basically if there are 3 participants 1,2,3 in MCU,
>
> 1 - listens audio from 2,3 and also 1's own
> 2 - listens audio from 1,3 and also 2's own
> 3 - listens audio from 2,1 and also 3's own
>
> I want to avoid this where participant only listens audio of all other
> participants except audio from himself
>
> Is there an approach to implement this kind of use case?
>
> I found a similar example at
> http://gstreamer-devel.966125.n4.nabble.com/audiomixer-implementation-for-audio-conference-cancel-user-1-contribution-when-streaming-to-user-1-td4659790.html
>
> but if its the only way or better approach is more welcome
>
> I was thinking if I can somehow filter / remove audio for each
> webrtcbin(while sending) after audio mixer which came from same
> participant,
> but not sure if its a valid/actual approach
>
> Please suggest some way of doing this or any pointers to start with...
>
> Thanks
>
>
>
>
>
> --
> Sent from: http://gstreamer-devel.966125.n4.nabble.com/
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel


Hey there,

Just wanted to bump this thread in case you had found a solution because I
am also building a similar application and haven't yet found a viable answer
to audiomixing in a conference with gstreamer and webrtc.

Thanks



--
Sent from: http://gstreamer-devel.966125.n4.nabble.com/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel