Using base transform fwith custom CAPS implementation

classic Classic list List threaded Threaded
3 messages Options
JK
Reply | Threaded
Open this post in threaded view
|

Using base transform fwith custom CAPS implementation

JK
Hi

I want to create a custom preprocessing plugin from base transform for doing
normalization, input CAPS of the plugin should be video/x-raw,format=RGB,BGR
and set a custom CAPS application/nn-input,media=video,format=RGB/BGR at the
src pad.

I am using basetransform_class vmethods transform_ip for buffer
manipulation, transform_caps for setting new caps.

what all sould be done for this, i am newbie to plugin development  



--
Sent from: http://gstreamer-devel.966125.n4.nabble.com/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|

Re: Using base transform fwith custom CAPS implementation

Michael Gruner
If you are planning to change caps, you also need to implement transform_caps.

Also, is there a reason to change the mime type to application/nn-input? It will be way easier if you keep video/x-raw, since you can reuse GstVideo utilities. Also, if you choose keeping video/x-raw, consider using videofilter instead of base_transform.


Michael
www.ridgerun.com



> On Sep 13, 2019, at 12:17 AM, JK <[hidden email]> wrote:
>
> Hi
>
> I want to create a custom preprocessing plugin from base transform for doing
> normalization, input CAPS of the plugin should be video/x-raw,format=RGB,BGR
> and set a custom CAPS application/nn-input,media=video,format=RGB/BGR at the
> src pad.
>
> I am using basetransform_class vmethods transform_ip for buffer
> manipulation, transform_caps for setting new caps.
>
> what all sould be done for this, i am newbie to plugin development  
>
>
>
> --
> Sent from: http://gstreamer-devel.966125.n4.nabble.com/
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
JK
Reply | Threaded
Open this post in threaded view
|

Re: Using base transform fwith custom CAPS implementation

JK
Thanks for the support, i got that functionality right.

Actually i am creating  plugins for a specific customer requirements, so in
that specific pipeline i need to actually restrict the outcaps to the custom
caps "application/nn-input" ( which is the input data to plugin that does
some inference processing ) ,
nn-input means  nueral network input

one reason behind this is that the output of this plugin could never be
always displayed as video, for example in this plugin i normalize the pixel
values of the input video ( 0 to 1), likewise there will be custom
processing of input video which would essentially giveout output data which
can't be visualised using displaysink



--
Sent from: http://gstreamer-devel.966125.n4.nabble.com/
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel