My employer asked me to work through the Windows build steps, and document them. I wrote a blog post, below. We'd be happy to migrate these at some point to an official gstreamer site, but my recent understanding was that is not set up yet. If anyone finds any mistakes or omissions, just let me know.
Build Gstreamer on Windows