GStreamer-devel

pipeline hangs

Classic

List

Threaded

7 messages Options

Carl Karsten

pipeline hangs

I think there is a bug. it may be a corrupt input file, but I am not sure what should happen in that case.

I am not really sure how to debug / report, so here is my start.

7gig input file:

http://veyepar3.nextdayvideo.com/static/temp/12_55_51.ts

export GST_DEBUG=5 (I think, maybe 4)
gst-launch-1.0 filesrc location=12_55_51.ts ! decodebin ! audioconvert ! fakesink &> gst1.log

tail ...

0:02:04.242907888 7272 0x7fa988036e30 DEBUG GST_SCHEDULING gstpad.c:4181:gst_pad_chain_data_unchecked:<mpegvparse0:sink> called chainfunction &gst_base_parse_chain with buffer 0x7fa988044bc0, returned not-linked

0:02:04.242919351 7272 0x7fa988036e30 DEBUG multiqueue gstmultiqueue.c:1568:gst_multi_queue_loop:<multiqueue0> SingleQueue 0 : trying to pop an object

0:02:04.242933255 7272 0x7fa988036e30 DEBUG multiqueue gstmultiqueue.c:1641:gst_multi_queue_loop:<multiqueue0> queue 0 sleeping for not-linked wakeup with newid 35819, highid 35818, next_time +0:15:35.117266667, high_time +0:15:34.889277778

0:02:04.242967390 7272 0x7fa98c052e80 DEBUG multiqueue gstmultiqueue.c:2550:single_queue_check_full:<multiqueue0> queue 0: visible 4/38, bytes 2339734/2097152, time 166833334/0

more of the log is here:

http://pastebin.com/YZwUjvpG

The whole thing was 1.1 gig and 40gig at GST_DEBUG=9

Carl K

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

Tim Müller

Re: pipeline hangs

On Sat, 2016-08-20 at 01:55 -0500, Carl Karsten wrote:

Hi Carl,

> I think there is a bug. it may be a corrupt input file, but I am not
> sure what should happen in that case.
>
> I am not really sure how to debug / report, so here is my start.

Perhaps you could start by telling us how it fails and how to reproduce
it exactly.

Are you saying the pipeline reliably hangs after ca. 2 minutes? Always,
or only with debug logging enabled?

What version of GStreamer are you using?

Cheers
-Tim

--
Tim Müller, Centricular Ltd - http://www.centricular.com
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

Carl Karsten-2

Re: pipeline hangs

Hey Tim,

Always hangs.

to repo:

wget http://veyepar3.nextdayvideo.com/static/temp/12_55_51.ts
export GST_DEBUG=4 # so we can see output that stops
gst-launch-1.0 filesrc location=12_55_51.ts ! decodebin ! audioconvert ! fakesink

(lots of output)

and then it stops on:

0:01:25.211115836 11647 0x7f02c0014630 INFO videodecoder gstvideodecoder.c:1432:gst_video_decoder_sink_event_default:<avdec_mpeg2video0> upstream tags: taglist, video-codec=(string)"MPEG-2\ Video", minimum-bitrate=(uint)6481678, maximum-bitrate=(uint)67988333, bitrate=(uint)2726087;

I hit ^c

^Chandling interrupt.
Interrupt: Stopping pipeline ...
Execution ended after 0:05:02.408558549
Setting pipeline to PAUSED ...
0:05:02.540604203 11647 0xed2a00 INFO GST_STATES gstbin.c:231
6:gst_bin_element_set_state:<fakesink0> current PLAYING pending VOID_PENDING, de

(lots more output)

(veyepar) juser@dhcp13:~/temp$ gst-launch-1.0 --version
gst-launch-1.0 version 1.8.2
GStreamer 1.8.2
https://launchpad.net/distros/ubuntu/+source/gstreamer1.0

gst-inspect-1.0 audioconvert

Version                  1.8.2
Source release date      2016-06-09
Binary package           GStreamer Base Plugins (Ubuntu)
Origin URL               https://launchpad.net/distros/ubuntu/+source/gst-plugins-base1.0

I just ran the same thing on gst-uninstalled, same result (same as far as I can tell - it runs, then it hangs. last line of debug:

0:01:24.589916655 31340 0x7f377c036e30 INFO            videodecoder gstvideodecoder.c:1337:gst_video_decoder_sink_event_default:<avdec_mpeg2video0> upstream tags: taglist, video-codec=(string)"MPEG-2\ Video", minimum-bitrate=(uint)6481678, maximum-bitrate=(uint)67988333, bitrate=(uint)2726087;

gst-inspect-1.0 audioconvert
Name                     audioconvert
Filename                 /home/juser/gst/master/gst-plugins-base/gst/audioconvert/.libs/libgstaudioconvert.so
Version                  1.9.1.1
Source release date      2016-08-20 16:58 (UTC)

I think I ran into this 6 months ago, and that is when I first started using files of this type, so I don't think I have ever seen it work. so don't look for a regression.

On Sat, Aug 20, 2016 at 4:41 AM, Tim Müller <[hidden email]> wrote:

On Sat, 2016-08-20 at 01:55 -0500, Carl Karsten wrote:

Hi Carl,

> I think there is a bug. it may be a corrupt input file, but I am not
> sure what should happen in that case.
>
> I am not really sure how to debug / report, so here is my start.

Perhaps you could start by telling us how it fails and how to reproduce
it exactly.

Are you saying the pipeline reliably hangs after ca. 2 minutes? Always,
or only with debug logging enabled?

What version of GStreamer are you using?

Cheers
-Tim

--
Tim Müller, Centricular Ltd - http://www.centricular.com
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

Carl Karsten-2

Re: pipeline hangs

bug?

I always feel lost reporting.

https://bugzilla.gnome.org/enter_bug.cgi
Component ?

Does it even matter?

Can I attach a 7gig file, or is there a good place to put it?

On Sat, Aug 20, 2016 at 12:47 PM, Carl Karsten <[hidden email]> wrote:

Hey Tim,

Always hangs.

to repo:

wget http://veyepar3.nextdayvideo.com/static/temp/12_55_51.ts
export GST_DEBUG=4 # so we can see output that stops
gst-launch-1.0 filesrc location=12_55_51.ts ! decodebin ! audioconvert ! fakesink

(lots of output)

and then it stops on:

0:01:25.211115836 11647 0x7f02c0014630 INFO            videodecoder gstvideodecoder.c:1432:gst_video_decoder_sink_event_default:<avdec_mpeg2video0> upstream tags: taglist, video-codec=(string)"MPEG-2\ Video", minimum-bitrate=(uint)6481678, maximum-bitrate=(uint)67988333, bitrate=(uint)2726087;

I hit ^c

^Chandling interrupt.
Interrupt: Stopping pipeline ...
Execution ended after 0:05:02.408558549
Setting pipeline to PAUSED ...
0:05:02.540604203 11647       0xed2a00 INFO              GST_STATES gstbin.c:231
6:gst_bin_element_set_state:<fakesink0> current PLAYING pending VOID_PENDING, de

(lots more output)

(veyepar) juser@dhcp13:~/temp$ gst-launch-1.0 --version
gst-launch-1.0 version 1.8.2
GStreamer 1.8.2
https://launchpad.net/distros/ubuntu/+source/gstreamer1.0

gst-inspect-1.0 audioconvert

Version                  1.8.2
Source release date      2016-06-09
Binary package           GStreamer Base Plugins (Ubuntu)
Origin URL               https://launchpad.net/distros/ubuntu/+source/gst-plugins-base1.0

I just ran the same thing on gst-uninstalled, same result (same as far as I can tell - it runs, then it hangs. last line of debug:

0:01:24.589916655 31340 0x7f377c036e30 INFO            videodecoder gstvideodecoder.c:1337:gst_video_decoder_sink_event_default:<avdec_mpeg2video0> upstream tags: taglist, video-codec=(string)"MPEG-2\ Video", minimum-bitrate=(uint)6481678, maximum-bitrate=(uint)67988333, bitrate=(uint)2726087;

gst-inspect-1.0 audioconvert
Name                     audioconvert
Filename                 /home/juser/gst/master/gst-plugins-base/gst/audioconvert/.libs/libgstaudioconvert.so
Version                  1.9.1.1
Source release date      2016-08-20 16:58 (UTC)

I think I ran into this 6 months ago, and that is when I first started using files of this type, so I don't think I have ever seen it work. so don't look for a regression.

On Sat, Aug 20, 2016 at 4:41 AM, Tim Müller <[hidden email]> wrote:
On Sat, 2016-08-20 at 01:55 -0500, Carl Karsten wrote:

Hi Carl,

> I think there is a bug. it may be a corrupt input file, but I am not
> sure what should happen in that case.
>
> I am not really sure how to debug / report, so here is my start.

Perhaps you could start by telling us how it fails and how to reproduce
it exactly.

Are you saying the pipeline reliably hangs after ca. 2 minutes? Always,
or only with debug logging enabled?

What version of GStreamer are you using?

Cheers
-Tim

--
Tim Müller, Centricular Ltd - http://www.centricular.com
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

Tim Müller

Re: pipeline hangs

On Mon, 2016-08-22 at 16:02 -0500, Carl Karsten wrote:

Hi Carl,

Yes it sounds like a bug.

I haven't been able to reproduce it yet though, it seems to work just
fine for me.

You won't be able to attach a 7GB file to bugzilla I'm afraid, but you
can put the link to the file there.

Cheers
-Tim

--
Tim Müller, Centricular Ltd - http://www.centricular.com
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

Carl Karsten-2

Re: pipeline hangs

more details:

it does work on some other .ts files made with the same ffmpeg command:

ffmpeg \

-i tcp://$VOC_CORE:11000 \

-ac 2 -channel_layout 2c -aspect 16:9 \

-map 0:v -c:v:0 mpeg2video -pix_fmt:v:0 yuv422p -qscale:v:0 2 -qmin:v:0 2 -qmax:v:0 10 -keyint_min 0 -bf:0 0 -g:0 0 -intra:0 -maxrate:0 140M \

-map 0:a -c:a:0 mp2 -b:a:0 192k -ac:a:0 2 -ar:a:0 48000 \

-flags +global_header -flags +ilme+ildct \

-f segment -segment_time $segment_time \

-segment_format mpegts \

-strftime 1 "$dest_dir/%Y-%m-%d/%H_%M_%S.ts"

https://github.com/CarlFK/voctomix-outcasts/blob/master/record-timestamp.sh

I have run the pipline on about 10 .ts files, all created with the same ffmpeg command. it woks ok on 5 files, hangs on the 5 others.

In case anyone is curious, the production code is this:
https://github.com/CarlFK/veyepar/blob/master/dj/lib/gslevels.py#L34-L36

which makes a visualization like this:
http://veyepar.ndv.cdn.nextdayvideo.com/veyepar/pyohio/pyohio_2016/audio_png/raw/barbietootle/2016-07-30/09_31_51.ts.wav.png

On Tue, Aug 23, 2016 at 7:50 AM, Tim Müller <[hidden email]> wrote:

On Mon, 2016-08-22 at 16:02 -0500, Carl Karsten wrote:

Hi Carl,

Yes it sounds like a bug.

I haven't been able to reproduce it yet though, it seems to work just
fine for me.

You won't be able to attach a 7GB file to bugzilla I'm afraid, but you
can put the link to the file there.

Cheers
-Tim

--
Tim Müller, Centricular Ltd - http://www.centricular.com
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

Carl Karsten-2

Re: pipeline hangs

bugged
https://bugzilla.gnome.org/show_bug.cgi?id=770498

On Tue, Aug 23, 2016 at 1:33 PM, Carl Karsten <[hidden email]> wrote:

more details:

it does work on some other .ts files made with the same ffmpeg command:

ffmpeg \

-i tcp://$VOC_CORE:11000 \

-ac 2 -channel_layout 2c -aspect 16:9 \

-map 0:v -c:v:0 mpeg2video -pix_fmt:v:0 yuv422p -qscale:v:0 2 -qmin:v:0 2 -qmax:v:0 10 -keyint_min 0 -bf:0 0 -g:0 0 -intra:0 -maxrate:0 140M \

-map 0:a -c:a:0 mp2 -b:a:0 192k -ac:a:0 2 -ar:a:0 48000 \

-flags +global_header -flags +ilme+ildct \

-f segment -segment_time $segment_time \

-segment_format mpegts \

-strftime 1 "$dest_dir/%Y-%m-%d/%H_%M_%S.ts"

https://github.com/CarlFK/voctomix-outcasts/blob/master/record-timestamp.sh

I have run the pipline on about 10 .ts files, all created with the same ffmpeg command. it woks ok on 5 files, hangs on the 5 others.

In case anyone is curious, the production code is this:
https://github.com/CarlFK/veyepar/blob/master/dj/lib/gslevels.py#L34-L36

which makes a visualization like this:
http://veyepar.ndv.cdn.nextdayvideo.com/veyepar/pyohio/pyohio_2016/audio_png/raw/barbietootle/2016-07-30/09_31_51.ts.wav.png

On Tue, Aug 23, 2016 at 7:50 AM, Tim Müller <[hidden email]> wrote:
On Mon, 2016-08-22 at 16:02 -0500, Carl Karsten wrote:

Hi Carl,

Yes it sounds like a bug.

I haven't been able to reproduce it yet though, it seems to work just
fine for me.

You won't be able to attach a 7GB file to bugzilla I'm afraid, but you
can put the link to the file there.

Cheers
-Tim

--
Tim Müller, Centricular Ltd - http://www.centricular.com
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel

_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel