canvas.captureStream() stops after a few seconds

[Tim Davis]

Hello I follow your example here

https://antmedia.io/how-to-merge-live-stream-and-canvas-in-webrtc-easily/

And the example works if I have nothing else on the page.. but when I add other javascript libraries normal, it stops working after a few seconds.. I been stuck on this for 4 days nonstop. everything looks identical, it just does not like the canvas after adding other JS files..

 

Here is some logs

y inserted, dropping frame.

Sep 16, 2020 6:14:20 AM io.vertx.core.impl.BlockedThreadChecker

WARNING: Thread Thread[vert.x-eventloop-thread-4,5,main] has been blocked for 2780 ms, time limit is 2000

Sep 16, 2020 6:14:21 AM io.vertx.core.impl.BlockedThreadChecker

WARNING: Thread Thread[vert.x-eventloop-thread-4,5,main] has been blocked for 3780 ms, time limit is 2000

Sep 16, 2020 6:14:22 AM io.vertx.core.impl.BlockedThreadChecker

WARNING: Thread Thread[vert.x-eventloop-thread-4,5,main] has been blocked for 4779 ms, time limit is 2000

[flv @ 0x7fc9fc0a7900] Could not find codec parameters for stream 0 (Video: h264, none, 400 kb/s): unspecified size

Consider increasing the value for the 'analyzeduration' and 'probesize' options

[libx264 @ 0x7fca244becc0] -qscale is ignored, -crf is recommended.

(physical_socket_server.cc:557): Socket::OPT_DSCP not supported.

(jsep_transport_controller.cc:360): Not adding candidate because the JsepTransport doesn't exist. Ignore it.

(jsep_transport_controller.cc:360): Not adding candidate because the JsepTransport doesn't exist. Ignore it.

(physical_socket_server.cc:557): Socket::OPT_DSCP not supported.

(frame_buffer2.cc:538): Frame with (picture_id:spatial_id) (9033:0) already inserted, dropping frame.

(frame_buffer2.cc:538): Frame with (picture_id:spatial_id) (9033:0) already inserted, dropping frame.

(frame_buffer2.cc:538): Frame with (picture_id:spatial_id) (9036:0) already inserted, dropping frame.

(frame_buffer2.cc:538): Frame with (picture_id:spatial_id) (9035:0) already inserted, dropping frame.

Sep 16, 2020 6:15:54 AM io.vertx.core.impl.BlockedThreadChecker

WARNING: Thread Thread[vert.x-eventloop-thread-5,5,main] has been blocked for 2632 ms, time limit is 2000

Sep 16, 2020 6:15:55 AM io.vertx.core.impl.BlockedThreadChecker

WARNING: Thread Thread[vert.x-eventloop-thread-5,5,main] has been blocked for 3632 ms, time limit is 2000

Sep 16, 2020 6:15:56 AM io.vertx.core.impl.BlockedThreadChecker

WARNING: Thread Thread[vert.x-eventloop-thread-5,5,main] has been blocked for 4633 ms, time limit is 2000

Sep 16, 2020 6:15:57 AM io.vertx.core.impl.BlockedThreadChecker

WARNING: Thread Thread[vert.x-eventloop-thread-5,5,main] has been blocked for 5632 ms, time limit is 2000

io.vertx.core.VertxException: Thread blocked

    at org.bytedeco.javacpp.Pointer.trimMemory(Native Method)

    at org.bytedeco.javacpp.Pointer.deallocator(Pointer.java:566)

    at org.bytedeco.javacpp.Pointer.init(Pointer.java:125)

    at org.bytedeco.javacpp.avutil$AVRational.allocate(Native Method)

    at org.bytedeco.javacpp.avutil$AVRational.<init>(avutil.java:1660)

    at io.antmedia.enterprise.webrtc.WebRTCMuxer.<init>(WebRTCMuxer.java:157)

    at io.antmedia.enterprise.adaptive.EncoderAdaptor.getWebRTCMuxer(EncoderAdaptor.java:677)

    at io.antmedia.enterprise.adaptive.EncoderAdaptor.buildEncoders(EncoderAdaptor.java:355)

    at io.antmedia.enterprise.adaptive.EncoderAdaptor.prepareEncoders(EncoderAdaptor.java:701)

    at io.antmedia.enterprise.adaptive.EncoderAdaptor.prepareInternal(EncoderAdaptor.java:274)

    at io.antmedia.muxer.MuxAdaptor.prepare(MuxAdaptor.java:498)

    at io.antmedia.muxer.MuxAdaptor.lambda$start$6(MuxAdaptor.java:977)

    at io.antmedia.muxer.MuxAdaptor$$Lambda$267/654230500.handle(Unknown Source)

    at io.vertx.core.impl.VertxImpl$InternalTimerHandler.handle(VertxImpl.java:885)

    at io.vertx.core.impl.VertxImpl$InternalTimerHandler.handle(VertxImpl.java:844)

    at io.vertx.core.impl.ContextImpl.lambda$wrapTask$2(ContextImpl.java:339)

    at io.vertx.core.impl.ContextImpl$$Lambda$31/961112735.run(Unknown Source)

    at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163)

    at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:404)

    at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:463)

    at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:886)

    at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)

    at java.lang.Thread.run(Thread.java:748)

 

[flv @ 0x7fca0808b980] Could not find codec parameters for stream 0 (Video: h264, none, 400 kb/s): unspecified size

Consider increasing the value for the 'analyzeduration' and 'probesize' options

[libx264 @ 0x7fca28143ac0] -qscale is ignored, -crf is recommended.

(physical_socket_server.cc:557): Socket::OPT_DSCP not supported.

[Selim Emre]

Hi,

Thank you for reporting this issue! We will update our blog post as soon as possible.

While we are updating the blog post, can you please try this HTML example in the meantime? -> https://gist.github.com/mekya/d7d21f78e7ecb2c34d89bd6ec5bf5799 I tried and It worked.

It seems AMS couldn't get the video source properly. Is it possible to share your javascript code snippets for the test with our environment? It would great :) Also, we see the error logs with FLV. What kind of usage do you have with FLV? Are you doing something with RTMP?

I hope, I could help you.

 

Best Regards,

Selim

[Tim Davis]

Hello Selim! Thank you so much! and also for updating the example on how to attach an Audio Track..

My problem was "&rtmpforward=true" with the canvas... so this was the result.

rtmpforward=true + no audio track = stream failure

rtmpforward=false + no audio track = success

rtmpforward true/false + audio track = success..

Thanks again!

[sOLVED]