Restarting antmedia server corrupts recorded MP4s

Konrad Piwowar · April 20, 2021

We have a show that was being recorded - webrtc ingress, recorded via the checkbox in the dashboard being on so all shows are recorded. I see a file called acfd988607849de3988ae27ce5247818_1080p.mp4.tmp_extension in the streams dir which seems to be a corrupted .mp4 file, with a last modified time of 21:35:54.

It looks like antmedia restart itself for some reason, and this caused the file corruption?

Log:

https://pastebin.com/8vGu0j85

Konrad Piwowar · April 20, 2021

The last error in error log prior to this restart is:

Apr 19, 2021 9:32:29 PM org.apache.coyote.AbstractProtocol$ConnectionHandler process

SEVERE: Error reading request, ignored

java.lang.IllegalArgumentException: Reason Phrase cannot exceed 123 UTF-8 encoded bytes: Unexpected error [20,014] reading data from the APR/native socket [140,408,970,682,528] with wrapper [org.apache.tomcat.util.net.AprEndpoint$AprSocketWrapper@1a5cfd8f:140408970682528].

at javax.websocket.CloseReason.<init>(CloseReason.java:70)

at org.apache.tomcat.websocket.server.WsHttpUpgradeHandler.upgradeDispatch(WsHttpUpgradeHandler.java:153)

at org.apache.coyote.http11.upgrade.UpgradeProcessorInternal.dispatch(UpgradeProcessorInternal.java:54)

at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:59)

at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:818)

at org.apache.tomcat.util.net.AprEndpoint$SocketProcessor.doRun(AprEndpoint.java:2075)

at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)

at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)

at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)

at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)

at java.base/java.lang.Thread.run(Thread.java:834)

Also the performer that was recording at the time claimed that users suddenly heard her audio cut out. I do see a bunch of things like this in error log:

(acm_receiver.cc:52): AcmReceiver::SetExtraDelay 2234

(acm_receiver.cc:52): AcmReceiver::SetExtraDelay 2314

(acm_receiver.cc:52): AcmReceiver::SetExtraDelay 2394

(acm_receiver.cc:52): AcmReceiver::SetExtraDelay 2474

(acm_receiver.cc:52): AcmReceiver::SetExtraDelay 2554

(acm_receiver.cc:52): AcmReceiver::SetExtraDelay 2634

(acm_receiver.cc:52): AcmReceiver::SetExtraDelay 2692

(acm_receiver.cc:52): AcmReceiver::SetExtraDelay 2722

(acm_receiver.cc:52): AcmReceiver::SetExtraDelay 2802

(acm_receiver.cc:52): AcmReceiver::SetExtraDelay 2864