Occasional crashes of long-running ogmios instance

[Quantumplation]

What Git revision / release tag are you using?

6.3.0

Do you use any client SDK? If yes, which one?

Go

Describe what the problem is?

Ogmios 6.3.0 crashes after around 2 days of uptime.

What should be the expected behavior?

Don't crash

If applicable, what are the logs from the server around the occurence of the problem?

Jun 29 19:24:34 SS2 ogmios[3904206]: CallStack (from HasCallStack):
Jun 29 19:24:34 SS2 ogmios[3904206]:   error, called at ./Control/AutoUpdate.hs:139:48 in auto-update-0.1.6-f24b5edf1f4082c9163b3eec491cbbe2d178da0d7f98160681c8c16e40851e98:Control.AutoUpdate
Jun 29 19:24:39 SS2 ogmios[3904206]: Control.AutoUpdate.mkAutoUpdate: worker thread exited with exception: thread blocked indefinitely in an MVar operation
Jun 29 19:24:39 SS2 ogmios[3904206]: CallStack (from HasCallStack):
Jun 29 19:24:39 SS2 ogmios[3904206]:   error, called at ./Control/AutoUpdate.hs:139:48 in auto-update-0.1.6-f24b5edf1f4082c9163b3eec491cbbe2d178da0d7f98160681c8c16e40851e98:Control.AutoUpdate
Jun 29 19:24:44 SS2 ogmios[3904206]: Control.AutoUpdate.mkAutoUpdate: worker thread exited with exception: thread blocked indefinitely in an MVar operation
Jun 29 19:24:44 SS2 ogmios[3904206]: CallStack (from HasCallStack):
Jun 29 19:24:44 SS2 ogmios[3904206]:   error, called at ./Control/AutoUpdate.hs:139:48 in auto-update-0.1.6-f24b5edf1f4082c9163b3eec491cbbe2d178da0d7f98160681c8c16e40851e98:Control.AutoUpdate
Jun 29 19:24:50 SS2 ogmios[3904206]: Control.AutoUpdate.mkAutoUpdate: worker thread exited with exception: thread blocked indefinitely in an MVar operation
Jun 29 19:24:50 SS2 ogmios[3904206]: CallStack (from HasCallStack):
Jun 29 19:24:50 SS2 ogmios[3904206]:   error, called at ./Control/AutoUpdate.hs:139:48 in auto-update-0.1.6-f24b5edf1f4082c9163b3eec491cbbe2d178da0d7f98160681c8c16e40851e98:Control.AutoUpdate
Jun 29 19:24:51 SS2 ogmios[3904206]: {"severity":"Info","timestamp":"2024-06-30T02:24:51.46309513Z","thread":"72532771","message":{"WebSocket":{"contents":{"atSlot":128148001,"ns":1702998861706590,"tag":"TxSubmissionLocalMempoolNewSnapshot"},"tag":"WebSocketTxSubmission"}},"version":"v6.3.0 (f6fd8d68)"}
Jun 29 19:24:51 SS2 ogmios[3904206]: {"severity":"Info","timestamp":"2024-06-30T02:24:51.465204127Z","thread":"72532769","message":{"WebSocket":{"contents":{"atSlot":128148001,"ns":1702998863818547,"tag":"TxSubmissionLocalMempoolNewSnapshot"},"tag":"WebSocketTxSubmission"}},"version":"v6.3.0 (f6fd8d68)"}
Jun 29 19:24:51 SS2 ogmios[3904206]: {"severity":"Info","timestamp":"2024-06-30T02:24:51.465873286Z","thread":"72532769","message":{"WebSocket":{"contents":{"tag":"TxSubmissionLocalMempoolSynchronized","took":"668µs"},"tag":"WebSocketTxSubmission"}},"version":"v6.3.0 (f6fd8d68)"}
Jun 29 19:24:51 SS2 ogmios[3904206]: {"severity":"Info","timestamp":"2024-06-30T02:24:51.466993044Z","thread":"72532771","message":{"WebSocket":{"contents":{"tag":"TxSubmissionLocalMempoolSynchronized","took":"3901µs"},"tag":"WebSocketTxSubmission"}},"version":"v6.3.0 (f6fd8d68)"}
Jun 29 19:24:55 SS2 ogmios[3904206]: Control.AutoUpdate.mkAutoUpdate: worker thread exited with exception: thread blocked indefinitely in an MVar operation