Can't connect errors on hub.mybinder.turing.ac.uk

[scottyhq]

Using the binder badge in this repo readme, opening VSCode seems to work, but is immediately followed by 'Disconnected' error pop-ups that keep showing up:

Seems like there are lots of javascript errors looking at a web console, but I'm not sure how to interpret them...

[manics]

What browser are you using? It's currently working for me, Firefox on OS X.

[scottyhq]

Interesting, I launched again with Safari and things seem to work. But with Chrome I get the same disconnect error. Javascript console shows:

 ERR [remote-connection][ExtensionHost][77f7f…][initial][hub.gke.mybinder.org:80] the handshake took longer than 10 seconds. Error:
workbench.web.api.js:3967 Error: handshake timeout
    at workbench.web.api.js:1752

[manics]

I see the same related problems as you with Chrome.

  ERR [remote-connection][ExtensionHost][6f9b6…][reconnect][hub.mybinder.turing.ac.uk:80] received error control message when negotiating connection. Error:
workbench.web.api.js:1584
  ERR Error: Connection error: Unrecognized reconnection token
    at k (workbench.web.api.js:1761)
    at workbench.web.api.js:1754
    at e.fire (workbench.web.api.js:95)
    at v.fire (workbench.web.api.js:404)
    at t.PersistentProtocol._receiveMessage (workbench.web.api.js:409)
    at workbench.web.api.js:408
    at e.fire (workbench.web.api.js:95)
    at g.acceptChunk (workbench.web.api.js:402)
    at workbench.web.api.js:401
    at workbench.web.api.js:1751

[betatim]

I have no idea :(

@sgibson91 do you have any ideas where we could start investigating?

[manics]

@scottyhq's second comment mentions hub.gke.mybinder.org, so maybe it's a more general problem?

[betatim]

Only error I see (on Firefox and GKE) right now is:

 ERR invalid identity escape in regular expression: _reviveRegExp@https://hub.gke.mybinder.org/user/betatim-vscode-binder-dehfxkym/vscode/static/521ac7d91f1d1107fa100898969e7b902740414a/lib/vscode/out/vs/workbench/workbench.web.api.js:4669:736
$setLanguageConfiguration@https://hub.gke.mybinder.org/user/betatim-vscode-binder-dehfxkym/vscode/static/521ac7d91f1d1107fa100898969e7b902740414a/lib/vscode/out/vs/workbench/workbench.web.api.js:4670:596
_doInvokeHandler@https://hub.gke.mybinder.org/user/betatim-vscode-binder-dehfxkym/vscode/static/521ac7d91f1d1107fa100898969e7b902740414a/lib/vscode/out/vs/workbench/workbench.web.api.js:3959:464
_invokeHandler@https://hub.gke.mybinder.org/user/betatim-vscode-binder-dehfxkym/vscode/static/521ac7d91f1d1107fa100898969e7b902740414a/lib/vscode/out/vs/workbench/workbench.web.api.js:3959:156
_receiveRequest@https://hub.gke.mybinder.org/user/betatim-vscode-binder-dehfxkym/vscode/static/521ac7d91f1d1107fa100898969e7b902740414a/lib/vscode/out/vs/workbench/workbench.web.api.js:3957:817
_receiveOneMessage@https://hub.gke.mybinder.org/user/betatim-vscode-binder-dehfxkym/vscode/static/521ac7d91f1d1107fa100898969e7b902740414a/lib/vscode/out/vs/workbench/workbench.web.api.js:3956:623
e/<@https://hub.gke.mybinder.org/user/betatim-vscode-binder-dehfxkym/vscode/static/521ac7d91f1d1107fa100898969e7b902740414a/lib/vscode/out/vs/workbench/workbench.web.api.js:3954:848
fire@https://hub.gke.mybinder.org/user/betatim-vscode-binder-dehfxkym/vscode/static/521ac7d91f1d1107fa100898969e7b902740414a/lib/vscode/out/vs/workbench/workbench.web.api.js:95:801
fire@https://hub.gke.mybinder.org/user/betatim-vscode-binder-dehfxkym/vscode/static/521ac7d91f1d1107fa100898969e7b902740414a/lib/vscode/out/vs/workbench/workbench.web.api.js:404:849
_receiveMessage@https://hub.gke.mybinder.org/user/betatim-vscode-binder-dehfxkym/vscode/static/521ac7d91f1d1107fa100898969e7b902740414a/lib/vscode/out/vs/workbench/workbench.web.api.js:409:276
@https://hub.gke.mybinder.org/user/betatim-vscode-binder-dehfxkym/vscode/static/521ac7d91f1d1107fa100898969e7b902740414a/lib/vscode/out/vs/workbench/workbench.web.api.js:406:357
fire@https://hub.gke.mybinder.org/user/betatim-vscode-binder-dehfxkym/vscode/static/521ac7d91f1d1107fa100898969e7b902740414a/lib/vscode/out/vs/workbench/workbench.web.api.js:95:801
acceptChunk@https://hub.gke.mybinder.org/user/betatim-vscode-binder-dehfxkym/vscode/static/521ac7d91f1d1107fa100898969e7b902740414a/lib/vscode/out/vs/workbench/workbench.web.api.js:402:393
g/<@https://hub.gke.mybinder.org/user/betatim-vscode-binder-dehfxkym/vscode/static/521ac7d91f1d1107fa100898969e7b902740414a/lib/vscode/out/vs/workbench/workbench.web.api.js:401:753
onData/<@https://hub.gke.mybinder.org/user/betatim-vscode-binder-dehfxkym/vscode/static/521ac7d91f1d1107fa100898969e7b902740414a/lib/vscode/out/vs/workbench/workbench.web.api.js:1751:387
fire@https://hub.gke.mybinder.org/user/betatim-vscode-binder-dehfxkym/vscode/static/521ac7d91f1d1107fa100898969e7b902740414a/lib/vscode/out/vs/workbench/workbench.web.api.js:95:801
l/this._fileReader.onload@https://hub.gke.mybinder.org/user/betatim-vscode-binder-dehfxkym/vscode/static/521ac7d91f1d1107fa100898969e7b902740414a/lib/vscode/out/vs/workbench/workbench.web.api.js:1750:39

which is at least in the same bit of code (the workbench). Maybe worth opening a ticket upstream with code-server to find out if they can help us figure out where this points?

[betatim]

On Chrome 83.0.4103.61 (Official Build) (64-bit) there aren't any errors in the console :-/

[sgibson91]

@sgibson91 do you have any ideas where we could start investigating?

Errrr, no sorry. Very weird :(

[sgibson91]

Just checked the Turing nodes, they're all in Ready state. If they had that weird Scheduling Disabled state that keeps cropping up then I'd suggest that, but I cleared all those yesterday and things are good so far.