question ids of reasoning types

[dirkweissenborn]

It would be really nice if the question ids that require the reasoning types specified in the paper could be made available in order to make more detailed analyses.

[dirkweissenborn]

Any updates?

[xingdi-eric-yuan]

Hey Dirk, I'm not sure if we are allowed to release the human annotated data, but we finally got approval for the preprocessing script releasing stuff. I have a "useable version" in this branch, we're still working on making it more clean. We'll soon make a leader board on our website, will let you know then. Thanks!

[ida-szubert]

Is there any chance for the human annotation of question types to be released? If not, it would be good to know too, if only to justify putting time into detailed analysis ourselves.