the number of columns of CSV files created is not equal to newsqa-data-v1.csv

[shakiba-bakhtiari]

I downloaded the corresponding code. However, I encountered some problems in executing some parts of the code. I am grateful to resolve the following ambiguities through your guidance.

1. In Maluuba/newsqa folder after following steps in data requirements, I run data_generator.py, but the number of columns of CSV files created is not equal to newsqa-data-v1.csv. how can I fix this?
2. Is it mandatory to use Docker in this implementation?
   Thanks

[juharris]

Thanks for your interest in NewsQA!

1. The columns for the generated files are different from the columns from newsqa-data-v1.csv since newsqa-data-v1.csv does not have the document/story text. There is nothing to fix.
2. Using Docker is not mandatory.

[shakiba-bakhtiari]

Thank you for your answer. But I still have some ambiguity. By executing this code, in created split data folder, I have three CSV files that contains "story_id", "story_text", "question" and "answer_token_ranges " columns. However, in preparation data operation of AMANDA system, the " story_id", "story_text", "question", "answer_char_ranges", "is_answer_absent ", "is_question_bad" and "validated_answers" columns are used. How can I fix this? I would be forever grateful for your kind help. With warm regards, Shakiba Bakhtiari

…

On Sun, Mar 7, 2021 at 2:29 PM Justin D. Harris ***@***.***> wrote: Thanks for your interest in NewsQA! 1. The columns for the generated files are different from the columns from newsqa-data-v1.csv since newsqa-data-v1.csv does not have the document/story text. There is nothing to fix. 2. Using Docker is not mandatory. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#36 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AS2LWSFVLMFO3UUWHBFBYOLTCP43DANCNFSM4YXZHJPA> .

[juharris]

One of the generated files should have all of those columns. I forgot which one but I can check later if you can't find it. It's probably the one that starts with "combined-" in the filename. The documentation in the README.md should document all these columns.

[shakiba-bakhtiari]

Thank you very much.

…

On Mon, 8 Mar 2021, 17:51 Justin D. Harris, ***@***.***> wrote: One of the generated files should have all of those columns. I forgot which one but I can check later if you can't find it. It's probably the one that starts with "combined-" in the filename. The documentation in the README.md should document all these columns. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#36 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AS2LWSCP427LVBP4ZU5CGQTTCTMONANCNFSM4YXZHJPA> .