Skip to content

Tool testing improvements #117

@mvdbeek

Description

@mvdbeek

These are a couple of things I found while implementing tool tests:

  • tests only run of the test data is available from where the tests are triggered (this should be fixed with a galaxy-lib update containing Unprivileged remote tool tests galaxy#7160)
  • tests seem to require an admin API key, that shouldn't be necessary with Unprivileged remote tool tests galaxy#7160
  • We create a new history for every test, even if this test is for the same tool
  • We just raise JobOutputExceptions, these need to be displayed properly
  • We should have some reporting, ideally re-using some things from planemo (manual planemo test_reports tool_test_output.json works fine)
  • Optionally delete test histories after run
  • Skip tests that use reference data
  • Move to next test when job becomes paused
  • Expose test timeout as command line option

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions