Skip to content

Setup scheduled repro tests#343

Merged
anton-seaice merged 7 commits intomainfrom
319-scheduled_repro
Jan 5, 2026
Merged

Setup scheduled repro tests#343
anton-seaice merged 7 commits intomainfrom
319-scheduled_repro

Conversation

@anton-seaice
Copy link
Copy Markdown
Collaborator

Update scheduled repro tests per #319

@anton-seaice
Copy link
Copy Markdown
Collaborator Author

anton-seaice commented Jan 4, 2026

Ran an adhoc test on dev-preindustrial+concentrations and the configured tests pass currently

model-config-tests -m "(repro and (not repro_restart)) or access_esm1p6 or config"
Test session starts (platform: linux, Python 3.12.1, pytest 8.4.1, pytest-sugar 1.0.0)
rootdir: /home/603/as2285/.local/lib/python3.12/site-packages/model_config_tests/config_tests
plugins: sugar-1.0.0, anyio-4.9.0, hypothesis-6.92.6
collected 58 items / 21 deselected / 37 selected

qa/test_access_esm1p6_config.py s✓✓✓✓✓✓✓✓ 24% ██▌
qa/test_config.py ✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓s✓✓✓✓ 95% █████████▌
test_bit_reproducibility.py ✓✓ 100% ██████████
========================================================================================== warnings summary ===========================================================================================
../../../../../../../apps/python3/3.12.1/lib/python3.12/site-packages/dateutil/tz/tz.py:37
/apps/python3/3.12.1/lib/python3.12/site-packages/dateutil/tz/tz.py:37: DeprecationWarning: datetime.datetime.utcfromtimestamp() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.fromtimestamp(timestamp, datetime.UTC).
EPOCH = datetime.datetime.utcfromtimestamp(0)

qa/test_access_esm1p6_config.py::TestAccessEsm1p6::test_access_esm1p6_manifest_exe_in_release_spack_location
/home/603/as2285/.local/lib/python3.12/site-packages/model_config_tests/config_tests/qa/test_access_esm1p6_config.py:105: UserWarning: Target branch is not specified, defaulting to current git branch: dev-preindustrial+concentrations. As some ACCESS-ESM1.6 tests infer information, such as scenario and modifiers, from the target branch name, some tests may not be run. To set use --target-branch flag in pytest call
warnings.warn(

qa/test_config.py::TestConfig::test_model_module_path_is_defined
/home/603/as2285/.local/lib/python3.12/site-packages/model_config_tests/config_tests/qa/test_config.py:50: UserWarning: Target branch is not specified, defaulting to current git branch: dev-preindustrial+concentrations. As some config tests infer config type information from the target branch name, some tests may not be run. To set use --target-branch flag in pytest call
warnings.warn(

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

Results (281.03s (0:04:41)):
35 passed
2 skipped
21 deselected

@anton-seaice anton-seaice self-assigned this Jan 4, 2026
@anton-seaice anton-seaice requested a review from blimlim January 4, 2026 22:35
@anton-seaice anton-seaice marked this pull request as ready for review January 4, 2026 22:36
Copy link
Copy Markdown
Collaborator

@blimlim blimlim left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @anton-seaice, just a couple of quick questions

Comment thread .github/workflows/schedule.yml Outdated
Comment thread config/ci.json Outdated
anton-seaice and others added 2 commits January 5, 2026 13:11
Co-authored-by: Spencer Wong <88933912+blimlim@users.noreply.github.com>
blimlim
blimlim previously approved these changes Jan 5, 2026
Copy link
Copy Markdown
Collaborator

@blimlim blimlim left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @anton-seaice, looks good

@anton-seaice
Copy link
Copy Markdown
Collaborator Author

Could you approve again please ? @blimlim there was a typo

@anton-seaice anton-seaice merged commit cf5624d into main Jan 5, 2026
32 checks passed
@anton-seaice anton-seaice deleted the 319-scheduled_repro branch January 5, 2026 21:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants