Skip to content

Increase jobfs to prevent exceeding the limit#484

Merged
blimlim merged 1 commit intodev-preindustrial+concentrationsfrom
475-jobfs
Feb 24, 2026
Merged

Increase jobfs to prevent exceeding the limit#484
blimlim merged 1 commit intodev-preindustrial+concentrationsfrom
475-jobfs

Conversation

@blimlim
Copy link
Copy Markdown
Collaborator

@blimlim blimlim commented Feb 24, 2026

1. Summary:

The historical configuration occasionally crashes due to exceeding the jobfs limit. This PR increases it from 1500MB -> 15GB, for the preindustrial configuration. This change will then be cherry-picked over to the other configurations.

2. Issues Addressed:

3. Dependencies (e.g. on payu, or model)

This change requires changes to (note pull request(s) where relevant):

  • workflow manager (payu):
  • model deployment (ACCESS-ESM1.6):
  • model component or library dependency:
  • input workflow:

4. Ad-hoc Testing

What ad-hoc testing was done? How are you convinced this change is correct (plots are good)?

Testing with a 1 month simulation shows that there are no issues with running the model

5. CI Testing

  • !test repro has been run

6. Reproducibility

Is this reproducible with the previous commit? (If not, why not?)

  • Yes
  • No - !test repro commit has been run.

7. Performance

Has the model performance (say, throughput of model-years/wall-day) changed?

  • Yes
  • No
  • N/A (if selected, please add a brief explanation why performance testing is not necessary for this PR)

Change not expected to affect performance

If yes, provide the numbers from your testing. Is the performance better or worse?

8. Manifests

Have you changed the executable, the input files and/or the restart files?

  • Yes
  • No

If yes, have you updated the manifests?

  • Yes
  • No

To update the manifests, run payu setup (in a cloned copy of your feature branch) with reproducibility tests turned off:

manifest:
  reproduce:
    exe: false
    input: false
    restart: false
runlog:
  enable: false

Then commit the newly created manifest files (under manifests/) only to the branch for this PR.

9. Documentation

Is the documentation updated?

  • Yes
  • N/A

10. Merge Strategy

  • Merge commit
  • Rebase and merge
  • Squash

@blimlim
Copy link
Copy Markdown
Collaborator Author

blimlim commented Feb 24, 2026

!test repro

@github-actions
Copy link
Copy Markdown

✅ The Bitwise Reproducibility Check Succeeded ✅

When comparing:

  • 475-jobfs (checksums created using commit 800eb88), against
  • dev-preindustrial+concentrations (checksums in commit 48c6c30)
Further information

The experiment can be found on Gadi at /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/800eb88623a545431c6e65bd9968b8b969e95079, and the test results at https://github.com/ACCESS-NRI/access-esm1.6-configs/runs/64758819037.

The checksums generated by this !test command are found in the testing/checksum directory of https://github.com/ACCESS-NRI/access-esm1.6-configs/actions/runs/22373515504/artifacts/5644386257.

The checksums compared against are found here https://github.com/ACCESS-NRI/access-esm1.6-configs/tree/48c6c305b5df2361946cd4a6b4d9171d14be71e6/testing/checksum

Test summary:
test_repro_historical
test_repro_determinism

Copy link
Copy Markdown
Collaborator

@manodeep manodeep left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@blimlim blimlim merged commit eb42166 into dev-preindustrial+concentrations Feb 24, 2026
12 checks passed
@blimlim blimlim deleted the 475-jobfs branch February 24, 2026 23:12
@blimlim
Copy link
Copy Markdown
Collaborator Author

blimlim commented Feb 24, 2026

!cherry-pick eb42166 into dev-flat10 dev-preindustrial+emissions dev-historical+concentrations dev-amip dev-1pctCO2 1pctCO2-bgc 1pctCO2-rad dev-4xCO2+concentrations dev-preindustrial+concentrations+CN test-historical+emissions

@github-actions
Copy link
Copy Markdown

!cherry-pick eb42166 into dev-flat10 dev-preindustrial+emissions dev-historical+concentrations dev-amip dev-1pctCO2 1pctCO2-bgc 1pctCO2-rad dev-4xCO2+concentrations dev-preindustrial+concentrations+CN test-historical+emissions

Automatic cherry-pick failed. Could not find branch(es) 1pctCO2-bgc 1pctCO2-rad in repository.

@blimlim
Copy link
Copy Markdown
Collaborator Author

blimlim commented Feb 24, 2026

!cherry-pick eb42166 into dev-flat10 dev-preindustrial+emissions dev-historical+concentrations dev-amip dev-1pctCO2 dev-1pctCO2-bgc dev-1pctCO2-rad dev-4xCO2+concentrations dev-preindustrial+concentrations+CN test-historical+emissions

@github-actions
Copy link
Copy Markdown

!cherry-pick eb42166 into dev-flat10 dev-preindustrial+emissions dev-historical+concentrations dev-amip dev-1pctCO2 dev-1pctCO2-bgc dev-1pctCO2-rad dev-4xCO2+concentrations dev-preindustrial+concentrations+CN test-historical+emissions

Automatic cherry-pick failed. Could not find commit(s) https://github.com/ACCESS-NRI/access-esm1.6-configs/commit/eb42166b7f2d0c9511d1534d25d661a72c3a6974 in dev-preindustrial+concentrations.

@blimlim
Copy link
Copy Markdown
Collaborator Author

blimlim commented Feb 24, 2026

!cherry-pick eb42166 into dev-flat10 dev-preindustrial+emissions dev-historical+concentrations dev-amip dev-1pctCO2 dev-1pctCO2-bgc dev-1pctCO2-rad dev-4xCO2+concentrations dev-preindustrial+concentrations+CN test-historical+emissions

@github-actions
Copy link
Copy Markdown

Automatic Git cherry-picking of commit(s) eb42166 into test-historical+emissions was successful.

The new pull request can be reviewed and approved here.

@github-actions
Copy link
Copy Markdown

Automatic Git cherry-picking of commit(s) eb42166 into dev-flat10 was successful.

The new pull request can be reviewed and approved here.

@github-actions
Copy link
Copy Markdown

Automatic Git cherry-picking of commit(s) eb42166 into dev-preindustrial+emissions was successful.

The new pull request can be reviewed and approved here.

@github-actions
Copy link
Copy Markdown

Automatic Git cherry-picking of commit(s) eb42166 into dev-1pctCO2-bgc was successful.

The new pull request can be reviewed and approved here.

@github-actions
Copy link
Copy Markdown

Automatic Git cherry-picking of commit(s) eb42166 into dev-1pctCO2-rad was successful.

The new pull request can be reviewed and approved here.

@github-actions
Copy link
Copy Markdown

Automatic Git cherry-picking of commit(s) eb42166 into dev-amip was successful.

The new pull request can be reviewed and approved here.

@github-actions
Copy link
Copy Markdown

Automatic Git cherry-picking of commit(s) eb42166 into dev-historical+concentrations was successful.

The new pull request can be reviewed and approved here.

@github-actions
Copy link
Copy Markdown

Automatic Git cherry-picking of commit(s) eb42166 into dev-preindustrial+concentrations+CN was successful.

The new pull request can be reviewed and approved here.

@github-actions
Copy link
Copy Markdown

Automatic Git cherry-picking of commit(s) eb42166 into dev-1pctCO2 was successful.

The new pull request can be reviewed and approved here.

@github-actions
Copy link
Copy Markdown

Automatic Git cherry-picking of commit(s) eb42166 into dev-4xCO2+concentrations was successful.

The new pull request can be reviewed and approved here.

blimlim added a commit that referenced this pull request Feb 24, 2026
Co-authored-by: Spencer Wong <88933912+blimlim@users.noreply.github.com>
blimlim added a commit that referenced this pull request Feb 24, 2026
Co-authored-by: Spencer Wong <88933912+blimlim@users.noreply.github.com>
blimlim added a commit that referenced this pull request Feb 24, 2026
Co-authored-by: Spencer Wong <88933912+blimlim@users.noreply.github.com>
blimlim added a commit that referenced this pull request Feb 24, 2026
Co-authored-by: Spencer Wong <88933912+blimlim@users.noreply.github.com>
blimlim added a commit that referenced this pull request Feb 24, 2026
Co-authored-by: Spencer Wong <88933912+blimlim@users.noreply.github.com>
blimlim added a commit that referenced this pull request Feb 24, 2026
Co-authored-by: Spencer Wong <88933912+blimlim@users.noreply.github.com>
blimlim added a commit that referenced this pull request Feb 24, 2026
Co-authored-by: Spencer Wong <88933912+blimlim@users.noreply.github.com>
blimlim added a commit that referenced this pull request Feb 24, 2026
Co-authored-by: Spencer Wong <88933912+blimlim@users.noreply.github.com>
blimlim added a commit that referenced this pull request Feb 24, 2026
Co-authored-by: Spencer Wong <88933912+blimlim@users.noreply.github.com>
blimlim added a commit that referenced this pull request Feb 24, 2026
Co-authored-by: Spencer Wong <88933912+blimlim@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants