Skip to content

Add description of restart files and instructions for changing calend…

Sign in for the full log view
GitHub Actions / Repro Test Results failed Jan 26, 2026 in 0s

2 errors in 3m 2s

2 tests   0 ✅  3m 2s ⏱️
1 suites  0 💤
1 files    0 ❌  2 🔥

Results for commit 33398ab.

Annotations

Check failure on line 0 in test-venv.lib.python3.10.site-packages.model_config_tests.config_tests.test_bit_reproducibility.TestBitReproducibility

See this annotation in the file changed.

@github-actions github-actions / Repro Test Results

test_repro_historical (test-venv.lib.python3.10.site-packages.model_config_tests.config_tests.test_bit_reproducibility.TestBitReproducibility) with error 

/opt/testing/checksum/test_report.xml [took 3m 0s]
Raw output 
failed on setup with "RuntimeError: There was an error running experiment exp_default_runtime: Payu run job failed with exit status 1:
Job_ID: 159340242.gadi-pbs
Output files: ['/scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_default_runtime/pre-industrial.o159340242', '/scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_default_runtime/pre-industrial.e159340242']
--- stdout ---
laboratory path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab
binary path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/bin
input path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/input
work path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work
archive path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/archive
Experiment name is configured in config.yaml:  exp_default_runtime
nruns: 1 nruns_per_submit: 1 subrun: 1
payu: Found modules in /opt/Modules/v4.3.0
Loading input manifest: manifests/input.yaml
Loading restart manifest: manifests/restart.yaml
Loading exe manifest: manifests/exe.yaml
Setting up atmosphere
Setting up ocean
Setting up ice
Setting up coupler
Checking exe, input and restart manifests
mod access-esm1p6/dependencies/pr181-2/oasis3-mct/OASIS3-MCT_5.2-sm7ksjm
mod access-esm1p6/dependencies/pr181-2/cice5/access-esm1.6-2025.11.001-wfnrfml
mod access-esm1p6/dependencies/pr181-2/access-fms/mom5-2025.08.000-ltn3e2q
mod access-esm1p6/dependencies/pr181-2/access-mocsy/2025.07.002-ejsylbt
mod access-esm1p6/dependencies/pr181-2/access-generic-tracers/2025.09.000-x2czqdx
mod access-esm1p6/dependencies/pr181-2/mom5/2025.05.000-e3fa5ml
mod access-esm1p6/dependencies/pr181-2/cable/2025.11.000-7ey6m4f
mod access-esm1p6/dependencies/pr181-2/gcom4/2025.08.000-qhkz6ut
mod access-esm1p6/dependencies/pr181-2/um7/2025.12.000-yhsp33y
mod access-esm1p6/pr181-2
mpirun --mca mpi_yield_when_idle true -wdir /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_default_runtime/atmosphere -np 256  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_default_runtime/atmosphere/um_hg3.exe : -wdir /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_default_runtime/ocean -np 240  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_default_runtime/ocean/mom5_access_cm : -wdir /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_default_runtime/ice -np 12  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_default_runtime/ice/cice_access-esm1.6_360x300_12x1_12p.exe
/scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_default_runtime/access-esm1.6.err /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/archive/exp_default_runtime/error_logs/access-esm1.6.159340242.gadi-pbs.err
/scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_default_runtime/access-esm1.6.out /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/archive/exp_default_runtime/error_logs/access-esm1.6.159340242.gadi-pbs.out
/scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_default_runtime/env.yaml /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/archive/exp_default_runtime/error_logs/env.159340242.gadi-pbs.yaml

======================================================================================
                  Resource Usage on 2026-01-27 10:57:54:
   Job Id:             159340242.gadi-pbs
   Project:            tm70
   Exit Status:        1
   Service Units:      13.29
   NCPUs Requested:    520                 CPU Time Used: 02:36:49        
   Memory Requested:   2.5TB                 Memory Used: 177.52GB        
   Walltime Requested: 02:30:00            Walltime Used: 00:00:46        
   JobFS Requested:    1.46GB                 JobFS Used: 4.53MB          
======================================================================================

--- stderr ---
Loading access-esm1p6/pr181-2
  Loading requirement:
    access-esm1p6/dependencies/pr181-2/oasis3-mct/OASIS3-MCT_5.2-sm7ksjm
    access-esm1p6/dependencies/pr181-2/cice5/access-esm1.6-2025.11.001-wfnrfml
    access-esm1p6/dependencies/pr181-2/access-fms/mom5-2025.08.000-ltn3e2q
    access-esm1p6/dependencies/pr181-2/access-mocsy/2025.07.002-ejsylbt
    access-esm1p6/dependencies/pr181-2/access-generic-tracers/2025.09.000-x2czqdx access-esm1p6/dependencies/pr181-2/mom5/2025.05.000-e3fa5ml access-esm1p6/dependencies/pr181-2/cable/2025.11.000-7ey6m4f access-esm1p6/dependencies/pr181-2/gcom4/2025.08.000-qhkz6ut access-esm1p6/dependencies/pr181-2/um7/2025.12.000-yhsp33y
Currently Loaded Modulefiles:
 1) access-esm1p6/dependencies/pr181-2/oasis3-mct/OASIS3-MCT_5.2-sm7ksjm           
 2) access-esm1p6/dependencies/pr181-2/cice5/access-esm1.6-2025.11.001-wfnrfml     
 3) access-esm1p6/dependencies/pr181-2/access-fms/mom5-2025.08.000-ltn3e2q         
 4) access-esm1p6/dependencies/pr181-2/access-mocsy/2025.07.002-ejsylbt            
 5) access-esm1p6/dependencies/pr181-2/access-generic-tracers/2025.09.000-x2czqdx  
 6) access-esm1p6/dependencies/pr181-2/mom5/2025.05.000-e3fa5ml                    
 7) access-esm1p6/dependencies/pr181-2/cable/2025.11.000-7ey6m4f                   
 8) access-esm1p6/dependencies/pr181-2/gcom4/2025.08.000-qhkz6ut                   
 9) access-esm1p6/dependencies/pr181-2/um7/2025.12.000-yhsp33y                     
10) access-esm1p6/pr181-2                                                          
11) pbs                                                                            
12) openmpi/5.0.8                                                                  
payu: Model exited with error code 1; aborting."
request = <SubRequest 'requested_experiments' for <Function test_repro_historical>>
experiments = <model_config_tests.exp_test_helper.Experiments object at 0x7f34272e8ee0>

    @pytest.fixture
    def requested_experiments(request, experiments: Experiments):
        """Fixture to check that requested experiments have run successfully
        and return a dictionary of ExpTestHelper instances for each experiment."""
        exp_marker = request.node.get_closest_marker("experiments").args[0]
        requested_exps = {}
        for exp_name in exp_marker:
            # Check experiment has run successfully - this will raise an
            # error if there are any non-zero exit codes in the outputs
>           experiments.check_experiment(exp_name)

../test-venv/lib/python3.10/site-packages/model_config_tests/config_tests/test_bit_reproducibility.py:159: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <model_config_tests.exp_test_helper.Experiments object at 0x7f34272e8ee0>
exp_name = 'exp_default_runtime'

    def check_experiment(self, exp_name: str) -> None:
        """
        Check whether given experiment name has run successfully
        """
        if exp_name in self.experiment_errors:
>           raise RuntimeError(
                f"There was an error running experiment {exp_name}:"
                f" {self.experiment_errors[exp_name]}"
            )
E           RuntimeError: There was an error running experiment exp_default_runtime: Payu run job failed with exit status 1:
E           Job_ID: 159340242.gadi-pbs
E           Output files: ['/scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_default_runtime/pre-industrial.o159340242', '/scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_default_runtime/pre-industrial.e159340242']
E           --- stdout ---
E           laboratory path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab
E           binary path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/bin
E           input path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/input
E           work path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work
E           archive path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/archive
E           Experiment name is configured in config.yaml:  exp_default_runtime
E           nruns: 1 nruns_per_submit: 1 subrun: 1
E           payu: Found modules in /opt/Modules/v4.3.0
E           Loading input manifest: manifests/input.yaml
E           Loading restart manifest: manifests/restart.yaml
E           Loading exe manifest: manifests/exe.yaml
E           Setting up atmosphere
E           Setting up ocean
E           Setting up ice
E           Setting up coupler
E           Checking exe, input and restart manifests
E           mod access-esm1p6/dependencies/pr181-2/oasis3-mct/OASIS3-MCT_5.2-sm7ksjm
E           mod access-esm1p6/dependencies/pr181-2/cice5/access-esm1.6-2025.11.001-wfnrfml
E           mod access-esm1p6/dependencies/pr181-2/access-fms/mom5-2025.08.000-ltn3e2q
E           mod access-esm1p6/dependencies/pr181-2/access-mocsy/2025.07.002-ejsylbt
E           mod access-esm1p6/dependencies/pr181-2/access-generic-tracers/2025.09.000-x2czqdx
E           mod access-esm1p6/dependencies/pr181-2/mom5/2025.05.000-e3fa5ml
E           mod access-esm1p6/dependencies/pr181-2/cable/2025.11.000-7ey6m4f
E           mod access-esm1p6/dependencies/pr181-2/gcom4/2025.08.000-qhkz6ut
E           mod access-esm1p6/dependencies/pr181-2/um7/2025.12.000-yhsp33y
E           mod access-esm1p6/pr181-2
E           mpirun --mca mpi_yield_when_idle true -wdir /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_default_runtime/atmosphere -np 256  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_default_runtime/atmosphere/um_hg3.exe : -wdir /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_default_runtime/ocean -np 240  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_default_runtime/ocean/mom5_access_cm : -wdir /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_default_runtime/ice -np 12  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_default_runtime/ice/cice_access-esm1.6_360x300_12x1_12p.exe
E           /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_default_runtime/access-esm1.6.err /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/archive/exp_default_runtime/error_logs/access-esm1.6.159340242.gadi-pbs.err
E           /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_default_runtime/access-esm1.6.out /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/archive/exp_default_runtime/error_logs/access-esm1.6.159340242.gadi-pbs.out
E           /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_default_runtime/env.yaml /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/archive/exp_default_runtime/error_logs/env.159340242.gadi-pbs.yaml
E           
E           ======================================================================================
E                             Resource Usage on 2026-01-27 10:57:54:
E              Job Id:             159340242.gadi-pbs
E              Project:            tm70
E              Exit Status:        1
E              Service Units:      13.29
E              NCPUs Requested:    520                 CPU Time Used: 02:36:49        
E              Memory Requested:   2.5TB                 Memory Used: 177.52GB        
E              Walltime Requested: 02:30:00            Walltime Used: 00:00:46        
E              JobFS Requested:    1.46GB                 JobFS Used: 4.53MB          
E           ======================================================================================
E           
E           --- stderr ---
E           Loading access-esm1p6/pr181-2
E             Loading requirement:
E               access-esm1p6/dependencies/pr181-2/oasis3-mct/OASIS3-MCT_5.2-sm7ksjm
E               access-esm1p6/dependencies/pr181-2/cice5/access-esm1.6-2025.11.001-wfnrfml
E               access-esm1p6/dependencies/pr181-2/access-fms/mom5-2025.08.000-ltn3e2q
E               access-esm1p6/dependencies/pr181-2/access-mocsy/2025.07.002-ejsylbt
E               access-esm1p6/dependencies/pr181-2/access-generic-tracers/2025.09.000-x2czqdx access-esm1p6/dependencies/pr181-2/mom5/2025.05.000-e3fa5ml access-esm1p6/dependencies/pr181-2/cable/2025.11.000-7ey6m4f access-esm1p6/dependencies/pr181-2/gcom4/2025.08.000-qhkz6ut access-esm1p6/dependencies/pr181-2/um7/2025.12.000-yhsp33y
E           Currently Loaded Modulefiles:
E            1) access-esm1p6/dependencies/pr181-2/oasis3-mct/OASIS3-MCT_5.2-sm7ksjm           
E            2) access-esm1p6/dependencies/pr181-2/cice5/access-esm1.6-2025.11.001-wfnrfml     
E            3) access-esm1p6/dependencies/pr181-2/access-fms/mom5-2025.08.000-ltn3e2q         
E            4) access-esm1p6/dependencies/pr181-2/access-mocsy/2025.07.002-ejsylbt            
E            5) access-esm1p6/dependencies/pr181-2/access-generic-tracers/2025.09.000-x2czqdx  
E            6) access-esm1p6/dependencies/pr181-2/mom5/2025.05.000-e3fa5ml                    
E            7) access-esm1p6/dependencies/pr181-2/cable/2025.11.000-7ey6m4f                   
E            8) access-esm1p6/dependencies/pr181-2/gcom4/2025.08.000-qhkz6ut                   
E            9) access-esm1p6/dependencies/pr181-2/um7/2025.12.000-yhsp33y                     
E           10) access-esm1p6/pr181-2                                                          
E           11) pbs                                                                            
E           12) openmpi/5.0.8                                                                  
E           payu: Model exited with error code 1; aborting.

../test-venv/lib/python3.10/site-packages/model_config_tests/exp_test_helper.py:318: RuntimeError

Check failure on line 0 in test-venv.lib.python3.10.site-packages.model_config_tests.config_tests.test_bit_reproducibility.TestBitReproducibility

See this annotation in the file changed.

@github-actions github-actions / Repro Test Results

test_repro_determinism (test-venv.lib.python3.10.site-packages.model_config_tests.config_tests.test_bit_reproducibility.TestBitReproducibility) with error 

/opt/testing/checksum/test_report.xml [took 0s]
Raw output 
failed on setup with "RuntimeError: There was an error running experiment exp_1d_runtime: Payu run job failed with exit status 1:
Job_ID: 159340252.gadi-pbs
Output files: ['/scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_1d_runtime/pre-industrial.o159340252', '/scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_1d_runtime/pre-industrial.e159340252']
--- stdout ---
laboratory path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab
binary path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/bin
input path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/input
work path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work
archive path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/archive
Experiment name is configured in config.yaml:  exp_1d_runtime
nruns: 1 nruns_per_submit: 1 subrun: 1
payu: Found modules in /opt/Modules/v4.3.0
Loading input manifest: manifests/input.yaml
Loading restart manifest: manifests/restart.yaml
Loading exe manifest: manifests/exe.yaml
Setting up atmosphere
Setting up ocean
Setting up ice
Setting up coupler
Checking exe, input and restart manifests
mod access-esm1p6/dependencies/pr181-2/oasis3-mct/OASIS3-MCT_5.2-sm7ksjm
mod access-esm1p6/dependencies/pr181-2/cice5/access-esm1.6-2025.11.001-wfnrfml
mod access-esm1p6/dependencies/pr181-2/access-fms/mom5-2025.08.000-ltn3e2q
mod access-esm1p6/dependencies/pr181-2/access-mocsy/2025.07.002-ejsylbt
mod access-esm1p6/dependencies/pr181-2/access-generic-tracers/2025.09.000-x2czqdx
mod access-esm1p6/dependencies/pr181-2/mom5/2025.05.000-e3fa5ml
mod access-esm1p6/dependencies/pr181-2/cable/2025.11.000-7ey6m4f
mod access-esm1p6/dependencies/pr181-2/gcom4/2025.08.000-qhkz6ut
mod access-esm1p6/dependencies/pr181-2/um7/2025.12.000-yhsp33y
mod access-esm1p6/pr181-2
mpirun --mca mpi_yield_when_idle true -wdir /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_1d_runtime/atmosphere -np 256  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_1d_runtime/atmosphere/um_hg3.exe : -wdir /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_1d_runtime/ocean -np 240  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_1d_runtime/ocean/mom5_access_cm : -wdir /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_1d_runtime/ice -np 12  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_1d_runtime/ice/cice_access-esm1.6_360x300_12x1_12p.exe
/scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_1d_runtime/access-esm1.6.err /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/archive/exp_1d_runtime/error_logs/access-esm1.6.159340252.gadi-pbs.err
/scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_1d_runtime/access-esm1.6.out /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/archive/exp_1d_runtime/error_logs/access-esm1.6.159340252.gadi-pbs.out
/scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_1d_runtime/env.yaml /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/archive/exp_1d_runtime/error_logs/env.159340252.gadi-pbs.yaml

======================================================================================
                  Resource Usage on 2026-01-27 10:57:54:
   Job Id:             159340252.gadi-pbs
   Project:            tm70
   Exit Status:        1
   Service Units:      13.00
   NCPUs Requested:    520                 CPU Time Used: 02:31:43        
   Memory Requested:   2.5TB                 Memory Used: 177.71GB        
   Walltime Requested: 02:30:00            Walltime Used: 00:00:45        
   JobFS Requested:    1.46GB                 JobFS Used: 4.39MB          
======================================================================================

--- stderr ---
Loading access-esm1p6/pr181-2
  Loading requirement:
    access-esm1p6/dependencies/pr181-2/oasis3-mct/OASIS3-MCT_5.2-sm7ksjm
    access-esm1p6/dependencies/pr181-2/cice5/access-esm1.6-2025.11.001-wfnrfml
    access-esm1p6/dependencies/pr181-2/access-fms/mom5-2025.08.000-ltn3e2q
    access-esm1p6/dependencies/pr181-2/access-mocsy/2025.07.002-ejsylbt
    access-esm1p6/dependencies/pr181-2/access-generic-tracers/2025.09.000-x2czqdx access-esm1p6/dependencies/pr181-2/mom5/2025.05.000-e3fa5ml access-esm1p6/dependencies/pr181-2/cable/2025.11.000-7ey6m4f access-esm1p6/dependencies/pr181-2/gcom4/2025.08.000-qhkz6ut access-esm1p6/dependencies/pr181-2/um7/2025.12.000-yhsp33y
Currently Loaded Modulefiles:
 1) access-esm1p6/dependencies/pr181-2/oasis3-mct/OASIS3-MCT_5.2-sm7ksjm           
 2) access-esm1p6/dependencies/pr181-2/cice5/access-esm1.6-2025.11.001-wfnrfml     
 3) access-esm1p6/dependencies/pr181-2/access-fms/mom5-2025.08.000-ltn3e2q         
 4) access-esm1p6/dependencies/pr181-2/access-mocsy/2025.07.002-ejsylbt            
 5) access-esm1p6/dependencies/pr181-2/access-generic-tracers/2025.09.000-x2czqdx  
 6) access-esm1p6/dependencies/pr181-2/mom5/2025.05.000-e3fa5ml                    
 7) access-esm1p6/dependencies/pr181-2/cable/2025.11.000-7ey6m4f                   
 8) access-esm1p6/dependencies/pr181-2/gcom4/2025.08.000-qhkz6ut                   
 9) access-esm1p6/dependencies/pr181-2/um7/2025.12.000-yhsp33y                     
10) access-esm1p6/pr181-2                                                          
11) pbs                                                                            
12) openmpi/5.0.8                                                                  
payu: Model exited with error code 1; aborting."
request = <SubRequest 'requested_experiments' for <Function test_repro_determinism>>
experiments = <model_config_tests.exp_test_helper.Experiments object at 0x7f34272e8ee0>

    @pytest.fixture
    def requested_experiments(request, experiments: Experiments):
        """Fixture to check that requested experiments have run successfully
        and return a dictionary of ExpTestHelper instances for each experiment."""
        exp_marker = request.node.get_closest_marker("experiments").args[0]
        requested_exps = {}
        for exp_name in exp_marker:
            # Check experiment has run successfully - this will raise an
            # error if there are any non-zero exit codes in the outputs
>           experiments.check_experiment(exp_name)

../test-venv/lib/python3.10/site-packages/model_config_tests/config_tests/test_bit_reproducibility.py:159: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <model_config_tests.exp_test_helper.Experiments object at 0x7f34272e8ee0>
exp_name = 'exp_1d_runtime'

    def check_experiment(self, exp_name: str) -> None:
        """
        Check whether given experiment name has run successfully
        """
        if exp_name in self.experiment_errors:
>           raise RuntimeError(
                f"There was an error running experiment {exp_name}:"
                f" {self.experiment_errors[exp_name]}"
            )
E           RuntimeError: There was an error running experiment exp_1d_runtime: Payu run job failed with exit status 1:
E           Job_ID: 159340252.gadi-pbs
E           Output files: ['/scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_1d_runtime/pre-industrial.o159340252', '/scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_1d_runtime/pre-industrial.e159340252']
E           --- stdout ---
E           laboratory path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab
E           binary path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/bin
E           input path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/input
E           work path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work
E           archive path:  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/archive
E           Experiment name is configured in config.yaml:  exp_1d_runtime
E           nruns: 1 nruns_per_submit: 1 subrun: 1
E           payu: Found modules in /opt/Modules/v4.3.0
E           Loading input manifest: manifests/input.yaml
E           Loading restart manifest: manifests/restart.yaml
E           Loading exe manifest: manifests/exe.yaml
E           Setting up atmosphere
E           Setting up ocean
E           Setting up ice
E           Setting up coupler
E           Checking exe, input and restart manifests
E           mod access-esm1p6/dependencies/pr181-2/oasis3-mct/OASIS3-MCT_5.2-sm7ksjm
E           mod access-esm1p6/dependencies/pr181-2/cice5/access-esm1.6-2025.11.001-wfnrfml
E           mod access-esm1p6/dependencies/pr181-2/access-fms/mom5-2025.08.000-ltn3e2q
E           mod access-esm1p6/dependencies/pr181-2/access-mocsy/2025.07.002-ejsylbt
E           mod access-esm1p6/dependencies/pr181-2/access-generic-tracers/2025.09.000-x2czqdx
E           mod access-esm1p6/dependencies/pr181-2/mom5/2025.05.000-e3fa5ml
E           mod access-esm1p6/dependencies/pr181-2/cable/2025.11.000-7ey6m4f
E           mod access-esm1p6/dependencies/pr181-2/gcom4/2025.08.000-qhkz6ut
E           mod access-esm1p6/dependencies/pr181-2/um7/2025.12.000-yhsp33y
E           mod access-esm1p6/pr181-2
E           mpirun --mca mpi_yield_when_idle true -wdir /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_1d_runtime/atmosphere -np 256  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_1d_runtime/atmosphere/um_hg3.exe : -wdir /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_1d_runtime/ocean -np 240  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_1d_runtime/ocean/mom5_access_cm : -wdir /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_1d_runtime/ice -np 12  /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/work/exp_1d_runtime/ice/cice_access-esm1.6_360x300_12x1_12p.exe
E           /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_1d_runtime/access-esm1.6.err /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/archive/exp_1d_runtime/error_logs/access-esm1.6.159340252.gadi-pbs.err
E           /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_1d_runtime/access-esm1.6.out /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/archive/exp_1d_runtime/error_logs/access-esm1.6.159340252.gadi-pbs.out
E           /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/control/exp_1d_runtime/env.yaml /scratch/tm70/repro-ci/experiments/access-esm1.6-configs/c24c59ef2c6a2f25e5d5fc6511634cb846080a84/lab/archive/exp_1d_runtime/error_logs/env.159340252.gadi-pbs.yaml
E           
E           ======================================================================================
E                             Resource Usage on 2026-01-27 10:57:54:
E              Job Id:             159340252.gadi-pbs
E              Project:            tm70
E              Exit Status:        1
E              Service Units:      13.00
E              NCPUs Requested:    520                 CPU Time Used: 02:31:43        
E              Memory Requested:   2.5TB                 Memory Used: 177.71GB        
E              Walltime Requested: 02:30:00            Walltime Used: 00:00:45        
E              JobFS Requested:    1.46GB                 JobFS Used: 4.39MB          
E           ======================================================================================
E           
E           --- stderr ---
E           Loading access-esm1p6/pr181-2
E             Loading requirement:
E               access-esm1p6/dependencies/pr181-2/oasis3-mct/OASIS3-MCT_5.2-sm7ksjm
E               access-esm1p6/dependencies/pr181-2/cice5/access-esm1.6-2025.11.001-wfnrfml
E               access-esm1p6/dependencies/pr181-2/access-fms/mom5-2025.08.000-ltn3e2q
E               access-esm1p6/dependencies/pr181-2/access-mocsy/2025.07.002-ejsylbt
E               access-esm1p6/dependencies/pr181-2/access-generic-tracers/2025.09.000-x2czqdx access-esm1p6/dependencies/pr181-2/mom5/2025.05.000-e3fa5ml access-esm1p6/dependencies/pr181-2/cable/2025.11.000-7ey6m4f access-esm1p6/dependencies/pr181-2/gcom4/2025.08.000-qhkz6ut access-esm1p6/dependencies/pr181-2/um7/2025.12.000-yhsp33y
E           Currently Loaded Modulefiles:
E            1) access-esm1p6/dependencies/pr181-2/oasis3-mct/OASIS3-MCT_5.2-sm7ksjm           
E            2) access-esm1p6/dependencies/pr181-2/cice5/access-esm1.6-2025.11.001-wfnrfml     
E            3) access-esm1p6/dependencies/pr181-2/access-fms/mom5-2025.08.000-ltn3e2q         
E            4) access-esm1p6/dependencies/pr181-2/access-mocsy/2025.07.002-ejsylbt            
E            5) access-esm1p6/dependencies/pr181-2/access-generic-tracers/2025.09.000-x2czqdx  
E            6) access-esm1p6/dependencies/pr181-2/mom5/2025.05.000-e3fa5ml                    
E            7) access-esm1p6/dependencies/pr181-2/cable/2025.11.000-7ey6m4f                   
E            8) access-esm1p6/dependencies/pr181-2/gcom4/2025.08.000-qhkz6ut                   
E            9) access-esm1p6/dependencies/pr181-2/um7/2025.12.000-yhsp33y                     
E           10) access-esm1p6/pr181-2                                                          
E           11) pbs                                                                            
E           12) openmpi/5.0.8                                                                  
E           payu: Model exited with error code 1; aborting.

../test-venv/lib/python3.10/site-packages/model_config_tests/exp_test_helper.py:318: RuntimeError

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / Repro Test Results

2 tests found 

There are 2 tests, see "Raw output" for the full list of tests.
Raw output 
test-venv.lib.python3.10.site-packages.model_config_tests.config_tests.test_bit_reproducibility.TestBitReproducibility ‑ test_repro_determinism
test-venv.lib.python3.10.site-packages.model_config_tests.config_tests.test_bit_reproducibility.TestBitReproducibility ‑ test_repro_historical
View more details on GitHub Actions
⚡