Skip to content

add patch to fix flaky scipy build in SciPy-bundle v2023.11#19481

Merged
branfosj merged 2 commits intoeasybuilders:developfrom
boegel:20240103124523_new_pr_SciPy-bundle202311
Jan 3, 2024
Merged

add patch to fix flaky scipy build in SciPy-bundle v2023.11#19481
branfosj merged 2 commits intoeasybuilders:developfrom
boegel:20240103124523_new_pr_SciPy-bundle202311

Conversation

@boegel
Copy link
Copy Markdown
Member

@boegel boegel commented Jan 3, 2024

(created using eb --new-pr)

fixes flaky build problem that seems more likely to occur when using more cores

[140/1620] /software/Python-bundle-PyPI/2023.10-GCCcore-13.2.0/bin/cython -3 --fast-fail --output-file scipy/special/_ellip_harm_2.cpython-311-x86_64-linux-gnu.so.p/_ellip_harm_2.c --include-dir . ../scipy/scipy-1.11.4/scipy/special/_ellip_harm_2.pyx
FAILED: scipy/special/_ellip_harm_2.cpython-311-x86_64-linux-gnu.so.p/_ellip_harm_2.c
/software/Python-bundle-PyPI/2023.10-GCCcore-13.2.0/bin/cython -3 --fast-fail --output-file scipy/special/_ellip_harm_2.cpython-311-x86_64-linux-gnu.so.p/_ellip_harm_2.c --include-dir . ../scipy/scipy-1.11.4/scipy/special/_ellip_harm_2.pyx
 
Error compiling Cython file:
------------------------------------------------------------
...
from scipy.special cimport cython_special
^
------------------------------------------------------------
 
/tmp/easybuild/SciPybundle/2023.11/gfbf-2023b/scipy/scipy-1.11.4/scipy/special.pxd:1:0: 'scipy/special/cython_special.pxd' not found

@boegel boegel added the bug fix label Jan 3, 2024
@boegel boegel added this to the release after 4.9.0 milestone Jan 3, 2024
@boegel
Copy link
Copy Markdown
Member Author

boegel commented Jan 3, 2024

@boegelbot please test @ generoso
CORE_CNT=16

@boegelbot
Copy link
Copy Markdown
Collaborator

@boegel: Request for testing this PR well received on login1

PR test command 'EB_PR=19481 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs /opt/software/slurm/bin/sbatch --job-name test_PR_19481 --ntasks="16" ~/boegelbot/eb_from_pr_upload_generoso.sh' executed!

  • exit code: 0
  • output:
Submitted batch job 12487

Test results coming soon (I hope)...

Details

- notification for comment with ID 1875256274 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

@boegel
Copy link
Copy Markdown
Member Author

boegel commented Jan 3, 2024

@boegelbot please test @ jsc-zen2
CORE_CNT=16

@easybuilders easybuilders deleted a comment from boegelbot Jan 3, 2024
@boegelbot
Copy link
Copy Markdown
Collaborator

@boegel: Request for testing this PR well received on jsczen2l1.int.jsc-zen2.easybuild-test.cluster

PR test command 'EB_PR=19481 EB_ARGS= EB_REPO=easybuild-easyconfigs /opt/software/slurm/bin/sbatch --mem-per-cpu=4000M --job-name test_PR_19481 --ntasks="16" ~/boegelbot/eb_from_pr_upload_jsc-zen2.sh' executed!

  • exit code: 0
  • output:
Submitted batch job 3984

Test results coming soon (I hope)...

Details

- notification for comment with ID 1875304376 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

@boegelbot
Copy link
Copy Markdown
Collaborator

Test report by @boegelbot
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
cnx1 - Linux Rocky Linux 8.5, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8
See https://gist.github.com/boegelbot/c9ffe731011a22ee510e6acad0476dc1 for a full test report.

@boegelbot
Copy link
Copy Markdown
Collaborator

Test report by @boegelbot
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
jsczen2c1.int.jsc-zen2.easybuild-test.cluster - Linux Rocky Linux 8.5, x86_64, AMD EPYC 7742 64-Core Processor (zen2), Python 3.6.8
See https://gist.github.com/boegelbot/9ebd0af1b5b649923aa67d7d4d77d00b for a full test report.

@boegel
Copy link
Copy Markdown
Member Author

boegel commented Jan 3, 2024

Test report by @boegel
SUCCESS
Build succeeded for 6 out of 6 (1 easyconfigs in total)
node3608.doduo.os - Linux RHEL 8.8, x86_64, AMD EPYC 7552 48-Core Processor (zen2), Python 3.6.8
See https://gist.github.com/boegel/251381d9226dddc749a2c45874da718d for a full test report.

@branfosj branfosj merged commit 57671fe into easybuilders:develop Jan 3, 2024
@boegel boegel deleted the 20240103124523_new_pr_SciPy-bundle202311 branch January 3, 2024 14:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants