use new easyblocks and easyconfigs

[puneet336]

Hi Team ,

I am using easybuild 5.1.0

user@server pytorch]$ eb --version
This is EasyBuild 5.1.0 (framework: 5.1.0, easyblocks: 5.1.0) on server

i need to install a newer version of pytorch which is bundled in
https://github.com/easybuilders/easybuild-easyconfigs/archive/refs/tags/easybuild-easyconfigs-v5.3.0.tar.gz
https://github.com/easybuilders/easybuild-easyblocks/archive/refs/tags/easybuild-easyblocks-v5.3.0.tar.gz

i downloaded and extracted these tarballs as:

/home/user/MySoftware/busdev_new/ easybuild-easyblocks-easybuild-easyblocks-v5.3.0
/home/user/MySoftware/busdev_new/easybuild-easyconfigs-easybuild-easyconfigs-v5.3.0
/home/user/MySoftware/busdev_new/pytorch

now while installing using eb, i see following error:

[user@server pytorch]$  eb PyTorch-2.9.1-foss-2024a.eb --robot --robot-paths=/home/user/MySoftware/busdev_new/easybuild-easyconfigs-easybuild-easyconfigs-v5.3.0/easybuild/easyconfigs/
== Temporary log file in case of crash /scratch/tmp/eb-4b4cm3jy/easybuild-cuoycwrw.log
== resolving dependencies ...

WARNING: Use of 1 unknown easyconfig parameters detected in Python-3.12.3-GCCcore-13.3.0.eb: patch_ctypes_ld_library_path
If these are just local variables please rename them to start with 'local_', or try using --fix-deprecated-easyconfigs to do this automatically.
For more information, see https://docs.easybuild.io/easyconfig-files-local-variables/ .

ERROR: Failed to process easyconfig /home/user/MySoftware/busdev_new/easybuild-easyconfigs-easybuild-easyconfigs-v5.3.0/easybuild/easyconfigs/b/BLIS/BLIS-1.0-GCC-13.3.0.eb: No software-specific easyblock 'EB_BLIS' found for BLIS
[user@server pytorch]$

i tried including easyblocks, but i see issue

 eb PyTorch-2.9.1-foss-2024a.eb --robot --robot-paths=/home/user/MySoftware/busdev_new/easybuild-easyconfigs-easybuild-easyconfigs-v5.3.0/easybuild/easyconfigs/ --include-easyblocks /home/user/MySoftware/busdev_new/easybuild-easyblocks-easybuild-easyblocks-v5.3.0/install/lib/python3.9/site-packages/easybuild/easyblocks/
ERROR: Failed to parse configuration options: "No files found using glob pattern '/home/user/MySoftware/busdev_new/easybuild-easyblocks-easybuild-easyblocks-v5.3.0/install/lib/python3.9/site-packages/easybuild/easyblocks/

tried :
/home/user/MySoftware/busdev_new/easybuild-easyblocks-easybuild-easyblocks-v5.3.0/install/lib/python3.9/site-packages/easybuild/easyblocks/
/home/user/MySoftware/busdev_new/easybuild-easyblocks-easybuild-easyblocks-v5.3.0/install/lib/python3.9/site-packages/easybuild/
/home/user/MySoftware/busdev_new/easybuild-easyblocks-easybuild-easyblocks-v5.3.0/

but i see same " "No files found using glob pattern" with all these paths.

Please advice.

[puneet336]

so i tried following and installation works,
seems we can include just one easyblock file? or there is a sifferent syntacx to include multiple?

eb PyTorch-2.9.1-foss-2024a.eb --robot --robot-paths=/home/user/MySoftware/busdev_new/easybuild-easyconfigs-easybuild-easyconfigs-v5.3.0/easybuild/easyconfigs/ --include-easyblocks /home/user/MySoftware/busdev_new/easybuild-easyblocks-easybuild-easyblocks-v5.3.0/install/lib/python3.9/site-packages/easybuild/easyblocks/b/blis.py

[jfgrimm]

is there a reason you're sticking to EB 5.1.0, instead of just installing the latest release (5.3.0)?

[puneet336]

For end users, we maintain EB for atleast 6 months before we upgrade to next stable release.
We plan to upgrade this in next 4 months.

[jfgrimm]

The easyconfigs from newer releases will often rely on features/enhancements/bugfixes in easyblocks and framework. Backporting easyconfigs to older EB releases is of course possible, but it's not something we really support.

If you're already using easyconfigs + easyblocks from a newer release, I don't really see the point in sticking to an older framework version...