Skip to content

Conversation

bedroge
Copy link
Contributor

@bedroge bedroge commented Sep 29, 2025

This doesn't change any default behavior, but it's needed for the RISC-V bot: RISC-V software is built for /cvmfs/dev.eessi.io/riscv, while using the compat layer and scripts from software.eessi.io. $EESSI_PREFIX is a bit ambiguous in that case, and is currently pointing to /cvmfs/dev.eessi.io/riscv, meaning that the EESSI-extend module will also look there for the init dir (that's where it expects the EB hooks file). This new variable allows us to to override that location.

These two changes were tested in EESSI/dev.eessi.io-riscv#1 (comment), along with some additional changes in https://github.com/EESSI/dev.eessi.io-scripts/blob/main/bot/bot-build-dev.eessi.io.slurm (this needs to actually set that variable).

edit: though not really required, I figured it would be clean to have the EESSI module set EESSI_INIT_PREFIX as well, so I've added that in 1ff11e3. For consistency, I also renamed the local variable eessi_archdetect_prefix to eessi_init_prefix.

@bedroge
Copy link
Contributor Author

bedroge commented Sep 29, 2025

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2
bot: build repo:eessi.io-2025.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2

@eessi-bot-aws
Copy link

eessi-bot-aws bot commented Sep 29, 2025

New job on instance eessi-bot-mc-aws for repository eessi.io-2023.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.09/pr_93/93291

date job status comment
Sep 29 08:22:21 UTC 2025 submitted job id 93291 awaits release by job manager
Sep 29 08:22:51 UTC 2025 released job awaits launch by Slurm scheduler
Sep 29 08:28:57 UTC 2025 running job 93291 is running
Sep 29 08:33:02 UTC 2025 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-93291.out
✅ no message matching FATAL:
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-17591345710.tar.gzsize: 0 MiB (53615 bytes)
entries: 14
modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
EESSI-extend/2023.06-easybuild.lua
software under 2023.06/software/linux/x86_64/amd/zen2/software
EESSI-extend/2023.06-easybuild
reprod directories under 2023.06/software/linux/x86_64/amd/zen2/reprod
no reprod directories in tarball
other under 2023.06/software/linux/x86_64/amd/zen2
2023.06/init/modules/EESSI/2023.06.lua
Sep 29 08:33:02 UTC 2025 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ OK ] ( 1/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos %scale=1_node /aeb2d9df @BotBuildTests:x86_64_amd_zen2+default
P: perf: 430.429 timesteps/s (r:0, l:None, u:None)
[ OK ] ( 2/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:x86_64_amd_zen2+default
P: perf: 441.576 timesteps/s (r:0, l:None, u:None)
[ OK ] ( 3/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /775175bf @BotBuildTests:x86_64_amd_zen2+default
P: latency: 1.8 us (r:0, l:None, u:None)
[ OK ] ( 4/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /52707c40 @BotBuildTests:x86_64_amd_zen2+default
P: latency: 1.91 us (r:0, l:None, u:None)
[ OK ] ( 5/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /b1aacda9 @BotBuildTests:x86_64_amd_zen2+default
P: latency: 3.96 us (r:0, l:None, u:None)
[ OK ] ( 6/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /c6bad193 @BotBuildTests:x86_64_amd_zen2+default
P: latency: 4.22 us (r:0, l:None, u:None)
[ OK ] ( 7/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:x86_64_amd_zen2+default
P: latency: 0.6 us (r:0, l:None, u:None)
[ OK ] ( 8/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:x86_64_amd_zen2+default
P: latency: 0.58 us (r:0, l:None, u:None)
[ OK ] ( 9/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:x86_64_amd_zen2+default
P: bandwidth: 7310.49 MB/s (r:0, l:None, u:None)
[ OK ] (10/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:x86_64_amd_zen2+default
P: bandwidth: 7254.37 MB/s (r:0, l:None, u:None)
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-93291.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@eessi-bot-aws
Copy link

eessi-bot-aws bot commented Sep 29, 2025

New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.09/pr_93/93292

date job status comment
Sep 29 08:22:26 UTC 2025 submitted job id 93292 awaits release by job manager
Sep 29 08:22:49 UTC 2025 released job awaits launch by Slurm scheduler
Sep 29 08:23:54 UTC 2025 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-93292.out
✅ no message matching FATAL:
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2025.06-software-linux-x86_64-amd-zen2-17591342220.tar.gzsize: 0 MiB (45067 bytes)
entries: 14
modules under 2025.06/software/linux/x86_64/amd/zen2/modules/all
EESSI-extend/2025.06-easybuild.lua
software under 2025.06/software/linux/x86_64/amd/zen2/software
EESSI-extend/2025.06-easybuild
reprod directories under 2025.06/software/linux/x86_64/amd/zen2/reprod
no reprod directories in tarball
other under 2025.06/software/linux/x86_64/amd/zen2
2025.06/init/modules/EESSI/2025.06.lua
Sep 29 08:23:54 UTC 2025 test result
😢 FAILURE (click triangle for details)
Reason
EESSI test suite was not run, test step itself failed to execute.
Details
✅ job output file slurm-93292.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@bedroge bedroge added ready-to-deploy 2025.06-software.eessi.io 2025.06 version of software.eessi.io 2023.06-software.eessi.io 2023.06 version of software.eessi.io and removed ready-to-deploy labels Sep 29, 2025
@bedroge
Copy link
Contributor Author

bedroge commented Sep 29, 2025

Removed the ready-to-deploy label, need to do a similar change to the bash init scripts (that's what the CI is complaining about).

@bedroge
Copy link
Contributor Author

bedroge commented Sep 29, 2025

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2
bot: build repo:eessi.io-2025.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2

@eessi-bot-aws
Copy link

eessi-bot-aws bot commented Sep 29, 2025

New job on instance eessi-bot-mc-aws for repository eessi.io-2023.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.09/pr_93/93311

date job status comment
Sep 29 14:48:42 UTC 2025 submitted job id 93311 awaits release by job manager
Sep 29 14:49:15 UTC 2025 released job awaits launch by Slurm scheduler
Sep 29 14:54:21 UTC 2025 running job 93311 is running
Sep 29 14:59:30 UTC 2025 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-93311.out
✅ no message matching FATAL:
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-17591577350.tar.gzsize: 0 MiB (54061 bytes)
entries: 15
modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
EESSI-extend/2023.06-easybuild.lua
software under 2023.06/software/linux/x86_64/amd/zen2/software
EESSI-extend/2023.06-easybuild
reprod directories under 2023.06/software/linux/x86_64/amd/zen2/reprod
no reprod directories in tarball
other under 2023.06/software/linux/x86_64/amd/zen2
2023.06/init/eessi_defaults
2023.06/init/modules/EESSI/2023.06.lua
Sep 29 14:59:30 UTC 2025 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ OK ] ( 1/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos %scale=1_node /aeb2d9df @BotBuildTests:x86_64_amd_zen2+default
P: perf: 441.608 timesteps/s (r:0, l:None, u:None)
[ OK ] ( 2/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:x86_64_amd_zen2+default
P: perf: 445.467 timesteps/s (r:0, l:None, u:None)
[ OK ] ( 3/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /775175bf @BotBuildTests:x86_64_amd_zen2+default
P: latency: 2.09 us (r:0, l:None, u:None)
[ OK ] ( 4/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /52707c40 @BotBuildTests:x86_64_amd_zen2+default
P: latency: 1.76 us (r:0, l:None, u:None)
[ OK ] ( 5/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /b1aacda9 @BotBuildTests:x86_64_amd_zen2+default
P: latency: 3.97 us (r:0, l:None, u:None)
[ OK ] ( 6/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /c6bad193 @BotBuildTests:x86_64_amd_zen2+default
P: latency: 4.05 us (r:0, l:None, u:None)
[ OK ] ( 7/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:x86_64_amd_zen2+default
P: latency: 0.58 us (r:0, l:None, u:None)
[ OK ] ( 8/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:x86_64_amd_zen2+default
P: latency: 0.59 us (r:0, l:None, u:None)
[ OK ] ( 9/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:x86_64_amd_zen2+default
P: bandwidth: 7395.56 MB/s (r:0, l:None, u:None)
[ OK ] (10/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:x86_64_amd_zen2+default
P: bandwidth: 7437.27 MB/s (r:0, l:None, u:None)
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-93311.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@eessi-bot-aws
Copy link

eessi-bot-aws bot commented Sep 29, 2025

New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.09/pr_93/93312

date job status comment
Sep 29 14:48:47 UTC 2025 submitted job id 93312 awaits release by job manager
Sep 29 14:49:13 UTC 2025 released job awaits launch by Slurm scheduler
Sep 29 14:54:19 UTC 2025 running job 93312 is running
Sep 29 14:55:24 UTC 2025 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-93312.out
✅ no message matching FATAL:
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2025.06-software-linux-x86_64-amd-zen2-17591576820.tar.gzsize: 0 MiB (45595 bytes)
entries: 15
modules under 2025.06/software/linux/x86_64/amd/zen2/modules/all
EESSI-extend/2025.06-easybuild.lua
software under 2025.06/software/linux/x86_64/amd/zen2/software
EESSI-extend/2025.06-easybuild
reprod directories under 2025.06/software/linux/x86_64/amd/zen2/reprod
no reprod directories in tarball
other under 2025.06/software/linux/x86_64/amd/zen2
2025.06/init/eessi_defaults
2025.06/init/modules/EESSI/2025.06.lua
Sep 29 14:55:24 UTC 2025 test result
😢 FAILURE (click triangle for details)
Reason
EESSI test suite was not run, test step itself failed to execute.
Details
✅ job output file slurm-93312.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@bedroge
Copy link
Contributor Author

bedroge commented Sep 30, 2025

Tested the additional changes in the init scripts with the EESSI container on a RISC-V system:

2023.06:

Singularity> source /cvmfs/software.eessi.io/versions/2023.06/init/bash
RISC-V architecture detected, but there is no RISC-V support yet in the production repository.
Automatically switching to version 20240402 of the RISC-V development repository /cvmfs/riscv.eessi.io.
For more details about this repository, see https://www.eessi.io/docs/repositories/riscv.eessi.io/.

Found EESSI repo @ /cvmfs/riscv.eessi.io/versions/20240402!
archdetect says riscv64/generic
archdetect could not detect any accelerators
Using riscv64/generic as software subdirectory.
Found Lmod configuration file at /cvmfs/riscv.eessi.io/versions/20240402/software/linux/riscv64/generic/.lmod/lmodrc.lua
Found Lmod SitePackage.lua file at /cvmfs/riscv.eessi.io/versions/20240402/software/linux/riscv64/generic/.lmod/SitePackage.lua
Using /cvmfs/riscv.eessi.io/host_injections/20240402/software/linux/riscv64/generic as the site extension directory for installations.
Using  as the site extension directory for accelerated installations.
Using /cvmfs/riscv.eessi.io/versions/20240402/software/linux/riscv64/generic/modules/all as the directory to be added to MODULEPATH.
Using /cvmfs/riscv.eessi.io/host_injections/20240402/software/linux/riscv64/generic/modules/all as the site extension directory to be added to MODULEPATH.
Initializing Lmod...
Prepending /cvmfs/riscv.eessi.io/versions/20240402/software/linux/riscv64/generic/modules/all to $MODULEPATH...
Prepending site path /cvmfs/riscv.eessi.io/host_injections/20240402/software/linux/riscv64/generic/modules/all to $MODULEPATH...
Environment set up to use EESSI (20240402), have fun!

{EESSI 20240402} Singularity> echo $EESSI_INIT_PREFIX
/cvmfs/riscv.eessi.io/versions/20240402/init

2025.06:

Singularity> source /cvmfs/software.eessi.io/versions/2025.06/init/bash
This EESSI production version only provides a RISC-V compatibility layer,
software installations are provided by the EESSI development repository at /cvmfs/dev.eessi.io/riscv.
Found EESSI repo @ /cvmfs/dev.eessi.io/riscv/versions/2025.06!
archdetect says riscv64/generic
archdetect could not detect any accelerators
Using riscv64/generic as software subdirectory.
ERROR: Lmod configuration file not found at /cvmfs/dev.eessi.io/riscv/versions/2025.06/software/linux/riscv64/generic/.lmod/lmodrc.lua
ERROR: Lmod SitePackage.lua file not found at /cvmfs/dev.eessi.io/riscv/versions/2025.06/software/linux/riscv64/generic/.lmod/SitePackage.lua
Using /cvmfs/dev.eessi.io/riscv/host_injections/2025.06/software/linux/riscv64/generic as the site extension directory for installations.
Using  as the site extension directory for accelerated installations.
ERROR: EESSI module path at /cvmfs/dev.eessi.io/riscv/versions/2025.06/software/linux/riscv64/generic/modules/all not found!
Initializing Lmod...
Prepending /cvmfs/dev.eessi.io/riscv/versions/2025.06/software/linux/riscv64/generic/modules/all to $MODULEPATH...
Prepending site path  to $MODULEPATH...
Environment set up to use EESSI (2025.06), have fun!

{EESSI 2025.06} Singularity> echo $EESSI_INIT_PREFIX
/cvmfs/software.eessi.io/versions/2025.06/init

2025.06-1:

Singularity> export EESSI_VERSION_OVERRIDE=2025.06-1
Singularity> source /cvmfs/software.eessi.io/versions/2025.06/init/bash
This EESSI production version only provides a RISC-V compatibility layer,
software installations are provided by the EESSI development repository at /cvmfs/dev.eessi.io/riscv.
Found EESSI repo @ /cvmfs/dev.eessi.io/riscv/versions/2025.06-1!
archdetect says riscv64/generic
archdetect could not detect any accelerators
Using riscv64/generic as software subdirectory.
ERROR: Lmod configuration file not found at /cvmfs/dev.eessi.io/riscv/versions/2025.06-1/software/linux/riscv64/generic/.lmod/lmodrc.lua
ERROR: Lmod SitePackage.lua file not found at /cvmfs/dev.eessi.io/riscv/versions/2025.06-1/software/linux/riscv64/generic/.lmod/SitePackage.lua
Using /cvmfs/dev.eessi.io/riscv/host_injections/2025.06-1/software/linux/riscv64/generic as the site extension directory for installations.
Using  as the site extension directory for accelerated installations.
ERROR: EESSI module path at /cvmfs/dev.eessi.io/riscv/versions/2025.06-1/software/linux/riscv64/generic/modules/all not found!
Initializing Lmod...
Prepending /cvmfs/dev.eessi.io/riscv/versions/2025.06-1/software/linux/riscv64/generic/modules/all to $MODULEPATH...
Prepending site path  to $MODULEPATH...
Environment set up to use EESSI (2025.06-1), have fun!

{EESSI 2025.06-1} Singularity> echo $EESSI_INIT_PREFIX
/cvmfs/software.eessi.io/versions/2025.06/init

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
2023.06-software.eessi.io 2023.06 version of software.eessi.io 2025.06-software.eessi.io 2025.06 version of software.eessi.io
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant