tech:slurm
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionNext revisionBoth sides next revision | ||
tech:slurm [2021/02/25 10:25] – [Compute Nodes] kohofer | tech:slurm [2021/03/19 12:28] – [Modules] kohofer | ||
---|---|---|---|
Line 385: | Line 385: | ||
====== Modules ====== | ====== Modules ====== | ||
+ | |||
+ | Add different python versions using spack! | ||
+ | |||
+ | 1. First see which python versions are available: | ||
+ | |||
+ | root@slurm-ctrl: | ||
+ | ==> Safe versions (already checksummed): | ||
+ | 3.8.2 3.7.7 3.7.4 3.7.1 3.6.7 3.6.4 3.6.1 3.5.2 3.4.10 | ||
+ | 3.8.1 3.7.6 3.7.3 3.7.0 3.6.6 3.6.3 3.6.0 3.5.1 3.4.3 | ||
+ | 3.8.0 3.7.5 3.7.2 3.6.8 3.6.5 3.6.2 3.5.7 3.5.0 3.3.6 | ||
+ | ==> Remote versions (not yet checksummed): | ||
+ | 3.10.0a6 | ||
+ | 3.10.0a5 | ||
+ | ... | ||
+ | ... | ||
+ | |||
+ | 2. now select the python version you would like to install: | ||
+ | |||
+ | root@slurm-ctrl: | ||
+ | ==> 23834: Installing libiconv | ||
+ | ==> Using cached archive: / | ||
+ | ==> Staging archive: / | ||
+ | ==> Created stage in / | ||
+ | ==> No patches needed for libiconv | ||
+ | ==> 23834: libiconv: Building libiconv [AutotoolsPackage] | ||
+ | ==> 23834: libiconv: Executing phase: ' | ||
+ | ==> 23834: libiconv: Executing phase: ' | ||
+ | ==> 23834: libiconv: Executing phase: ' | ||
+ | ==> 23834: libiconv: Executing phase: ' | ||
+ | ==> 23834: libiconv: Successfully installed libiconv | ||
+ | Fetch: 0.04s. | ||
+ | [+] / | ||
+ | ==> 23834: Installing libbsd | ||
+ | ... | ||
+ | ... | ||
+ | ... | ||
+ | ==> 23834: Installing python | ||
+ | ==> Fetching https:// | ||
+ | ############################################################################################################ | ||
+ | ==> Staging archive: / | ||
+ | ==> Created stage in / | ||
+ | ==> Ran patch() for python | ||
+ | ==> 23834: python: Building python [AutotoolsPackage] | ||
+ | ==> 23834: python: Executing phase: ' | ||
+ | ==> 23834: python: Executing phase: ' | ||
+ | ==> 23834: python: Executing phase: ' | ||
+ | ==> 23834: python: Executing phase: ' | ||
+ | ==> 23834: python: Successfully installed python | ||
+ | Fetch: 1.81s. | ||
+ | [+] / | ||
+ | |||
+ | |||
+ | This will take some minutes time, depending on the type of version | ||
+ | |||
+ | |||
+ | 3. Now you need to add a modules file | ||
+ | |||
+ | root@slurm-ctrl: | ||
+ | |||
+ | < | ||
+ | #%Module1.0 | ||
+ | proc ModulesHelp { } { | ||
+ | global dotversion | ||
+ | | ||
+ | puts stderr " | ||
+ | } | ||
+ | |||
+ | module-whatis " | ||
+ | |||
+ | set | ||
+ | set-alias | ||
+ | |||
+ | prepend-path | ||
+ | prepend-path | ||
+ | |||
+ | </ | ||
+ | |||
+ | 4. New module should now be available: | ||
+ | |||
+ | root@slurm-ctrl: | ||
+ | -------------------------------------------- / | ||
+ | anaconda3 | ||
+ | bzip | ||
+ | cuda-10.2 | ||
+ | cuda-11.0 | ||
+ | |||
+ | 5. Load the new module | ||
+ | |||
+ | root@slurm-ctrl: | ||
+ | |||
+ | 6. Verify it works | ||
+ | |||
+ | root@slurm-ctrl: | ||
+ | Python 3.8.2 (default, Mar 19 2021, 11:05:37) | ||
+ | [GCC 9.3.0] on linux | ||
+ | Type " | ||
+ | >>> | ||
+ | |||
+ | 7. Unload the new module | ||
+ | |||
+ | module unload python-3.8.2 | ||
+ | |||
===== Python ===== | ===== Python ===== |
/data/www/wiki.inf.unibz.it/data/pages/tech/slurm.txt · Last modified: 2022/11/24 16:17 by kohofer