Differences

This shows you the differences between two versions of the page.

--- tech:slurm [2019/09/06 15:29] – [Compute Nodes] kohofer
+++ tech:slurm [2020/02/07 12:55] – [Controller] kohofer
@@ Line 22: / Line 22: @@
   ssh slurm-ctrl
-  apt install slurm-wlm slurm-wlm-doc mailutils sview mariadb-client mariadb-server libmariadb-dev python-dev python-mysqldb
+  apt install slurm-wlm slurm-wlm-doc mailutils mariadb-client mariadb-server libmariadb-dev python-dev python-mysqldb
 === Install Maria DB Server ===
@@ Line 51: / Line 51: @@
 === Central Controller ===
-The main configuration file is /etc/slurm-llnl/slurm.conf this file has to be present in the controller and all of the compute nodes and it also has to be consistent between all of them.
+The main configuration file is /etc/slurm-llnl/slurm.conf this file has to be present in the controller and *ALL* of the compute nodes and it also has to be consistent between all of them.
   vi /etc/slurm-llnl/slurm.conf
 <code>
@@ Line 114: / Line 114: @@
 </code>
-  root@controller# systemctl start slurmctld
+  root@slurm-ctrl# scp /etc/slurm-llnl/slurm.conf csadmin@10.7.20.109:/tmp/.; scp /etc/slurm-llnl/slurm.conf csadmin@10.7.20.110:/tmp/.
+  root@slurm-ctrl# systemctl daemon-reload
+  root@slurm-ctrl# systemctl enable slurmdbd
+  root@slurm-ctrl# systemctl start slurmdbd
+  root@slurm-ctrl# systemctl enable slurmctld
+  root@slurm-ctrl# systemctl start slurmctld
 === Accounting Storage ===
@@ Line 153: / Line 159: @@
 </code>
-  root@controller# systemctl start slurmdbd
+  root@slurm-ctrl# systemctl start slurmdbd
+=== Authentication ===
+Copy /etc/munge.key to all compute nodes
+  scp /etc/munge/munge.key csadmin@10.7.20.98:/tmp/.
+Allow password-less access to slurm-ctrl
+  csadmin@slurm-ctrl:~$ ssh-copy-id -i .ssh/id_rsa.pub 10.7.20.102:
+Run a job from slurm-ctrl
+  ssh csadmin@slurm-ctrl
+  srun -N 1 hostname
+  linux1
 === Test munge ===
@@ Line 174: / Line 198: @@
 {{:tech:slurm-hpc-cluster_compute-node.png?400|}}
-==== Installation ====
+=== Installation slurm and munge ===
+  ssh -l csadmin <compute-nodes> 10.7.20.109 10.7.20.110
+  sudo apt install slurm-wlm libmunge-dev libmunge2 munge
+  sudo systemctl enable slurmd
+  sudo systemctl enable munge
+  sudo systemctl start slurmd
+  sudo systemctl start munge
-  ssh -l csadmin 10.7.20.102
-  sudo apt install slurm-wlm
 Generate ssh keys
   ssh-keygen
@@ Line 198: / Line 228: @@
 </code>
+First copy the munge keys from the slurm-ctrl to all compute nodes, now fix location,
+owner and permission.
+  mv /tmp/munge.key /etc/munge/.
+  chown munge:munge /etc/munge/munge.key
+  chmod 400 /etc/munge/munge.key
+Place /etc/slurm-llnl/slurm.conf in right place,
+  mv /tmp/slurm.conf /etc/slurm-llnl/
+  chown root: /etc/slurm-llnl/slurm.conf
@@ Line 213: / Line 254: @@
 [[https://doku.lrz.de/display/PUBLIC/SLURM+Workload+Manager|SLURM Workload Manager]]
+[[https://support.ceci-hpc.be/doc/_contents/QuickStart/SubmittingJobs/SlurmTutorial.html|Slurm Quick Start Tutorial]]
+{{ :tech:9-slurm.pdf |Linux Clusters Institute: Scheduling and Resource Management 2017}}