Slurm job accounting


#1

We have an application that uses Slurm job accounting to track memory usage among other things. Is it possible to enable job accounting on Alces Flight, either with a text file or MySQL instance somewhere for storage?


#2

Hi dwjperry,

Slurm accounting is enabled by default in our upcoming 2017.2 release (which is coming out real soon).

For previous versions the textfile accounting can be enabled by making the following modifications :

  • Open the Slurm configuration file for editing
    sudo vim /opt/clusterware/opt/slurm/etc/slurm.conf

    • Uncomment #AccountingStorageLoc= and make it look as follows
      AccountingStorageLoc=/var/log/slurm/accounting

    • Change AccountingStorageType=accounting_storage/none to AccountingStorageType=accounting_storage/filetxt

    • Change JobAcctGatherType=jobacct_gather/none to JobAcctGatherType=jobacct_gather/linux

  • Setup log rotation for the accounting file (sudo vim /opt/clusterware/etc/logrotate.d/clusterware-slurm) by adding the following

    /var/log/slurm/accounting {
      missingok
      size 100M
      rotate 20
      dateext
      notifempty
      nocompress
      copytruncate
    }
    
  • Restart the slurm controller and syslog services for changes to take effect on the queue

     sudo systemctl restart clusterware-slurm-slurmctld.service
     sudo systemctl restart rsyslog
    

Let us know how that goes!