Dear Michael and colleagues,
The Peregrine nodes that have been bought by Gelifes have been configured, and are available. I did some first tests myself, and everything seems to be working fine.
This means that I would like to invite the Gelifes members to test the nodes for themselves. Joke suggested that you, Michael, and your group members, are available and probably would be willing to try the new nodes. So please go ahead.
Some details about the setup. The nodes have been put in a separate partition, called 'gelifes'. They share the same storage and software as all the other nodes.
Since these nodes have been paid by Gelifes, users from Gelifes are currently the only ones who can access them. To separate the usage between the Gelifes nodes and the rest of the cluster a separate 'gelifes' account has been made in the scheduler, the other account being 'users'.
Only users which have an account in 'gelifes' are able to submit to the gelifes partition. These people also have an account in 'users'. Job submitted in the gelifes partition will be accounted for in the gelifes account, and jobs in the other partitions will be accounted for in the users account.
This sounds a bit complicated, but the main thing to take home is:
- submit to the partition 'gelifes' to get to the new nodes.
- usage (and priorities) of the gelifes nodes is accounted separately from the rest of the cluster.
The node themselves are 64 core AMD nodes with 512GB of memory. These should be suitable for most of the workloads you have. There is also quite a lot (16 TB) of temporary local scratch space per node, available for jobs through the use $TMPDIR.
I added all people from Gelifes in the cc: to the gelifes account. If anyone else needs to be added, please let me know. Unfortunately adding people is a manual process.
I would suggest to use [email protected] for any questions or problems you may have when using the systems. This makes sure that my colleagues will take over when I am on holiday, and that not a whole group of other people gets these e-mails.
For any questions related to the contents of this email a reply, is of course fine.
Good luck with the extra capacity! I expect that some of you can really benefit from it.
Kind regards,
Fokke Dijkstra