Hardware
GB Unit big-mem Interactive Servers
These are high memory machines bought by the Unit where you can log in for performing interactive computing. These are especially well suited when your resources need changes as you work or when you need a lot of RAM ; this second situation is less of a problem since the IT-managed cluster has similar beasts. An good example situation is when you sporadically need e.g. 20 cores and hundreds Gb of RAM to quickly perform matrix operations in R. In such a situation, you'd need to book the maximum resources you could during your work session to be able to work on the cluster ; resulting in massive waste of resources.
1. spinoza:
- log in from within EMBL with e.g. ssh spinoza
- 40CPUs, 1024GB RAM, CentOS7
- 9 Tb of local space in /tmpdata, please see storage policies
- registered as SLURM submitter i.e. you can sbatch to the cluster (see IT wiki)
- /scratch is also available from there
2. schroedinger (deprecated):
- log in from within EMBL with e.g. ssh schroedinger
- 40CPUs, 1024GB RAM, CentOS6
- 9 Tb of local space in /tmpdata, please see storage policies
- registered as LSF submitter i.e. you can bsub to the cluster
- /scratch is also available from there
Using interactive servers allows you to run job without specifying the memory usage. However, VERY IMPORTANTLY, please check the capacity left on the machine before running the jobs and always use a fair share of the resources. Long-lasting jobs with predictable resource usage should always go to the cluster.
EMBL SLURM Cluster
Please consult the IT wiki and the cluster chat channel.
EMBL LSF Cluster (deprecated)
EMBL Cluster Nodes
- 60 nodes comprising more than 700 CPU cores, including 8 nodes with 1TB of RAM and 40 Cores and 52 nodes with 16GB of RAM and 8 Cores
- Runs LSF 7.0.6 and CentOS 6.2
- The default memory limit is 2GB, but you can request more memory and CUPs when submitting the jobs
- More information about EMBL cluster at EMBL-cluster
If you use the cluster, or intend to, you should subscribe to the clusterng@embl.de mailing list (send an email to clusterng-subscribe@embl.de). More information at IT Service-Computing
LSF Submission System
- A software for managing and accelerating batch workload to distribute jobs to the cluster
- To run jobs on EMBL-clusters, log into submaster, schroedinger or spinoza server and use the "bsub" command for submitting jobs
- For more information, please check IT-LSFand EMBL-cluster
When the job has problems, you can use "bjobs -l" to check the detail information about the job. For example, it shows which computer (node) the job is executed. You can ssh to that node (such as compute036) through submaster machine (not from schroedinger/spinoza) to check the job running detail status.