SGI Altix UV 1000 - Rothorn
This page describes Rothorn in the following sections
A Short Description of the Machine
The SGI Altix UV 1000, Rothorn, is a general-purpose system featuring large amounts of addressable memory (2TB of RAM in total).
OpenMP codes and memory-intensive applications are most suitable.
Rothorn has 16 blades for a total of 32 CPU Intel(R) Xeon(R) CPU E7- 8837 at 2.67 GHz, that is 256 cores and 2 TB of RAM. However at most 254 cores are available for jobs submitted by users, since 2 cores are reserved by root. The operating system is SUSE SLES11 SP1.
How to Access Rothorn
Users who wish to have access to Rothorn need either to submit a Data Analytics Project or to contact Maria Grazia Giuffreda.
Rothorn is accessible via SSH from the frontend ela.cscs.ch as rothorn.cscs.ch. Please note that direct access to Rothorn does not allow you to use more than 2 cores. To access all resources you need to use the batch queuing system.
Programming Environment and Supported Software
The software environment on Rothorn is controlled using the modules framework which is an easy and flexible way to access all the available compilers, tools, and applications.
Run the command "module avail" to see the modules available on the system, and "module list" to see the modules currently loaded.
Compilers for Rothorn are:
PGI
Intel 11/12
gcc-4.3.4
Submission of Batch Jobs
Rothorn uses the SLURM batch system, all jobs should be submitted from the login nodes. Because this is a Single System Image machine you should declare 1 node in your job scripts. To list the available queues and partitions where to submit jobs use the commands sinfo and scontrol show partition. You can choose the queue where to run your job by issuing the "--partition" directive in your batch script:
#SBATCH --partition=<partition_name>
Instructions on batch submission and how to set up a batch job are available on the following page:
For a list of the most useful SLURM commands, please have a look at the corresponding FAQ section under the User Forum. Please refer to the man pages and the official SLURM documentation for the details.
Data Storage
/scratch
Rothorn has a scratch partition (/scratch/rothorn/user_name) connected via IB interconnect. Please be aware that /scratch is not backed up and is cleaned once a week. Do not use /scratch for long-term storage.
/project
Access to the shared storage (/project) is also available through the high speed interconnect. However, the request for disk space needs to be done at the time of the proposal submission and needs to be well justified.
For further information, please have a look at Data Management or contact help(at)cscs.ch.