EN Bereichsnavigation EN

Posts Tagged ‘Rosa’

Cray’s April Programming Environment (PE) installed on Monte Rosa and Tödi

Friday, April 27th, 2012

The following rpms, which comprise the April release of Cray’s Programming Environment (PE), have been installed on Monte Rosa and Tödi:

MONTE ROSA:

Installed packages:

cce-8.0.4.105-1.x86_64.rpm
cray-libpmi-devel-3.0.1-1.0000.8917.33.1.gem.x86_64.rpm
cray-libpmi0-3.0.1-1.0000.8917.33.1.gem.x86_64.rpm
cray-mpt-5.4.5-gem0_8942.x86_64.rpm
cray-papi-4.3.0.1-1.x86_64.rpm
lgdb-1.5-1.x86_64.rpm
perftools-5.3.2-1.x86_64.rpm
perftools-clients-5.3.2-1.x86_64.rpm
petsc-3.2.01-1.x86_64.rpm
pgi-12.3.0-06.x86_64.rpm
set_pe_default-6.09-02.x86_64.rpm
xt-asyncpe-5.09-17.i386.rpm
xt-gcc-4.6.3-04.sles11sp1.x86_64.rpm

No default has been changed.

TÖDI
Installed packages:

cce-8.0.4.105-1.x86_64.rpm
cray-libpmi-devel-3.0.1-1.0000.8917.33.1.gem.x86_64.rpm
cray-libpmi0-3.0.1-1.0000.8917.33.1.gem.x86_64.rpm
cray-mpt-5.4.5-gem0_8942.x86_64.rpm
cray-papi-4.3.0.1-1.x86_64.rpm
cray-papi-acc-4.3.0.1-1.x86_64.rpm
cudatoolkit-4.1.28-114.x86_64.rpm
lgdb-1.5-1.x86_64.rpm
libsci_acc-1.1.00-1.x86_64.rpm
perftools-5.3.2-1.x86_64.rpm
perftools-clients-5.3.2-1.x86_64.rpm
petsc-3.2.01-1.x86_64.rpm
pgi-12.3.0-06.x86_64.rpm
set_pe_default-6.09-02.x86_64.rpm
xt-asyncpe-5.09-17.i386.rpm
xt-gcc-4.6.3-04.sles11sp1.x86_64.rpm

Default changed:

# /opt/cray/admin-pe/set_default_files/120419_set_pe_default.sh

xt-mpich2-5.4.5 is now default.
xt-shmem-5.4.5 is now default.
pmi-3.0.1-1.0000.8917.33.1.gem is now default.
petsc-3.2.01 is now default.
petsc-complex-3.2.01 is now default.
xt-asyncpe-5.09 is now default.
pgi-12.3.0 is now default.
papi-4.3.0.1 is now default.
perftools-5.3.2 is now default.
cudatoolkit-4.1.28 is now default.
xt-lgdb-1.5 is now default.
gcc-4.6.3 is now default.

As you see the defaults have been changed on Tödi but not Rosa.  If you encounter any problems please let us know.

Upgraded “Rosa”: scalable performance for an interacting quantum system

Friday, March 23rd, 2012
Scalability of the Exact Diagonalization technique on the upgrade Cray XE6 "Rosa"

The scalability of a the new ED technique is illustrated (vertical axus: time (s.) to solution, horizontal axis: number of cores). Perfect scalability would be a line with slope -1 on this log-log graph. In fact, the actual performance results are only slightly off the optimal scalability.

Dr. Sergei Isakov, a research scientist at the ETH Institute of Theoretical Physics, is investigating new approaches to look at the behavior of interacting systems known as quantum spin models. The underlying numerical kernel is the determination of a small number of eigenvalues by way of the Exact Diagonalization (ED) technique. This problem has typically proved difficult to parallelize on very large machine configurations.

 

As part of the High Performance and Productivity Computing (HP2C) initiative, Dr. Isakov and Prof. Matthias Troyer conceived an approach which makes use of data locality, that is, in which each computational process need only communicate with a relatively small number of neighbors through the Message Passing Interface (MPI). This technique maps well to Cray XE6 “Rosa” nodes. Within each node, further parallelism can be achieved by so-called shared-memory (or “OpenMP”) parallelism.

The combination of both MPI and OpenMP parallelism in this new technique means that the ED code will scale to very large machine configurations. After the recent upgrade of Rosa, CSCS scientists had the opportunity to evaluate the ED code on nearly the full machine (up to 47232 cores). The results (see figure) clearly show the scalability of the technique.

The results indicate that larger lattice sizes can be investigated when large machine configurations are used which, in turn, enables new science.

More details on the HP2C initiative can be found at www.hp2c.ch.

Twitter: cscsch