Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...


Model: IBM Power AC922 (Whiterspoon)

Racks: 55 total (49 compute)
Nodes: 980
Processors: 2x16 cores IBM POWER9 AC922 at 3.1 GHz
Accelerators: 4 x NVIDIA Volta V100 GPUs/node, Nvlink 2.0, 16GB
Cores: 32 cores/node, Hyperthreading x4
RAM: 256 GB/node (242 usable)
Peak Performance: about 32 Pflop/s, 32 TFlops per node
Internal Network: Mellanox IB EDR DragonFly++
Disk Space: 8PB raw GPFS storage

...

More technical details on this architecture can be found on the IBM RedBook series: https://www.redbooks.ibm.com/redpapers/pdfs/redp5494.pdfyou can find same of them in our repository or at the IBM site for redBooks (search for AC922).

Peak performance details

The peak performance of M100 (980 compute nodes + 8 login nodes) is about 32PFlops. The performance of the single node is 32 TFlops due to 0.8 for the CPU part and 7.8x4 for the four GPUs on the node. In the calculation of the peak performances we included also the login nodes since they are identical to compute nodes.
The theoretical peak performance is 988*(0,8+4*7,8) =  31,6 PFlop/s
In the below table you can find the single node theoretical peak performance of the AC992 CN node with two Power9 processors and four NVIdia V100 GPUs.

...

Other flags are compiler specific and are described in the following:

XL Fortran compilerto be added...

-O0     Lower level of optimization, you can use also -O2
-g      Produce debugging information


PORTLAND Group (PGI) Compilers

...

The spectrum_mpi module provides the following compiler wrappers:

compilerwrapperusage
xlc_rmpixlcCompile C source files with XL
xlC_rmpixlCCompile C++ source files with XL
xlf_rmpixlfCompile FORTRAN source files with XL
pgccmpipgiccCompile C source files with PGI
pgc++mpipgic++

Compile C++ source files with PGI

pgfortranmpipgifortCompile FORTRAN source files with PGI
gcc

mpicc
ortecc
oshcc
shmemcc

Compile C source files with GNU
g++

mpic++
mpiCC
mpicxx
oshc++
oshCC
oshcxx
shmemc++
shmemCC
shmemcxx

Compile C++ source files with GNU
gfortranmpif77
mpif90
mpifort
oshfort
shmemfort
Compile FORTRAN source files with GNU

Detailed documentation can be found in the original IBM website.

...

The openmpi module provides the following wrappers:

compilerwrapperUsage
gccmpicc
opalcc
ortecc
oshcc
shmemcc
Compile C source files with GNU
g++

mpic++
mpiCC
mpicxx
opalc++
oshc++
oshCC
oshcxx
shmemc++
shmemCC
shmemcxx

Compile C++ source files with GNU
gfortran

mpif77
mpif90
mpifort
oshfort
shmemfort

Compile FORTRAN source files with GNU



Scientific libraries

ESSL: Engineering and Scientific Subroutine Library by IBM

...