JUWELS - Configuration

Hardware Characteristics of the Cluster Module

• 2271 standard compute nodes - Dual Intel Xeon Platinum 8168

  • 2x 24 cores, 2.7 GHz
  • 12x 8 GB, 2666 MHz
  • EDR-Infiniband (Connect-X4)
  • diskless

• 240 large memory compute nodes - Dual Intel Xeon Platinum 8168

  • 2x 24 cores, 2.7 GHz
  • 12x 16 GB, 2666 MHz
  • EDR-Infiniband (Connect-X4)
  • diskless

• 56 accelerated compute nodes - Dual Intel Xeon Gold 6148

  • 2x 20 cores, 2.4 GHz
  • 12x 16 GB, 2666MHz
  • Dual EDR-Infiniband (Connect-X4)
  • diskless
  • 4x Nvidia V100 GPU

• 12 login nodes - Dual Intel Xeon Gold 6148

  • 2x 20 cores, 2.4 GHz
  • 12x 64 GB, 2666MHz
  • EDR-Infiniband (Connect-X5)
  • 100 GigE
  • 2x 1TB HDD (Raid 1)

• 4 visualisation nodes - Dual Intel Xeon Gold 6148

  • 2x 20 cores, 2,4 GHz
  • 12x 64 GB, 2666 MHz
  • EDR-Infiniband (Connect-X5)
  • 100 GigE
  • 2x 1TB HDD (Raid 1)
  • 1x Nvidia Pascal P100

• 122,768 CPU cores
• 10.6 (CPU) + 1.7 (GPU) Petaflop per second peak performance
• Mellanox EDR InfiniBand fat-tree network with 2:1 pruning at leaf level and top-level HDR switches (starting autumn 2019)
• 250 GB/s network connection to JUST for storage access

Software Characteristics

• CentOS 7 Linux distribution
• Parastation Cluster Management
• Slurm batch system with Parastation resource management

• Intel Professional Fortran, C/C++ Compiler

  • Support for OpenMP programming model for intra-node parallelization
• Intel Math Kernel Library
• ParTec MPI (Message Passing Interface) Implementation
• Intel MPI (Message Passing Interface) Implementation
• IBM General Parallel Filesystem (GPFS)