- Infos im HLRS Wiki sind nicht rechtsverbindlich und ohne Gewähr -

Difference between revisions of "NEC Cluster Hardware and Architecture (laki + laki2)"

From HLRS Platforms
(Architecture)
m (Hardware)
Line 7: Line 7:
 
* network: [http://de.wikipedia.org/wiki/Infiniband InfiniBand] Double Data Rate
 
* network: [http://de.wikipedia.org/wiki/Infiniband InfiniBand] Double Data Rate
 
** switches for interconnect: [http://www.voltaire.com/Products/Grid_Backbone_Switches Voltaire Grid Director 4036 QDR]
 
** switches for interconnect: [http://www.voltaire.com/Products/Grid_Backbone_Switches Voltaire Grid Director 4036 QDR]
 +
 +
* [http://www.top500.org/ Top500] [http://www.top500.org/lists/2009/06 June 2009 list] [http://www.top500.org/list/2009/06/100 (1-100)]: [http://www.top500.org/system/9888 #77]
  
 
=== Architecture ===
 
=== Architecture ===

Revision as of 23:54, 1 November 2009

Hardware

Architecture

The NEC Nehalem Cluster platform consists of several frontend nodes for interactive access (for access details see Access) and several compute nodes for execution of parallel programs.


Compute node CPU architecture types installed:

  • Intel Xeon 5560 (nehalem)
  • Nvidia Tesla S1070 (consisting of C1060 devices)


Features

  • Operating System: ScientificLinux 5.3 (internal test on Windows HPC Server 2008)
  • Batchsystem: Torque/Maui/Moab
  • node-node interconnect: Infiniband + GigE
  • Global Disk 60 TB (lustre)
  • OpenMPI
  • Compiler: Intel, GCC, Java


Short overview of installed nodes
Function Name CPU Sockets Cores Memory Disk PBS properties Interconnect
Compute Nodes n010501 - n143302 (700 nodes) Intel Xeon X5560 2.80 GHz 2 8 12 GB (default), 24 GB (4nodes), 48 GB (4nodes) - nehalem Infiniband
Compute Nodes with Tesla S1070 (32 nodes) Intel Xeon X5560 2.80 GHz + Tesla S1070 GPU 2 8 12 GB - tesla Infiniband
Login Node cl3fr1 / cl3fr2 Intel Xeon X5560 2.80 GHz 2 8 48 GB 150 GB mirror - 10GigE/Infiniband
I/O Server (2 lustre nodes) Intel Xeon E5405 2.0 GHz 8 GB 60 TB - Infiniband
Infrastructure (NTP,PBS,DNS,DHCP,FTP,NAT,NFS,Imager,...) 6 nodes - GigE