- Infos im HLRS Wiki sind nicht rechtsverbindlich und ohne Gewähr -
- Information contained in the HLRS Wiki is not legally binding and HLRS is not responsible for any damages that might result from its use -

HPE Hawk: Difference between revisions

From HLRS Platforms
Jump to navigationJump to search
No edit summary
(48 intermediate revisions by 4 users not shown)
Line 1: Line 1:
<br>
{{warning|text=HAWK is currently in the set up phase. For more details about the timing please see the [https://kb.hlrs.de/platforms/index.php/Hawk_installation_schedule Hawk installation schedule].}}
{{warning|text=Please have in mind that the system is currently under construction. Hence, modifications might occur and the observed performance can vary.}}


<font color=red>'''If your job does not start, please have in mind the time-dependent limitations according to [[Batch_System_PBSPro_(Hawk)#time-dependent limitations|Batch System]]!'''</font>


This Page is under construction!
----


The information below applies to the Test and Development System (TDS) which is similar to the future Hawk production system. Please have in mind that this is a system under construction. Hence modifications might occur ''without'' announcement and stuff may not work as expected from time to time!


{| style="border:0; margin: 0;" width="100%" cellspacing="10"


== Access ==
| valign="top" style="padding: 0; border: 1px solid #aaaaaa; margin-bottom: 0;" |
<div style="font-size: 105%; padding: 0.4em; background-color: #eeeeee; border-bottom: 1px solid #aaaaaa; text-align: center;">'''Introduction'''</div>
<div style="background: #ffffff; padding:0.2em 0.4em;">
{| style="border: 0; margin: 0;" cellpadding="3"
| valign="top" | 
* [[Hawk_installation_schedule#Terms_of_Use | Terms of use ]]
* [[HPE_Hawk_access|Access]]
* [[HPE_Hawk_Hardware_and_Architecture|Hardware and Architecture]]
|}
</div>


Login-Node: hawk-tds-login1.hww.hlrs.de
{{note|text=Access to the Hawk TDS is possible now on request. In case you have early access, we ask you to provide us with your experience regarding usage and performance (approximately half a page) once a month.}}




== Manuals ==
| valign="top" style="padding: 0; border: 1px solid #aaaaaa; margin-bottom: 0;" |
'''Processor''':
<div style="font-size: 105%; padding: 0.4em; background-color: #eeeeee; border-bottom: 1px solid #aaaaaa; text-align: center;">'''Troubleshooting'''</div>
* [https://developer.amd.com/wp-content/resources/56305_SOG_3.00_PUB.pdf Software Optimization Guide for AMD EPYC Rome Processors]
<div style="background: #ffffff; padding:0.2em 0.4em;">
* [https://developer.amd.com/wp-content/resources/56255_3_03.PDF Open-Source Register Reference for AMD EPYC Rome Processors] <br> (in particular describing available hardware performance counters)
{| style="border: 0; margin: 0;" cellpadding="3"
* [https://www.amd.com/system/files/TechDocs/47414_15h_sw_opt_guide.pdf Software Optimization Guide for AMD Family 15h] <br> (although depicting an older family of AMD processors, the optimization approaches shown in this document are also applicable to the AMD EPYC Rome processor deployed in Hawk)
| valign="top" | 
* [[HPE_Hawk_Support|Support (contact/staff)]]
* [[HPE_Hawk_FAQ|FAQ]]
* [http://websrv.hlrs.de/cgi-bin/hwwweather?task=viewmachine&machine=hawk News,Status,Maintenance for hawk]
|}
</div>


<br>


'''MPI''':
|}
* [http://www.hpe.com/support/mpi-ug-036 HPE Message Passing Interface (MPI) User Guide]


<br>


'''Filesystem''':
* tbd


<br>


== Module environment ==


[[Module environment(Hawk)|Module environment]]
{| style="border:0; margin: 0;" width="100%" cellspacing="10"


<br>
| valign="top" style="padding: 0; border: 1px solid #aaaaaa; margin-bottom: 0;" |
<div style="font-size: 105%; padding: 0.4em; background-color: #eeeeee; border-bottom: 1px solid #aaaaaa; text-align: center;">'''Documentation'''</div>
<div style="background: #ffffff; padding:0.2em 0.4em;">
{| style="border: 0; margin: 0;" cellpadding="3"
| valign="top" | 
* [[Batch_System_PBSPro_(Hawk)|Batch System]]
* [[Module environment(Hawk)|Module Environment]]
* [[Storage_(Hawk)| Storage Description ]]
* [[Compiler(Hawk)|Compiler]]
* [[MPI(Hawk)|MPI]]
* [[Libraries(Hawk)|Libraries]]
* [[Manuals(Hawk)|Manuals]]
|}
</div>


== Compiler ==


[[Compiler(Hawk)|Compiler]]


<br>
| valign="top" style="padding: 0; border: 1px solid #aaaaaa; margin-bottom: 0;" |
<div style="font-size: 105%; padding: 0.4em; background-color: #eeeeee; border-bottom: 1px solid #aaaaaa; text-align: center;">'''Utilities'''</div>
<div style="background: #ffffff; padding:0.2em 0.4em;">
{| style="border: 0; margin: 0;" cellpadding="3"
| valign="top" | 
* [[CAE_utilities|CAE Utilities]]
* [[MKL | MKL Fortran Interfaces ]]
|}
</div>


== MPI ==
|}


'''Tuned MPI''': In order to use the MPI implementation provided by HPE, please load the Message Passing Toolkit (MPT) module ''mpt'' (not ABI-compatible to other MPI implementations) or ''hmpt'' (ABI-compatible to MPICH-derivatives).


'''User Guide''': For detailed information cf. the [http://www.hpe.com/support/mpi-ug-036 HPE Message Passing Interface (MPI) User Guide].
----
 
[[Help | Help for Wiki Usage]]
'''Performance optimization''': With respect to MPI performance optimization by means of tuning environment variables please cf.
[https://kb.hlrs.de/platforms/upload/Tuning_of_MPT.pdf Tuning of MPT]
 
'''Interconnect topology''': Hawk deploys an Infiniband HDR based interconnect with a 9-dimensional enhanced hypercube topology. Please refer to [https://kb.hlrs.de/platforms/upload/Interconnect_topology.pdf here] with respect to the latter. Infiniband HDR has a bandwidth of 200 Gbit/s and a MPI latency of ~1.3us per link. The full bandwidth of 200 Gbit/s can be used if communicating between the 16 nodes connected to the same node of the hypercube (cf. [https://kb.hlrs.de/platforms/upload/Interconnect_topology.pdf here]). Within the hypercube, the higher the dimension, the less bandwidth is available.
 
<br>
 
== Libraries ==
 
[[Libraries(Hawk)|Libraries]]
 
<br>
 
== Disk storage ==
 
Home directories as well as workspaces are handled in the same way as on Hazel Hen, so please cf. [[CRAY_XC40_Disk_Storage | Storage Description ]] regarding details.
 
<br>
 
== Batch System ==
 
[[Batch_System_PBSPro_(Hawk)|Batch System]]
 
<br>
 
== Best Practises for Software Installation ==
Best practices for software installation on Hawk is described on a separate (internal) wiki page [https://kb.hlrs.de/staff/index.php/Hawk_installation Software Installation on Hawk].

Revision as of 11:26, 2 March 2020

Warning: HAWK is currently in the set up phase. For more details about the timing please see the Hawk installation schedule.
Warning: Please have in mind that the system is currently under construction. Hence, modifications might occur and the observed performance can vary.




Introduction


Troubleshooting




Documentation


Utilities



Help for Wiki Usage