- Infos im HLRS Wiki sind nicht rechtsverbindlich und ohne Gewähr -
- Information contained in the HLRS Wiki is not legally binding and HLRS is not responsible for any damages that might result from its use -

HPE Hawk: Difference between revisions

From HLRS Platforms
Jump to navigationJump to search
No edit summary
No edit summary
 
(26 intermediate revisions by 6 users not shown)
Line 1: Line 1:
{{warning|text=HAWK is currently in the set up phase. For more details about the timing please see the [https://kb.hlrs.de/platforms/index.php/Hawk_installation_schedule Hawk installation schedule].}}
 
{{warning|text=Please have in mind that the system is currently under construction. Hence, modifications might occur and the observed performance can vary.}}
{{Note
| text = Please be sure to read at least the [[10_minutes_before_the_first_job]] document and consult the [[General HWW Documentation]] before you start to work with any of our systems.
}}
 
{{Warning
| text = In prepartion of the next generation supercomputer [[ Hunter_(HPE) | Hunter ]], the hardware configuration has been reduced (from 5632 compute nodes to 4096 compute nodes). Workspace filesystem ws10 has been removed.
}}




Line 13: Line 19:
{| style="border: 0; margin: 0;" cellpadding="3"
{| style="border: 0; margin: 0;" cellpadding="3"
| valign="top" |   
| valign="top" |   
<!-- * [[Hawk_installation_schedule#Terms_of_Use | Terms of use ]] -->
* [[HPE_Hawk_access|Access]]
* [[HPE_Hawk_access|Access]]
* [[HPE_Hawk_Hardware_and_Architecture|Hardware and Architecture]]
* [[HPE_Hawk_Hardware_and_Architecture|Hardware and Architecture]]
Line 27: Line 34:
* [[HPE_Hawk_Support|Support (contact/staff)]]
* [[HPE_Hawk_Support|Support (contact/staff)]]
* [[HPE_Hawk_FAQ|FAQ]]
* [[HPE_Hawk_FAQ|FAQ]]
* [http://websrv.hlrs.de/cgi-bin/hwwweather?task=viewmachine&machine=hawk News,Status,Maintenance for hawk]
* [https://websrv.hlrs.de/cgi-bin/hwwweather?task=viewmachine&machine=hawk Status,Maintenance for hawk]
* [[HPE_Hawk_News|News]]
|}
|}
</div>
</div>
Line 41: Line 49:


| valign="top" style="padding: 0; border: 1px solid #aaaaaa; margin-bottom: 0;" |
| valign="top" style="padding: 0; border: 1px solid #aaaaaa; margin-bottom: 0;" |
<div style="font-size: 105%; padding: 0.4em; background-color: #eeeeee; border-bottom: 1px solid #aaaaaa; text-align: center;">'''Cluster Documentation'''</div>
<div style="font-size: 105%; padding: 0.4em; background-color: #eeeeee; border-bottom: 1px solid #aaaaaa; text-align: center;">'''Documentation'''</div>
<div style="background: #ffffff; padding:0.2em 0.4em;">
<div style="background: #ffffff; padding:0.2em 0.4em;">
{| style="border: 0; margin: 0;" cellpadding="3"
{| style="border: 0; margin: 0;" cellpadding="3"
Line 47: Line 55:
* [[Batch_System_PBSPro_(Hawk)|Batch System]]
* [[Batch_System_PBSPro_(Hawk)|Batch System]]
* [[Module environment(Hawk)|Module Environment]]
* [[Module environment(Hawk)|Module Environment]]
* Home directories as well as workspaces are handled in the same way as on Hazel Hen, so please cf. [[CRAY_XC40_Disk_Storage | Storage Description ]] regarding details.
* [[Storage_(Hawk)| Storage Description ]]
* [[Compiler(Hawk)|Compiler]]
* [[Compiler(Hawk)|Compiler]]
* [[MPI(Hawk)|MPI]]
* [[MPI(Hawk)|MPI]]
* [[Libraries(Hawk)|Libraries]]
* [[Libraries(Hawk)|Libraries]]
* [[Manuals(Hawk)|Manuals]]
* [[Manuals(Hawk)|Manuals]]
* [[Optimization|Optimization]]
* [[Hawk_PrePostProcessing|Pre- and Post-Processing]]
* [[Big_Data,_AI_Aplications_and_Frameworks|Big Data, AI Applications and Frameworks]]
* [[Performance Analysis Tools]]
* [[CPE|Cray Programming Environment (CPE)]]
|}
|}
</div>
</div>
Line 58: Line 72:


| valign="top" style="padding: 0; border: 1px solid #aaaaaa; margin-bottom: 0;" |
| valign="top" style="padding: 0; border: 1px solid #aaaaaa; margin-bottom: 0;" |
<div style="font-size: 105%; padding: 0.4em; background-color: #eeeeee; border-bottom: 1px solid #aaaaaa; text-align: center;">'''Programming / Utilities'''</div>
<div style="font-size: 105%; padding: 0.4em; background-color: #eeeeee; border-bottom: 1px solid #aaaaaa; text-align: center;">'''Utilities'''</div>
<div style="background: #ffffff; padding:0.2em 0.4em;">
<div style="background: #ffffff; padding:0.2em 0.4em;">
{| style="border: 0; margin: 0;" cellpadding="3"
{| style="border: 0; margin: 0;" cellpadding="3"
| valign="top" |   
| valign="top" |   
* [[CAE_utilities|CAE Utilities]]
* [[CAE_utilities|CAE Utilities]]
* [[CAE_howtos|CAE HOWTOs]]
* [[MKL | MKL Fortran Interfaces ]]
* [[MKL | MKL Fortran Interfaces ]]
* [[FFTW | FFTW library usage ]]
|}
|}
</div>
</div>
Line 73: Line 87:
----
----
[[Help | Help for Wiki Usage]]
[[Help | Help for Wiki Usage]]
== Module environment ==
cf. [[Module environment(Hawk)|here]]
<br>
== Compiler ==
cf. [[Compiler(Hawk)|here]]
<br>
== MPI ==
'''Tuned MPI''': In order to use the MPI implementation provided by HPE, please load the Message Passing Toolkit (MPT) module ''mpt'' (not ABI-compatible to other MPI implementations) or ''hmpt'' (ABI-compatible to MPICH-derivatives).
'''User Guide''': For detailed information cf. the [http://www.hpe.com/support/mpi-ug-036 HPE Message Passing Interface (MPI) User Guide].
'''Performance optimization''': With respect to MPI performance optimization by means of tuning environment variables please cf.
[https://kb.hlrs.de/platforms/upload/Tuning_of_MPT.pdf Tuning of MPT]
<br>
== Libraries ==
cf. [[Libraries(Hawk)|here]]
<br>
== Batch System ==
cf. [[Batch_System_PBSPro_(Hawk)|here]]
<br>
== Disk storage ==
Home directories as well as workspaces are handled in the same way as on Hazel Hen, so please cf. [[CRAY_XC40_Disk_Storage | Storage Description ]] regarding details.
<br>
== Pre- and post processing ==
Within HLRS simulation environment special nodes for pre- and post processing tasks are available. Such nodes could be requested via the batch system (follow this link for more info).
Available nodes are
  table...
    4 nodes 2 TB Memory 2 Socket AMD ...x TB local storage  shared usage model
    1 Node  4 TB Memory 2 Socket AMD    x TB local storage  shared usage model
more specialized nodes e.g. graphics, vector, DataAnalytics, ... are available in the [[NEC_Cluster_Hardware_and_Architecture_(vulcan)|Vulcan cluster]]
<br>
== Manuals ==
'''Processor''':
* [https://developer.amd.com/wp-content/resources/56305_SOG_3.00_PUB.pdf Software Optimization Guide for AMD EPYC Rome Processors]
* [https://developer.amd.com/wp-content/resources/56255_3_03.PDF Open-Source Register Reference for AMD EPYC Rome Processors] <br> (in particular describing available hardware performance counters)
* [https://www.amd.com/system/files/TechDocs/47414_15h_sw_opt_guide.pdf Software Optimization Guide for AMD Family 15h] <br> (although depicting an older family of AMD processors, the optimization approaches shown in this document are also applicable to the AMD EPYC Rome processor deployed in Hawk)
<br>
'''MPI''':
* [http://www.hpe.com/support/mpi-ug-036 HPE Message Passing Interface (MPI) User Guide]
<br>
'''Batch system''':
* [https://www.altair.com/pdfs/pbsworks/PBSUserGuide19.2.3.pdf User's Guide]
* [https://www.altair.com/pdfs/pbsworks/PBSReferenceGuide19.2.3.pdf Reference Guide] (cf. this with respect to a complete list of environment variables exported by PBS)

Latest revision as of 11:56, 11 December 2024

Note: Please be sure to read at least the 10_minutes_before_the_first_job document and consult the General HWW Documentation before you start to work with any of our systems.


Warning: In prepartion of the next generation supercomputer Hunter , the hardware configuration has been reduced (from 5632 compute nodes to 4096 compute nodes). Workspace filesystem ws10 has been removed.




Introduction


Troubleshooting




Documentation


Utilities



Help for Wiki Usage