- Infos im HLRS Wiki sind nicht rechtsverbindlich und ohne Gewähr -
- Information contained in the HLRS Wiki is not legally binding and HLRS is not responsible for any damages that might result from its use -

CPE: Difference between revisions

From HLRS Platforms
Jump to navigationJump to search
No edit summary
Line 4: Line 4:


== CPE on Hawk ==
== CPE on Hawk ==
=== Setup ===
* Bash script to initialize CPE: enable_cpe.sh
* Additional module files for PrgEnv-aocc and PrgEnv-intel: compiler.tar.gz
* Example PBS job script (for xthi): job.sh
To use PrgEnv-aocc and PrgEnv-intel, unpack compiler.tar.gz in ''DIR'' and set REPO_ROOT=''DIR'' in enable_cpe.sh.


=== Loading CPE ===
=== Loading CPE ===


   $ module list
   $ module list
 
 
   Currently Loaded Modules:
   Currently Loaded Modules:
     1) system/site_names  3) system/wrappers/1.0          5) gcc/10.2.0
     1) system/site_names  3) system/wrappers/1.0          5) gcc/10.2.0
     2) system/ws/1.4.0    4) hlrs-software-stack/current  6) mpt/2.26
     2) system/ws/1.4.0    4) hlrs-software-stack/current  6) mpt/2.26
 
 
   $ . enable_cpe.sh
   $ . enable_cpe.sh
   $ module list
   $ module list
 
 
   Currently Loaded Modules:
   Currently Loaded Modules:
     1) system/site_names    6) perftools-base/22.09.0  11) cray-libsci/22.11.1.2
     1) system/site_names    6) perftools-base/22.09.0  11) cray-libsci/22.11.1.2
Line 22: Line 30:
     4) craype-x86-rome      9) cray-dsmml/0.2.2
     4) craype-x86-rome      9) cray-dsmml/0.2.2
     5) craype-network-ucx  10) cray-mpich-ucx/8.1.21
     5) craype-network-ucx  10) cray-mpich-ucx/8.1.21
 
 
   $ cc --version
   $ cc --version
   Cray clang version 15.0.0  (324a8e7de6a18594c06a0ee5d8c0eda2109c6ac6)
   Cray clang version 15.0.0  (324a8e7de6a18594c06a0ee5d8c0eda2109c6ac6)
Line 28: Line 36:
   Thread model: posix
   Thread model: posix
   InstalledDir: /opt/cray/pe/cce/15.0.0/cce-clang/x86_64/share/../bin
   InstalledDir: /opt/cray/pe/cce/15.0.0/cce-clang/x86_64/share/../bin


=== Unloading CPE ===
=== Unloading CPE ===
Line 34: Line 41:
   $ module restore
   $ module restore
   Resetting modules to system default (...)
   Resetting modules to system default (...)
 
 
   $ echo $MODULEPATH | tr : '\n'
   $ echo $MODULEPATH | tr : '\n'
   /opt/hlrs/non-spack/rev-009_2022-09-01/modulefiles/mpt/2.26/gcc/10.2.0
   /opt/hlrs/non-spack/rev-009_2022-09-01/modulefiles/mpt/2.26/gcc/10.2.0
Line 43: Line 50:
   /opt/hlrs/non-spack/rev-009_2022-09-01/modulefiles/gcc/8.5.0
   /opt/hlrs/non-spack/rev-009_2022-09-01/modulefiles/gcc/8.5.0
   /opt/hlrs/non-spack/system/modulefiles
   /opt/hlrs/non-spack/system/modulefiles
 
 
   $ echo $LD_LIBRARY_PATH | tr : '\n'
   $ echo $LD_LIBRARY_PATH | tr : '\n'
   /opt/hlrs/non-spack/rev-009_2022-09-01/compiler/gcc/10.2.0/mpt_custom_fortran_modules/2.26
   /opt/hlrs/non-spack/rev-009_2022-09-01/compiler/gcc/10.2.0/mpt_custom_fortran_modules/2.26
Line 49: Line 56:
   /opt/hlrs/non-spack/rev-009_2022-09-01/compiler/gcc/10.2.0/lib64
   /opt/hlrs/non-spack/rev-009_2022-09-01/compiler/gcc/10.2.0/lib64
   /opt/cray/pe/lib64 # <--- Need a proper modulefile to undo this change
   /opt/cray/pe/lib64 # <--- Need a proper modulefile to undo this change
=== References ===
[CPE Release Notes and Changelogs]([https://github.com/PE-Cray/cpe-changelog CPE Release Notes and Changelogs])

Revision as of 10:18, 3 May 2023

Cray Programming Environment User Guide: CSM for HPE Cray EX Systems HPE CPE User Guide

CPE on Hawk

Setup

  • Bash script to initialize CPE: enable_cpe.sh
  • Additional module files for PrgEnv-aocc and PrgEnv-intel: compiler.tar.gz
  • Example PBS job script (for xthi): job.sh

To use PrgEnv-aocc and PrgEnv-intel, unpack compiler.tar.gz in DIR and set REPO_ROOT=DIR in enable_cpe.sh.

Loading CPE

 $ module list
 
 Currently Loaded Modules:
   1) system/site_names   3) system/wrappers/1.0           5) gcc/10.2.0
   2) system/ws/1.4.0     4) hlrs-software-stack/current   6) mpt/2.26
 
 $ . enable_cpe.sh
 $ module list
 
 Currently Loaded Modules:
   1) system/site_names     6) perftools-base/22.09.0  11) cray-libsci/22.11.1.2
   2) system/ws/1.4.0       7) cce/15.0.0              12) cray-pals/1.2.4
   3) system/wrappers/1.0   8) craype/2.7.19           13) PrgEnv-cray/8.3.4
   4) craype-x86-rome       9) cray-dsmml/0.2.2
   5) craype-network-ucx   10) cray-mpich-ucx/8.1.21
 
 $ cc --version
 Cray clang version 15.0.0  (324a8e7de6a18594c06a0ee5d8c0eda2109c6ac6)
 Target: x86_64-unknown-linux-gnu
 Thread model: posix
 InstalledDir: /opt/cray/pe/cce/15.0.0/cce-clang/x86_64/share/../bin

Unloading CPE

 $ module restore
 Resetting modules to system default (...)
 
 $ echo $MODULEPATH | tr : '\n'
 /opt/hlrs/non-spack/rev-009_2022-09-01/modulefiles/mpt/2.26/gcc/10.2.0
 /sw/hawk-rh8/hlrs/spack/rev-009_2022-09-01/modulefiles/linux-rocky8-x86_64/mpt/2.26-zbg2lgp/gcc/10.2.0
 /opt/hlrs/spack/rev-009_2022-09-01/modulefiles/linux-rocky8-x86_64/gcc/10.2.0
 /opt/hlrs/non-spack/rev-009_2022-09-01/modulefiles/gcc/10.2.0
 /opt/hlrs/spack/rev-009_2022-09-01/modulefiles/linux-rocky8-x86_64/gcc/8.5.0
 /opt/hlrs/non-spack/rev-009_2022-09-01/modulefiles/gcc/8.5.0
 /opt/hlrs/non-spack/system/modulefiles
 
 $ echo $LD_LIBRARY_PATH | tr : '\n'
 /opt/hlrs/non-spack/rev-009_2022-09-01/compiler/gcc/10.2.0/mpt_custom_fortran_modules/2.26
 /opt/hlrs/non-spack/mpi/mpt/2.26/lib
 /opt/hlrs/non-spack/rev-009_2022-09-01/compiler/gcc/10.2.0/lib64
 /opt/cray/pe/lib64 # <--- Need a proper modulefile to undo this change