- Infos im HLRS Wiki sind nicht rechtsverbindlich und ohne Gewähr -
- Information contained in the HLRS Wiki is not legally binding and HLRS is not responsible for any damages that might result from its use -
Programming How-To's, Tips & Tricks: Difference between revisions
From HLRS Platforms
Jump to navigationJump to search
m (Add link to →Big Data, AI Applications, and Frameworks) |
|||
| Line 17: | Line 17: | ||
=== Big Data, AI Applications, and Frameworks === | === Big Data, AI Applications, and Frameworks === | ||
* [[How to use AI containers on GPU-accelerated compute partitions?]] | * Containers: [[How to use AI containers on GPU-accelerated compute partitions?]] | ||
* [[How to move local conda environments to the clusters]] | * Conda: [[How to move local conda environments to the clusters]] | ||
* [[How to launch a Ray cluster on HLRS compute platforms]] | * Ray: [[How to launch a Ray cluster on HLRS compute platforms]] | ||
* [[How to use Web Based Services on HLRS Compute Platforms]] | * Web-Based Services: [[How to use Web Based Services on HLRS Compute Platforms]] | ||
=== Miscalleneous === | === Miscalleneous === | ||
Revision as of 10:17, 26 February 2024
Project Management and Collaboration
General
- POSIX compliant shell scripting
- Best practices for I/O, Parallel I/O, aka MPI-IO
- Best practices for Porting & Migration of Code
- Best practices for Debugging
- Best practices for Performance Analysis
Performance Optimization
- Useful compiler options on x86 processors
- Pinning threads and memory on multicore/processor system under Linux
Debugging
Big Data, AI Applications, and Frameworks
- Containers: How to use AI containers on GPU-accelerated compute partitions?
- Conda: How to move local conda environments to the clusters
- Ray: How to launch a Ray cluster on HLRS compute platforms
- Web-Based Services: How to use Web Based Services on HLRS Compute Platforms
Miscalleneous
- SX and configure
- PACX-MPI on clusters
- How to measure Flop/s etc. of massively parallel jobs with perf stat
- How to detect out of memory events