- Infos im HLRS Wiki sind nicht rechtsverbindlich und ohne Gewähr -
- Information contained in the HLRS Wiki is not legally binding and HLRS is not responsible for any damages that might result from its use -
Storage (Hawk): Difference between revisions
| Line 4: | Line 4: | ||
{{Warning|text=Due to the limited network performance, the HOME filesystem is not intended for use in any compute jobs! Do not read or write files within any compute job, as this will cause trouble for all users. For compute jobs please use the [[workspace mechanism]] which uses the [http://en.wikipedia.org/wiki/Lustre_%28file_system%29 Lustre] based scratch directories. }} | {{Warning|text=Due to the limited network performance, the HOME filesystem is not intended for use in any compute jobs! Do not read or write files within any compute job, as this will cause trouble for all users. For compute jobs please use the [[workspace mechanism]] which uses the [http://en.wikipedia.org/wiki/Lustre_%28file_system%29 Lustre] based scratch directories. }} | ||
=== SCRATCH directories === | === SCRATCH directories / workspace mechanism === | ||
For large files and fast I/O [http://en.wikipedia.org/wiki/Lustre_%28file_system%29 Lustre] based scratch directories are available which make use of the high speed network infrastructure. Scratch directories are available on all compute and login (frontend) nodes via the [[workspace mechanism|'''WORKSPCE MECHANISM''']]. | For large files and fast I/O [http://en.wikipedia.org/wiki/Lustre_%28file_system%29 Lustre] based scratch directories are available which make use of the high speed network infrastructure. Scratch directories are available on all compute and login (frontend) nodes via the [[workspace mechanism|'''WORKSPCE MECHANISM''']]. | ||
{{Note|text=To get the best performance using [[MPI-IO]] it may be necessary to use tune the file distribution }} | {{Note|text=To get the best performance using [[MPI-IO]] it may be necessary to use tune the file distribution }} | ||
Revision as of 14:51, 16 February 2020
Users' HOME directories are located on a shared RAID system and are mounted via NFS on all login (frontend) and compute nodes. The path to the HOME directories is consistent across all nodes. The filesystem space on HOME is limited by a small quota!
SCRATCH directories / workspace mechanism
For large files and fast I/O Lustre based scratch directories are available which make use of the high speed network infrastructure. Scratch directories are available on all compute and login (frontend) nodes via the WORKSPCE MECHANISM.
The available storage capacity is about 25 PB
Filesystem Policy
IMPORTANT! NO BACKUP!! There is NO backup done of any user data located on HWW Cluster systems. The only protection of your data is the redundant disk subsystem. This RAID system is able to handle a failure of one component. There is NO way to recover inadvertently removed data. Users have to backup critical data on their local site!
Long term storage
For data which should be available longer than the workspace time limit allowed and for very important data storage, please use the High Performance Storage System HPSS