- Infos im HLRS Wiki sind nicht rechtsverbindlich und ohne Gewähr -
- Information contained in the HLRS Wiki is not legally binding and HLRS is not responsible for any damages that might result from its use -

HPSS Introduction

From HLRS Platforms
Jump to navigationJump to search

General

The High Performance Storage System (HPSS) is developed by a collaboration consisting of several labs in the US and led by IBM. HPSS is a Hierarchical Storage Management System (HSM) and it is designed to manage petabytes of data stored on disks and in tape libraries. More information on the system can be found here: http://www.hpss-collaboration.org/

Currently HPSS at HLRS manages 500 TB of disk storage and more than 4PB tape storage held in two copies.

Hardware

In the HPSS complex, 19 x86 servers are building a distributed system consisting of a core server, disk as well as tape movers. Each system is equipped with 32 cores on 2 sockets using 32 GB (movers) or 128GB (core server) of main memory.

Metadata is redundantly held on IBM v3700 Storwize device.

As disk cache, 4 SNA460 are used controlling 500TB disk space.

The tapes are stored in two spatially separated copies on IBM TS3500 Tape libraries with approx. 4000 tapes. The first copy is stored on EO7 Jaguar media whereas the second copy is stored on LTO6 media technology.

Software

We are currently using HPSS version 7.4.2 distributed by IBM. HPSS is a Hierarchical Storage Management System (HSM) which is able to manage petabytes of data on disk and tape storage and is used by the big HPC sites across the world. A map of users can be found here: http://www.hpss-collaboration.org/documents/HPSSWorldMap.pdf.