HPSS Introduction

General

The High Performance Storage System HPSS is developped by several Labs in the US in cooperation with IBM. HPSS is a Hierarchical Storage Management System (HSM) and it is developped to manage petabytes of data stored on disks and in tape libraries.

HPSS at HLRS manages 288 TB of disk storage and more than a petabyte tape storage.

Usage

For the user, there are currently two ways to access the HPSS environment to store data: ftp and parallel ftp. More information about this is given in the User Access section. Please remember always, that your data is stored on tape and might be on disk. Especially, if you have not touched your data for a longer time, it will happen that your data is located on tape only. This may result in some latency at the begin of data transfers when reading data.

Class of Service

The only control instrument visible to the outside is the class of service (cos). Each class of service has an id which is used to specify the class of service to be used. The current setup knows three class of service for general usage with different chracteristics.

cos 112 is for files sized smaller than 2 GB

cos 122 is for files larger than 2 GB but small than 8 GB

cos 132 is for files larger than 8 GB

Depending on the class of service, the internal handling of files is different. Please find more information about this in the chapter Configuration Details below.

Hardware

In the HPSSSc omplex, 10 server PC's are working as metadata server and data movers. Each system is equipped with 8 CPU cores on 4 sockets using 16 GB or 32 GB of main memory. Additinally, each systems has 10 GBit Ethernet, Infiniband and Fibre Channel adapters.

Software

We are using the current version of HPSS (High Performance Storage System) distributed by IBM. HPSS is a Hierarchical Storage Management System (HSM) which is able to manage Petabytes of data on disk and tape storage.