- Infos im HLRS Wiki sind nicht rechtsverbindlich und ohne Gewähr -

Difference between revisions of "HPSS User Access"

From HLRS Platforms
Jump to navigationJump to search
(Use templates for commands, minor improvements in text, link to the HPSS user guide.)
Line 4: Line 4:
 
Initiate the ftp connection to HPSS using
 
Initiate the ftp connection to HPSS using
  
  ftp hpsscore.hww.de 4021
+
{{Command| command=ftp hpsscore.hww.de 4021}}
  
when requested, please provide your username and password.
+
When requested, please provide your username and password.
The password is your general hww password (as your have it
+
The password is your general hww password (as you have it
 
for Hermit for example).
 
for Hermit for example).
ftp will check the .netrc file in the user's home directory,
+
 
 +
ftp will check the <tt>.netrc</tt> file in the user's home directory,
 
where e.g. login information can be given and the the ftp command
 
where e.g. login information can be given and the the ftp command
 
can be used in e.g. scripts without a password prompt (see ftp man pages).
 
can be used in e.g. scripts without a password prompt (see ftp man pages).
Line 15: Line 16:
 
in a .netrc file.
 
in a .netrc file.
  
'''Please note:''' For technical reasons a password change  
+
{{Note| text=For technical reasons a password change  
is valid on HPSS with a one day delay.
+
is valid on HPSS with a one day delay.}}
  
 
=== Class of Service ===
 
=== Class of Service ===
Line 32: Line 33:
 
moving the file into HPSS. Before the transfer, you have to specify at the
 
moving the file into HPSS. Before the transfer, you have to specify at the
 
ftp prompt:
 
ftp prompt:
  site setcos <cos id>
+
{{Command| command=site setcos <cos id>}}
 
 
 
Default setting for the cos id is 112. The setting of the cos id is valid for all
 
Default setting for the cos id is 112. The setting of the cos id is valid for all
 
following file transfers.
 
following file transfers.
Line 46: Line 46:
 
network connections or at least several parallel I/O streams.
 
network connections or at least several parallel I/O streams.
  
to start the client, you should specify the number of parallel streams.
+
To start the client, you should specify the number of parallel streams. We recommend a setting of 2.
 
 
We recommend a setting of 2.
 
  
  pftp_client -w2 hpsscore 4021
+
{{Command| command=pftp_client -w2 hpsscore 4021}}
  
 
When requested, please provide your username and password.
 
When requested, please provide your username and password.
The password is your general hww password (as your have it
+
The password is your general hww password (as you have it
 
for the SX-8 for example).
 
for the SX-8 for example).
  
'''Please note:''' For technical reasons a password change  
+
{{Note| text=For technical reasons a password change  
is valid on HPSS with a one day delay.
+
is valid on HPSS with a one day delay.}}
  
 
Compared to the ftp access, there is no setting for the class of service
 
Compared to the ftp access, there is no setting for the class of service
 
necessary as this is done automatically by the pftp_client.
 
necessary as this is done automatically by the pftp_client.
  
For a parallel put please use the pput command instead of put.
+
Use the parallel ''pput'' and ''pget'' commands instead of the normal ''put'' and ''get''.
For a parallel get, please use pget.
 
  
 
More details of using ftp and pftp to access HPSS can be found in
 
More details of using ftp and pftp to access HPSS can be found in
the official user guide which will be available here soon.
+
the official [http://www.hpss-collaboration.org/user_doc.shtml User's guide].
  
 
== Other Access Methods ==
 
== Other Access Methods ==

Revision as of 14:36, 15 April 2014

Currently, there are two methods to access the HPSS complex:

FTP

Initiate the ftp connection to HPSS using

ftp hpsscore.hww.de 4021


When requested, please provide your username and password. The password is your general hww password (as you have it for Hermit for example).

ftp will check the .netrc file in the user's home directory, where e.g. login information can be given and the the ftp command can be used in e.g. scripts without a password prompt (see ftp man pages). Be aware of security issues, if a password is stored in plain text in a .netrc file.

Note: For technical reasons a password change is valid on HPSS with a one day delay.


Class of Service

When putting files into HPSS you have to specify a so called class of service. The class of service depends on the file size. The following values are possible:

112: size < 2GB

122: 2GB < size < 8GB

132: size > 8GB

You have to specify the class of service for a file prior to moving the file into HPSS. Before the transfer, you have to specify at the ftp prompt:

site setcos <cos id>

Default setting for the cos id is 112. The setting of the cos id is valid for all following file transfers.

Beside the setting of the class of service, this option works just like normal ftp.

Parallel FTP

On LAKI, there is a Parallel FTP client available.

The advantage of Parallel FTP is a file transfer which makes use of several parallel network connections or at least several parallel I/O streams.

To start the client, you should specify the number of parallel streams. We recommend a setting of 2.

pftp_client -w2 hpsscore 4021


When requested, please provide your username and password. The password is your general hww password (as you have it for the SX-8 for example).

Note: For technical reasons a password change is valid on HPSS with a one day delay.


Compared to the ftp access, there is no setting for the class of service necessary as this is done automatically by the pftp_client.

Use the parallel pput and pget commands instead of the normal put and get.

More details of using ftp and pftp to access HPSS can be found in the official User's guide.

Other Access Methods

Currently, there are no other access methods available. Especially, there is currently no access to HPSS available from outside the hww network. For a transfer of stored files to your home site, please move these files to a system within hww where you have scp access. This is an intermediate solution, we plan to provide a method for a direct transfer within the next months.