BC Project: FY14-02
Date of Policy: 08 Sep 2014
Last Updated: 25 Mar 2019 (see Revision Log)
The transfer queue is a batch queue that is configured for the sole purpose of allowing users to transfer data into and out of the High Performance Computing (HPC) platforms at each center. Users are able to submit batch scripts to move data between the various storage areas/file systems within a given center using a common set of commands. The transfer queue environment supports all environment variables defined by BC policy FY05-04 (Environment Variables), especially those referring to storage locations. The transfer queue has a wall clock limit of at least 48 hours.
The following storage areas are accessible from the transfer queue:
- Workspace (The temporary work file system of the machine on which the job is running).
- Center Wide File System (CWFS).
- The Mass Storage Archival System (MSAS) of the site.
For transferring data between the MSAS and either the Workspace or CWFS, one of the following must be supported:
archivecommand and its associated subcommands
mkdir, defined in BC policy FY06-09 (Common Archival Retrieval),
- The standard Posix commands,
For sample script(s), please see BC policy FY06-15 (Sample Code Repository).
A summary of queue information for the participating centers can be found at the HPC Centers website.
|25 Mar 2019||Transfer queue wall clock limit increased to at least 48 hours|
|20 Sep 2018||BC Team Audit|