Using Research Archival Storage

There are two primary ways to move data to and from Research Archival Storage:

Viewing data on the Archival System

You can use SFTP to browse the file system on the Archival System.  Note that this can only be done from on-campus or when connected to the campus VPN:

[user@hpc-login] $ sftp export
Warning: Permanently added 'export,' (ECDSA) to the list of known hosts.
Connected to archival.
sftp > cd /archival/[MY_VOLUME]

There are a number of free and open-source graphical SFTP clients.  We provide links to some on our data transfer page.

Transferring data via Globus

Globus is the preferred way to move data between the RAS and any system, on or off-campus.  Globus works similarly to FTP, but is more reliable and includes features to ease transfer or large amounts of data that may take a long time.  A Globus Account and the Globus Client App are required on any system that you wish to move data to or from.

Refer to our Globus documentation for information about how to setup Globus and transfer data.

Moving data via SFTP, SCP, or RSYNC

You can use an SFTP client, or SCP/RSYNC on the command-line to transfer data between on-campus systems and the Research Archival System.  This allows you to easily move data around either manually or via scripted solutions:

# Copy a file from HPC or Spear to RAS using SCP
[user@hpc-login] $ scp some-local.file[MY_VOLUME]

The SCP command is highly scriptable and can be used to automate data transfer to/from the RAS as part of a normal job processing workflow.  Read our SFTP documentation for more information about this method.

NOTE: Users are not allowed to log in to via the terminal (SSH). Only SFTP, SCP, and RSYNC are available.  If you need additional access, please contact RCC support.

Backup Disclaimer

We do not provide backups for data on the Research Archival Storage system.  The RAS is a robust enterprise-grade storage system with multiple redundancies and a very high level of reliability.  However, as with any system, errors can occur.  We do not provide any guarantees or warranty for any data stored on this system.  We advise researchers to bear this in mind when planning for data storage needs.