Data transfer needs take many forms. Here we address common data set transfers to and from the Summit HPC system. See CU Boulder’s Data Transfer page for other file transfer methods supported on Summit and for a detailed step-by-step process to initiate the file transfers on Summit. Please let us know at rc2-request@colostate.edu what other forms of data transfer you would like to see added here.
SFTP
The sftp utility is an interactive alternative to scp that allows multiple, bi-directional transfer operations in a single session. Within a sftp session, a series of domain-specific file system commands can be used to navigate, move, remove, and copy data between a local system and Research Computing resources.
Good for small data sets (<25MB) i.e. batch scripts, small files, error logs, etc.
Good for medium data sets (25MB to 10GB) i.e. codes, software files, libraries, small datasets, output files, etc.
Globus
Globus transfers can be used on MacOS, Windows, and Linux OS and is research computing’s recommended way of transferring data. The file transfer is initiated through an interactive web application. See the Get Started with Globus page to learn more.
Good for large data sets (over 10GB) i.e. large output files, large datasets, large models, etc.