You are here

HOWTO: Transfer files using Globus Connect

Globus Connect is a reliable, high-performance file transfer platform allowing users to transfer large amounts of data seamlessly between systems. It aims to make transfers a "click-and-forget" process by setting up configuration details in the background and automating fault recovery.

Globus can be used for both file transfers between OSC and:

A computing institution with Globus installed (check with your site provider for availability) or

A personal computer (known as a personal endpoint)

Users transferring between OSC and another computing institution with​ Globus installed do not need to install Globus Connect Personal or add OSC certificate authority files, and can skip to Step 3.

If you are looking to transfer smaller sized files you can utilize OnDemand's file transfer capabilities, or use a SFTP client to connect to sftp.osc.edu. Our general recommendation is that for small files - measured in MB to several hundred MB - to use OnDemand or SFTP. You can continue to use SFTP and get reasonable performance up to file sizes of several GB. For transfers of several GB or larger, you should consider using Globus Online.

Changing directories accessible to Globus

By default Globus will only add certain default folders to the list of files and directories accessible by Globus. To change/add/remove files and directories from this list:

Windows

Start Globus Connect Personal

Go to Tools -> Options

Add directories/files using the "+" button

Remove directories/files using the "-" button

Revert to the default accessible directories/files using the "Reset to Defaults" button

Any changes you make are not made permanent until you press the "Save" button

​​Mac

Start Globus Connect Personal

Go to Preferences -> Access

Add directories/files using the "+" button

Remove directories/files using the "-" button

Revert to the default accessible directories/files using the "Reset to Defaults" button

Any changes you make are not made permanent until you press the "Save" button

2. Adding OSC Certificate Authority Files

This process will add Certificate Authority files to your computer to ensure you are a trusted endpoint. If you installed Globus on a Windows computer, and also installed it to the default directory, we have provided this as a automated process. Linux and Mac installations, as well as Windows installations to non-default locations, will need to follow the manual instructions below.

To open the contents of the Globus Connect Personal.app folder, right click the folder in Finder and select "Show Package Contents"

Windows - Typically found within /Program Files

Linux - Where you unzipped the tarball

Open the ca directory within the etc directory found in the installation directory

Copy all the files in the unzipped archive, except copy_auth, to the ca directory located previously

3. Creating a MyProxy Certificate

These steps will create a short lived certificate on OSC's systems to ensure you are a valid OSC user. This certificate will be good for 0.5 days (11 hours), after which you will need to repeat this process to transfer to/from OSC again. Repeating this process will overwrite your old certificate, meaning you will need to change the Credentials for osc#Glenn on the Globus website immediately after.

Login to Glenn using your OSC username and password (ssh to Glenn.osc.edu)

Usage

If transferring to a computer with Globus Connect Personal installed, this will be the unique name chosen during installation

Enter osc#glenn as the other endpoint

If this is your first time connecting to Glenn through Globus, or if your credentials have expired, you will be prompted to Activate the Endpoint

Enter your OSC username

Enter the passphrase created during the "Creating a MyProxy Certificate"

You can now transfer files and directories both ways by selecting them and pressing the arrow indicating which way you'd like to transfer

Once a transfer has begun, you do not need to keep the Globus webpage up, but you will need to make sure the Globus Connect Personal Client is running on your computer until it has completed. If the transfer is interrupted for any reason, Globus will attempt to re-initiate the transfer automatically.