Skip to main content

Using Globus Online with Quest

Overview

Globus is a Software-as-a-Service (SaaS) that provides a program interface for file transfer and sharing, as well as identity, profile, and group management. It provides high performance, secure, third party data movement and synchronization between endpoints.

A Globus transfer handles all the difficult aspects of data transfer allowing by optimizing parameters to maximize bandwidth usage, managing security configurations, providing automatic fault recovery, and notifying users of completion and problems. Command line and web interfaces are available for use.

When to Use Globus

  1. Transferring very large data sets (larger than a few GBs). Globus uses GridFTP, a high performance transfer protocol that uses parallel TCP streams for optimal bandwidth. For large transfers (TBs and above), it is significantly faster (8X) than using scp, rsync or sftp.
  2. Collaboration and data sharing. Many national labs, universities, and data centers around the world use it for data management.
  3. “Fire and forget” transfers so that users can start transferring files and work on something else, while it automatically optimizes transfer settings, retries any failed attempts, and emails you when the file transfer is done. In case of any dropped network connection, it picks up right where it left off and performs a checksum to check for file corruption and confirms the data integrity.

Requirements

  1. If you want to transfer from a laptop, workstation, install Globus Connect Personal to set up a personal endpoint that will allow you to share files to and from this machine.
    1. After installing Globus Connect, run the application and you will be asked for a setup key.
    2. Log into Globus Online, select Manage Data and then Dashboard and click on Globus Connect Personal and enter an endpoint name to uniquely identify your machine.
    3. Click Generate Setup Key, copy and paste the setup key into the Globus Connect window to complete the setup process.
    4. Your endpoint is added to the list of endpoints and should be identified under the format <Globus-username>#<Globus-connect-endpoint-name>.
  2. If you want to transfer from another campus storage system or HPC cluster, the system must be setup as a Server endpoint. This is typically done by system administrators.
  3. National cyberinfrastructure resources established Globus endpoints. For example, the XSEDE project is under the format xsede#<resource-name>. For example the Stampede system at Texas Advanced Computing Center is named xsede#stampede.

Usage: Transfer to/from Quest

  1. Sign in to Globus and select Manage Data from then Transfer Files from the submenu.
  2. Type the name of your personal endpoint in the left panel, hit “Enter” or click on the “Go” button to access your files and directories. Make sure that you have Globus Connect running on your laptop or workstation.
  3. In the right panel, type northwestern#quest and use your NetID and Password to log in and gain access to Quest. Note: You will be asked to select an Identity Provider (Northwestern University) and redirected to NU Online Passport to log in through a websso authentication.
  4. Choose files to transfer, and request the transfer with one of the directional arrows. A green notification panel will appear to confirm that the transfer request has been submitted. Once the transfer is completed, you will see an activity notice at the bottom of the Transfer Files page.

Last Updated: 21 August 2017

Get Help Back to top