Globus is a non-profit service for moving, syncing, and sharing large amounts of data asynchronously in the background. Transfers are done from and to, so called, Collections. In order to perform a file transfer from one location to another using the Globus service, both ends must have a Collection. UCSF has a site license for Globus, and several UCSF departments and services, including the Wynton HPC environment, provide Globus Collection. This will allow you to transfer and share data efficiently with any other Globus user in the world.
If you only need to transfer data to or from remote Globus collections to or from your local machine or departmental share, you do NOT need a Wynton HPC Account.
Instead, follow the instructions below to install Globus Connect Personal on your computer.
If you want to transfer files from or to your local machine, you need to set up a personal Collection on that machine. Below is an outline on how to do this. For full details, see the Globus Docs How To.
[local] Make sure Globus Connect Personal is installed on your local machine (available for macOS, Linux, and MS Windows)
[local] (optional) The default is that Globus will have access to all of the content under your home directory, e.g. when connected to Globus you will be able to browse it from the Global website online. To limit this, create a folder to be used solely for Globus transfers, e.g. ~/globus/. Launch the ‘Globus Connect Personal’ software, go to ‘Preferences’ and change the ‘Access Path Configuration’ to ~/globus. Then, click ‘Save’.
[online] Setup a Globus Connect Personal (GCP) Collection for your local machine. Use one GCP collection per machine. This step will produce a GCP Security Key for your local machine. Make sure to write it down in a safe place. If you lose it, you will have to create a new GCP collection.
[local] Launch the ‘Globus Connect Personal’ software, and enter your GCP Security Key code to connect.
[online] Go to Collection -> ‘Administered by You’, go to on your GCP Collection, and click on ‘Open in File Manager’. This will display the files and folders on your local computer. If you restricted access to ~/globus (Step 2), then it is only that folder that is accessible via Globus.
[local] In the Globus Connect Personal software, make sure to disconnect when no longer needed.
[online] (Optional) If you require to transfer data to or from Globus High Assurance Collections, your account must be associated with the “University of California San Francisco High Assurance Globus Plus” Group. To join the group, login to globus.org with your UCSF MyAccess credentials, select the groups side tab, deselect “My Groups”, and search for “University of California San Francisco” - locate the “University of California San Francisco High Assurance Globus Plus” group and hit the join. The person who manages the UCSF Globus subscription will approve any account associated with a UCSF Email Address.
If you want to transfer files from or to your Wynton account, you need to set up the ‘UCSF Wynton HPC’ Collection. Below is an outline on how to do this.
NOTE: You can only use Wynton Globus Collections to share data from Wynton Servers and the Wynton File systems. You cannot use the Wynton Globus Collections to share data mounted on Wynton servers via NFS mounts of remote servers.
Missing Identity Information. Unable to complete the authentication process. Your identity Provider did not release the attributes(s): please follow these steps, “This error is the result of email address privacy settings in the directory. Please ask them to go to UCSF Directory and click the “Edit My Record” button at the top right of the page. They’ll be asked to login via MyAccess (if they haven’t already done so). To the right of the “Email” field on the Edit Your UCSF Directory Entry page that appears, click the pop-up menu (which probably shows “Private” currently) and select either “UCSF Only” or “Public” then click the “Save Changes” button at the bottom of the page. This will tell the SSO system that it’s okay to release the email address to CILogon and other InCommon Federation registered applications.”To use the PHI Compatible Globus ‘UCSF Wynton PDT’ Collection, you must be signed up for Wynton Two-Factor Authentication.
Instead of using the non-PHI-compliant Collection ‘UCSF Wynton HPC’, all PHI data must use the PHI-approved Globus Collection ‘UCSF Wynton PDT’, which is associated with the pdt1 and pdt2 data-transfer nodes.
You must have:
a UCSF Associated Globus Account
a UCSF Account that includes access to UCSF Box
Go to Globus.org and log in with your UCSF MyAccess credentials.
In the “Collections” search field enter “UCSF Wynton HPC Box Connector”.
Select the “UCSF Wynton HPC Box Connector” collection.
You will see a dialog “Authentication Required”, click “continue”.
Next you will see a dialog “Identity Required”. Select your UCSF associated identity, (it will be something like “123456@ucsf.edu”).
Authenticate with MyAccess.
A representation of your UCSF Box files will appear in the Globus panel.
Log in to another Globus Collection to transfer files to or from your UCSF Box file repository to another collection.
Troubleshooting:
To transfer files via the Globus network:
Go to the Globus Online File Manager
Specify the two Collections you wish to transfer files from and to.
Select the files and folders to be transferred and click ‘Start’.
68f06816-cd00-4bf3-ae1f-0597a07ed118)ef126934-6f8a-4af8-81cd-d5b0b7afe51f)98d778c4-75a9-4d8d-8baa-68f71d6568c0)