Loading...

ALTO Integration Design with Globus

Globus Architecture Review

Globus is a toolkit for resource and data management and running for over 20 years. In the early days, it was designed for Grid Computing Platform only. But nowadays, it has been used in generic data management scenarios.

Notes: The latest globus has become no longer fully open source. Most management component like GRAM (Grid Resource Allocation Management) component has no longer been updated. Instead, Globus provides a cloud service offically to help the resource allocation management.

globus/globus-toolkit

globus-toolkit. Contribute to globus/globus-toolkit development by creating an account on GitHub.

globus/globus-toolkit • github.com

Overview of Globus ( $\le$ V4)

User-uploaded image: image.png

Globus Toolkit (before v5) Components (from: http://www.cloudbus.org/678/Globus.ppt)

Resource and Job Management - GRAM

Resource Monitoring and Discovery - GRIS/MDS

Data Management - GASS

Security - GSI

Online Globus Service

User-uploaded image: image.png

Globus Online Architecture (from: https://www.globus.org/sites/default/files/globus-online-accelerating-and-democratizing-science-through-cloud-based-services.pdf)

User-uploaded image: image.png

Globus Connect Architecture (from: https://www.globus.org/sites/default/files/globus-online-accelerating-and-democratizing-science-through-cloud-based-services.pdf)

User-uploaded image: GCS-v5-terminology.png

Globus Connect Server version 5 (from: https://docs.globus.org/globus-connect-server-v5-installation-guide/#globus_connect_version_5_terminology)

Resource Representation in Globus

Globus provides a tree-like model for the unified resource representation.

User-uploaded image: image.png

Directory Information Tree (DIT) Model (from: https://www.globus.org/sites/default/files/hpdc97-mds.pdf)

Replica Selection using Globus

HTCondor: Matchmaking with ClassAds (See https://htcondor.readthedocs.io/en/v8_8_5/users-manual/matchmaking-with-classads.html)

ClassAd of the application request

hostname = "comet.xyz.com";

reqdSpace = 5G;

reqdRDBandwidth = 50K/Sec;

rank = other.availableSpace;

requirement = other.availableSpace >

5G && other.MaxRDBandwidth >

50K/Sec;

User-uploaded image: image.png

Replica Selection Example (from: https://www.globus.org/sites/default/files/repsel.pdf)

The Globus client will query the DIT by LDAP (Lightweight Directory Access Protocol).

User-uploaded image: image.png

DIT from GRIS (from: https://www.globus.org/sites/default/files/repsel.pdf)

ClassAds of site capabilities