Decentralised Cloud Storage

Objective 

Investigate the potential of using Storj Decentralised Cloud Service for scientific data sharing the Rucio scientific data management framework.

Summary of work undertaken 

– We shared scientific dataset using Storj DCS through Zenodo (e.g. https://doi.org/10.5281/zenodo.6369178).

– Performance for upload and download of data on Storj DCS using Rclone was monitored.

– We investigated how to configure Storj DCS as a storage element in Rucio, and performed a synthetic data transfer from a remote Rucio client.

Outputs

– Workflow and scripts to share data on Storj DCS.

– Performance report (https://www.storj.io/resource/university-of-edinburgh-performance-report)

– Documentation of configuration for Storj as a Rucio storage element (https://app.archbee.com/doc/Nf9hb4wvtgW8RxTodjWQ6/8IATlmHE_1fC09IMsHzRN)

Categories: Uncategorized