Accessing Object Storage from the Boole HPC Platform

s3cmd is available to all users in the cluster for accessing S3-compatible object storage services.

Configure s3cmd

s3cmd --configure

When prompted, enter the following configuration details:

Access Key: <your access key>
Secret Key: <your secret access key>
Default Region: <your default region>
S3 Endpoint: <your S3 endpoint>
DNS-style: no
Encryption password: [Press Enter]
Path to GPG program: [Press Enter]
Use HTTPS protocol: [Press Enter]
HTTP Proxy server name: [Press Enter]
Save settings? [y/N] y

Example: CloudCIX Object Storage Configuration

Configuring s3cmd to use the CloudCIX Object Storage:

s3cmd --configure
Access Key: <your access key>
Secret Key: <your secret access key>
Default Region: boole-zonegroup
S3 Endpoint: s3-boole.cloudcix.com
DNS-style: no
Encryption password: [Press Enter]
Path to GPG program: [Press Enter]
Use HTTPS protocol: [Press Enter]
HTTP Proxy server name: [Press Enter]
Save settings? [y/N] y

Basic Usage Examples

# Create a bucket
s3cmd mb s3://test
Bucket 's3://test/' created

# Upload a file
s3cmd put file.txt s3://test
upload: 'file.txt' -> 's3://test/file.txt'  [1 of 1]
 0 of 0     0% in    0s     0.00 B/s  done

# Download a file
s3cmd get s3://test/file.txt
download: 's3://test/file.txt' -> './file.txt'  [1 of 1]
 0 of 0     0% in    0s     0.00 B/s  done