AWS SDK and Hosted Gateway MT

14min

Hosted S3 Compatible Multitenant Gateway - AWS SDK
Storj now offers a hosted multitenant gateway (Gateway MT)  that is backward compatible with S3. This means you’ll be able to integrate with the Storj network via HTTP, and you won’t have to run anything extra on your end.
By using hosted Gateway MT you are opting into ﻿Design Decision: Server-side Encryption  
Using Gateway MT with AWS CLI is a 2-step process:
﻿﻿AWS SDK and Hosted Gateway MT  
﻿﻿AWS SDK and Hosted Gateway MT﻿
Generate Credentials to the Gateway MTNavigate to the Access page within your project and then click on Create S3 Credentials. A modal window will pop up where you should enter a name for this access grant.
﻿
﻿
Assign the permissions you want this access grant to have, then click on Encrypt My Access:
﻿
Enter the Encryption Passphrase you used for your other access grants. If this is your first access grant, we strongly encourage you to use a mnemonic phrase as your encryption passphrase (The GUI automatically generates one on the client-side for you.)
﻿
This passphrase is important! Encryption keys derived from it are used to encrypt your data at rest, and your data will have to be re-uploaded if you want it to change!
Importantly, if you want two access grants to have access to the same data, they must use the same passphrase. You won't be able to access your data if the passphrase in your access grant is different than the passphrase you uploaded the data with.
Please note that Storj does not know or store your encryption passphrase, so if you lose it, you will not be able to recover your files.
Click either on the Copy to clipboard link or Download .txt and confirm that you copied your Encryption Phrase to a safe place.
﻿
Click the Create my Access link to finish generating of S3 credentials.
﻿
Copy your Access Key, Secret Key, and Endpoint to a safe location or download them.
Now you are ready to configure AWS SDK
Gateway MT with Amazon S3 SDK (Node.js)1. Install or include the Amazon S3 SDKe.g. with npm
Terminal
|
npm install --save aws-sdk
npm install --save aws-sdk
﻿
2. Import the S3 clientTerminal
|
import S3 from "aws-sdk/clients/s3";
import S3 from "aws-sdk/clients/s3";
﻿
3. Create client object with MT credentialsTerminal
|
const accessKeyId = "access key here";
const secretAccessKey = "secret access key here";
const endpoint = "https://gateway.storjshare.io";

const s3 = new S3({
  accessKeyId,
  secretAccessKey,
  endpoint,
  s3ForcePathStyle: true,
  signatureVersion: "v4",
  connectTimeout: 0,
  httpOptions: { timeout: 0 }
});
const accessKeyId = "access key here";
const secretAccessKey = "secret access key here";
const endpoint = "https://gateway.storjshare.io";

const s3 = new S3({
  accessKeyId,
  secretAccessKey,
  endpoint,
  s3ForcePathStyle: true,
  signatureVersion: "v4",
  connectTimeout: 0,
  httpOptions: { timeout: 0 }
});
﻿
4. List objects and log to consoleTerminal
|
(async () => {

  const { Buckets } = await s3.listBuckets({}).promise();
  
  console.log(Buckets);

})();
(async () => {

  const { Buckets } = await s3.listBuckets({}).promise();
  
  console.log(Buckets);

})();
﻿
5. Upload an objectTerminal
|
(async () => {

  // `file` can be a readable stream in node or a `Blob` in the browser

  const params = {
    Bucket: "my-bucket",
    Key: "my-object",
    Body: file
  };

  await s3.upload(params, {
    partSize: 64 * 1024 * 1024
  }).promise();
  
})();
(async () => {

  // `file` can be a readable stream in node or a `Blob` in the browser

  const params = {
    Bucket: "my-bucket",
    Key: "my-object",
    Body: file
  };

  await s3.upload(params, {
    partSize: 64 * 1024 * 1024
  }).promise();
  
})();
﻿
6. Get URL that points to an objectThe getSignedUrl function creates a cryptographically signed url. No contact with the gateway is needed here; this happens instantaneously.
Terminal
|
const params = {
  Bucket: "my-bucket",
  Key: "my-object"
}

const url = s3.getSignedUrl("getObject", params);

// e.g. create an <img> where src points to url
const params = {
  Bucket: "my-bucket",
  Key: "my-object"
}

const url = s3.getSignedUrl("getObject", params);

// e.g. create an <img> where src points to url
﻿
﻿