Amazon S3

Connecting a Amazon S3 Data Source

What is Amazon S3?

Amazon Simple Storage Service (S3) is a popular solution for storing data in the cloud. Amazon S3 stores resources in "buckets". HyperLabel supports syncing data sets from both public and private buckets. You will need access to an Amazon Web Services (AWS) account to take advantage of Amazon S3.

Creating a bucket

For instructions on setting up an Amazon S3 bucket, see here.

Public vs. Private buckets

AWS S3 buckets have varying levels of permissions. In general, public buckets are available to everyone, whereas private buckets require security tokens to access. If your bucket is private, be sure the "Public Bucket" is unchecked when adding the data source. You will need to add your security credentials using the Access Key ID and Secret Access Key fields. Buckets are private by default, but you can easily make them public during creation. For more detailed information on how to give buckets public read access, see this page. Note: if you are using a public bucket, you have to grant Public Access to Everyone along with List objects access. For more information, see step 4c here.

Adding an Amazon S3 Data Source

Once you've uploaded your data set to your bucket, you can use HyperLabel to add your Amazon S3 data source.

Data Source Name - A friendly name for your data source. This is how it will display in your list of data sources. Example, Chess Images Bucket Name - The name of the bucket you're connecting to. Be sure this is spelled correctly with no trailing spaces. Example, hyper-label-chess-images Access Key ID - Key identifier used to sign requests to AWS. When using a private bucket, you will need credentials for the account in the form of the Access Key ID and Secret Access Key. Amazon has a post on Secret Access Keys and where to find them here. Secret Access Key - Secret key used in conjunction with the access key ID to sign requests to AWS. When using a private bucket, you will need credentials for the account in the form of the Access Key ID and Secret Access Key. Amazon has a post on Secret Access Keys and where to find them here.