Google Cloud Storage

Connecting a Google Cloud Storage Data Source

What is Google Cloud Storage?

Google Cloud Storage (GCS) is a popular way to store data in the cloud. Like Amazon S3, data is stored in "buckets". HyperLabel supports syncing data sets from both public and private buckets. You will need access to the Google Cloud Platform to take advantage of GCS.

Creating a bucket

For instructions on setting up a Google Cloud Storage bucket, see here.

Bucket Permissions

GCS buckets have varying levels of permissions. In general, public buckets are available to everyone, whereas private buckets require Service Account Keys to use. If your bucket is private, ensure that this checkbox is unchecked and locate Service Account Key in the Service Account Key JSON File field. Buckets are private by default, but you can make them public by following these steps. A private bucket will need to grant authenticated users read access in order for HyperLabel to use it. At minimum, a service account will need to be added as a member of the bucket with a "Storage Object Viewer" role. Private buckets will require credentials tied to this service account. You can see more on creating a Service Account Key JSON file.

Adding a Google Cloud Storage Data Source

Once you've configured and uploaded your data set to your bucket, you can now add a Google Cloud Storage data source in HyperLabel. Data Source Name - A friendly name for your data source. This is how it will display in your list of data sources. Example, Chess Images Bucket Name - The globally-unique name for your bucket. Be sure this is spelled correctly with no trailing spaces. Example, my-sample-project File Name Filter - You can use this optional field to filter files within a data source by name. Check out the File Name Filter Guide for more information on how to use this filter. Example, *-june-* or images/** Upload Service Account Key JSON File - Upload the JSON file containing the credentials to access a private bucket. More info