GCP

Suggest Edits

Your data is uploaded to, and securely stored in the Files section of Index where it is organized into folders and sub-folders. Importing your data into Encord is a multi-step process:

  1. Create a GCP integration.
  2. Create a folder to store your data in Encord.
  3. Upload your data to the folder.

Step 1: Create a GCP Integration

Before you can do anything with the Encord platform and cloud storage, you need to configure your cloud storage to work with Encord. Once the integration between Encord and your cloud storage is complete, you can then use your data in Encord.

In order to integrate with GCP, you need to:

  1. Set up a GCP bucket on the Google Cloud Platform so that it can be integrated with Encord. This includes setting up a CORS configuration for your bucket.

  2. Integrating your GCP bucket with Encord's platform.

👍

Tip

See our GCP integration documentation for a detailed guide to setting up a GCP integration.

Step 2: Create a folder

  1. Navigate to Files section of Index in the Encord platform.
  2. Click + New folder.
    A dialog to create a new folder appears.
  1. Give the folder a meaningful name and description.
  2. Click Create to create the folder.
    The folder is listed in Files.

Step 3: Upload your data to the folder

👍

Tip

We recommend uploading smaller batches of data: limit uploads to 100 videos and up to 1000 images at a time. Familiarize yourself with our limits and best practices for data import before uploading data to Encord.

  1. Navigate to Files section of Index in the Encord platform.
  2. Click + Upload files.
    A dialog appears.
  1. Select the folder you created in step 2.
  2. Click the Import from private cloud option.
  3. Select the integration you created in step 1 to add your cloud data.

👍

Tip

We recommend turning on the Ignore individual file errors feature. This ensures that individual file errors do not lead to the whole upload process being aborted.

  1. Click Add JSON or CSV files to add a JSON or CSV file specifying cloud data that is to be added.
  2. Click Import to add your GCP data.

Updated about 1 month ago