Your data is uploaded to, and securely stored in the Files section of Index where it is organized into folders and sub-folders. Importing your data into Encord is a multi-step process:

  1. Create an OTC integration.
  2. Create a folder to store your data in Encord.
  3. Upload your data to the folder.

Step 1: Create an OTC Integration

Before you can do anything with the Encord platform and cloud storage, you need to configure your cloud storage to work with Encord. Once the integration between Encord and your cloud storage is complete, you can then use your data in Encord.

In order to integrate with OTC, you need to:

In order to integrate with Open Telecom Cloud, you need to:

  1. Create the account which accesses data in the Object Storage Service.
  2. Give the account read access to the desired buckets by:
    1. Creating a Custom Bucket Policy.
    2. (Optional) If you have Cross-origin resource sharing (CORS) configured on your buckets, make sure that *.encord.com is given read access.
  3. Create the integration by giving Encord access to that account's credentials.

👍

Tip

See our OTC integration documentation for a detailed guide to setting up an OTC integration.

Step 2: Create a folder

  1. Navigate to Files section of Index in the Encord platform.
  2. Click + New folder.
    A dialog to create a new folder appears.
  1. Give the folder a meaningful name and description.
  2. Click Create to create the folder.
    The folder is listed in Files.

Step 3: Upload your data to the folder

👍

Tip

We recommend uploading smaller batches of data: limit uploads to 100 videos and up to 1000 images at a time. Familiarize yourself with our limits and best practices for data import before uploading data to Encord.

  1. Navigate to Files section of Index in the Encord platform.
  2. Click + Upload files.
    A dialog appears.
  1. Select the folder you created in step 2.
  2. Click the Import from private cloud option.
  3. Select the integration you created in step 1 to add your cloud data.

👍

Tip

We recommend turning on the Ignore individual file errors feature. This ensures that individual file errors do not lead to the whole upload process being aborted.

  1. Click Add JSON or CSV files to add a JSON or CSV file specifying cloud data that is to be added.
  2. Click Import to add your OTC data.