To ensure smoother uploads and faster completion times, and avoid hitting absolute file limits, we recommend adding smaller batches of data. Limit uploads to 100 videos or up to 1,000 images at a time. You can also create multiple Datasets, all of which can be linked to a single Project. Familiarize yourself with our limits and best practices for data import and registration before adding data to Encord.
Navigate to the Datasets section under the Annotate heading.
Click the Dataset you want to add data to.
Click +Attach existing files.
If the files you want have not been uploaded into Encord yet, click +Upload files to add new files.
Select the folders containing the files you want to attach to the Dataset. To select individual files, double-click a folder to see its contents, and select the files you want to add to the Dataset.
Click Attach data to attach the selected files to the Dataset.
Select a folder to store the files in, or create a new folder.
Select the Import from private cloud tab and select the integration you want to use.
Click Add JSON or CSV files to upload a JSON or CSV file specifying the cloud data that is to be added to the Dataset. Turn on the Ignore individual file errors toggle to ignore errors caused by files not supported by Encord.
We recommend enabling the Ignore individual file errors toggle. This ensures that the entire upload does not fail if only one file cannot be added.
Click Import to add your cloud data to the Dataset.
The data is fetched from your cloud storage and processed asynchronously. This involves fetching appropriate metadata and other file information to help us render the files appropriately and to check for any framerate inconsistencies. We do not store your files in any way.
Mirrored Datasets provide a continuity solution that retains the organization of data prior to the release of Index. With the transition to Index, all existing data within Datasets has been transferred to Files in the form of Mirrored Datasets. Mirrored Datasets can be managed using both the Files and Datasets sections of the Encord platform.For example, moving a file named “chicken.mp4” from a mirrored Dataset titled “Animal videos” to another mirrored Dataset called “Chicken videos”, results in “chicken.mp4” being visible in all Projects associated with “Chicken videos”.
Use the Danger zone pane to delete Datasets.Click the Delete dataset button to delete the entire Dataset. You are prompted to type the word ‘delete’ into the resulting pop-up to delete the Dataset.
Deleting a Dataset cannot be undone. Make sure you want to perform this action before continuing.