How This Helps

Use this method to quickly create datasets from publicly hosted S3 buckets. Ideal for demos, testing, or ingesting open datasets without manual upload.

​
Prerequisites

This feature is only supported in cloud-hosted environments.

​
Make the API Request

To create a dataset using a public S3 bucket, send a POST request to the following endpoint:

​
Request

POST /api/v1/dataset
Headers: Authorization: Bearer <jwt>

​
Required Form Parameters

  • dataset_name: (string) – The name of the dataset to create
  • bucket_path: (string) – The path to the public S3 bucket containing your data

​
Example

curl -X POST -H "Authorization: Bearer <jwt>" \
     -F dataset_name=api_test \
     -F bucket_path=public_test_bucket \
     https://app.visual-layer.com/api/v1/dataset
The dataset_id returned in the response will be used for all future operations on that dataset.