Datasets

Ingested data sources: upload, refresh, schema, and lineage.

📄️Read Datasets

Cursor-paginated. The wire query parameter is `exclusiveStartKey` (what the cURL tab and the parameter table show); the TypeScript SDK takes it as the `exclusiveStartKey` option and the Python SDK as the `exclusive_start_key` keyword — one parameter, spelled per language. Pass the previous page's `nextKey` and stop when it comes back `null` — or let `iterAll()` / `iter_all()` drive the cursor for you (see the SDKs page, 'Pagination').

📄️Create Dataset

Create Dataset

📄️Get Datasets Catalog

Iceberg catalog overview for the current account.

📄️Read Folder Datasets

Cursor-paginated. The wire query parameter is `exclusiveStartKey` (what the cURL tab and the parameter table show); the TypeScript SDK takes it as the `exclusiveStartKey` option and the Python SDK as the `exclusive_start_key` keyword — one parameter, spelled per language. Pass the previous page's `nextKey` and stop when it comes back `null` — or let `iterAll()` / `iter_all()` drive the cursor for you (see the SDKs page, 'Pagination').

📄️Download Public Dataset

Create a dataset from a public data source and trigger download

📄️Search Public Datasets

Search for public datasets from a specific source

📄️Get Enabled Public Dataset Sources

Get list of enabled public dataset sources

📄️Get Public Dataset Suggestions

Get random popular datasets from all providers

📄️Validate Sql Query

Validate a SQL query using sqlglot syntax validation, then run with LIMIT 1.

📄️Delete Dataset

Delete Dataset

📄️Read Dataset

Read Dataset

📄️Update Dataset

Update Dataset

📄️Get Dataset Freshness

HOW OLD ARE THESE NUMBERS — the newest value in the data's own time column.

📄️Get Dataset Iceberg Metadata

Full Iceberg table metadata for a single dataset.

📄️Get Dataset Lineage

Alias of `GET /v1/lineage?node=dataset:{dataset_id}&direction=both&depth=3`,

📄️Mark Dataset Ready

Return a FAILED dataset to READY WITHOUT re-ingesting — for the case where

📄️Transfer Dataset Ownership

Transfer ownership of a dataset to another user. Requires owner or admin role.

📄️Refresh Dataset

Manually trigger a dataset refresh.

📄️Repartition Dataset

Start an Iceberg-native maintenance (repartition) job for a dataset.

📄️Reset Checkpoint

Clear the incremental checkpoint, forcing next refresh to fetch all data.

📄️Retry Dataset

Re-run a FAILED dataset's own ingestion (edit permission).

📄️Retry Public Dataset Download

[DEPRECATED — alias kept for one release, remove after ~2026-10-05]

📄️Set Primary Keys

Set primary keys on an Iceberg dataset and trigger compaction to enforce uniqueness.

📄️Create Dataset Upload

Create Dataset Upload

📄️Load Dataset Upload

Ingest an uploaded file into the dataset — append to its rows, or REPLACE them.