Lakehouse
A lakehouse separates stateless compute from infinitely scalable object storage: compute can start, stop, and scale independently while data remains durable in buckets. Altertable Lakehouse builds on that model with catalogs that define what you query, Workers that run SQL, Buckets that store table files in object storage, and external catalogs that connect existing databases, warehouses, and file-backed buckets.
The core pieces are:
- Catalogs define tables: Altertable catalogs are hosted lakehouse databases for new managed tables. Altertable stores those tables as Parquet files and handles file layout, compaction, caching, and query execution together.
- Workers run SQL: Workers execute DuckDB SQL, cache hot data locally, and connect Altertable to your sources. Use managed Workers, or deploy them in your own infrastructure.
- Buckets store files: Buckets are object storage locations for lakehouse data. Use managed Buckets, or connect an existing bucket so data stays in the account, region, and governance boundary you already operate.
- External catalogs connect existing data: External catalogs make databases, warehouses, and file-backed buckets queryable from Altertable without moving them into managed lakehouse storage first.
At runtime, clients send SQL to Workers. Workers read and write Parquet files in object storage, use local SSD for hot data, and can also query external databases and warehouses.
╔════════════════ Altertable ════════════════════╗ ╔════════════╗ ║ ║░ ║ ║░ ║ ┏━━━━━━━━━━━━━━━━━━┓ ┏━━━━━━━━━━━━━━━┓ ║░ ║ Client ║░───HTTP──▶║ ┃ Workers ┃ ┃ Object ┃ ║░ ║ ║░ ║ ┃ ┌──┐ ┌──┐ ┌──┐ ┃ ┃ Storage ┃ ║░ ║ ║░ ║ ┃ │W1│ │W2│ │WN│ ┃───▶┃ ┌─────────┐ ┃ ║░ ║ ║░ ║ ┃ └──┘ └──┘ └──┘ ┃ ┃ │ Parquet │ ┃ ║░ ║ ║░ ║ ┃ ┃ ┃ │ File 1 │ ┃ ║░ ║ ║░ ║ ┗━━━━━━━━┬━━━━━━━━━┛ ┃ └─────────┘ ┃ ║░ ╚════════════╝░ ║ │ ┃ ┃ ┌─────────┐ ┃ ║░ ░░░░░░░░░░░░ ║ ┏━━━━━━━┻━━━━━━┓ ┃ ┃ │ Parquet │ ┃ ║░ ║ ┃ Local SSD ┃ ┃ ┃ │ File... │ ┃ ║░ ║ ┃ Cache ┃ ┃ ┃ └─────────┘ ┃ ║░ ║ ┗━━━━━━━━━━━━━━┛ ┃ ┃ ┌─────────┐ ┃ ║░ ║ ┃ ┃ │ Parquet │ ┃ ║░ ║ ┃ ┃ │ File N │ ┃ ║░ ║ ┃ ┃ └─────────┘ ┃ ║░ ║ ┃ ┗━━━━━━━━━━━━━━━┛ ║░ ║ ┃ ║░ ╚════════════════════════════════════════════════╝░ ░░░░░░░░░░░░░░░░░░░░░┃░░░░░░░░░░░░░░░░░░░░░░░░░ ┃ ┃ ┏━━━━━━━━━━━━━━━┓ ┃ ┃ |░ ┃ ┃ External |░ ┗───▶┃ DB & Warehouse|░ ┃ |░ ┗━━━━━━━━━━━━━━━┛░ ░░░░░░░░░░░░░░░░
Managed and external catalogs
Use Altertable catalogs when you are creating new lakehouse tables on Altertable. Use external catalogs to query existing databases, warehouses, and file-backed buckets alongside those managed tables in the same SQL engine.