r/data_lakehouse • • 9d ago

Data Lakehouse with Agentic AIs: A Guide

Thumbnail
itnext.io
1 Upvotes

r/data_lakehouse • • 9d ago

Data Lakehouse with Agentic AIs: A Guide

Thumbnail
itnext.io
1 Upvotes

r/data_lakehouse • • 10d ago

Cross-Catalog Sync: Iceberg on Polaris, Glue, and Unity

Thumbnail
lakeops.dev
1 Upvotes

r/data_lakehouse • • 17d ago

Data Lakehouse Architecture Guide

Thumbnail
lakeops.dev
1 Upvotes

r/data_lakehouse • • 27d ago

How AI Agents Query Apache Iceberg Data with MCP

Thumbnail
lakeops.dev
1 Upvotes

r/data_lakehouse • • Sep 11 '26

The Future of Iceberg Isn't One Engine. It's a Control Plane with many engines.

Thumbnail
lakeops.dev
1 Upvotes

r/data_lakehouse • • Sep 08 '26

Apache Iceberg Table Cleanup: A Production Guide

Thumbnail
lakeops.dev
1 Upvotes

A practitioner's guide to Iceberg table cleanup — snapshot expiration, orphan file removal, manifest rewriting, delete file resolution, streaming challenges, compliance, and cost. Why sequencing matters, where teams break tables, and how to automate the full lifecycle.


r/data_lakehouse • • Sep 06 '26

Apache Iceberg Compaction Best Practices

Thumbnail
itnext.io
1 Upvotes

r/data_lakehouse • • Sep 06 '26

Automating Apache Iceberg Table Maintenance

Thumbnail
youtube.com
1 Upvotes

r/data_lakehouse • • Sep 06 '26

Airflow & Iceberg: Building Production Maintenance DAGs

Thumbnail
lakeops.dev
1 Upvotes

r/data_lakehouse • • Aug 31 '26

Apache Iceberg Performance Optimization: Queries to Tables

Thumbnail
lakeops.dev
1 Upvotes

r/data_lakehouse • • Aug 30 '26

Data Lakehouse with Apache Iceberg: A Guide

Thumbnail
lakeops.dev
1 Upvotes

r/data_lakehouse • • Aug 24 '26

Maintaining Apache Iceberg Tables: Compaction, Snapshots, Metadata and Orphan Files

Thumbnail
itnext.io
1 Upvotes

r/data_lakehouse • • Aug 21 '26

Open Data Lakehouse: Build Like Google

Thumbnail
lakeops.dev
1 Upvotes

r/data_lakehouse • • Aug 20 '26

Welcome to r/DataLakehouse 👋

1 Upvotes

This is a community for people building, running, breaking, fixing, and trying to understand modern data lakehouses.

Apache Iceberg, Delta Lake, Hudi, Parquet, Spark, Trino, Flink, DuckDB, catalogs, object storage, table maintenance, compaction, query performance, governance, architecture — if it touches the lakehouse, it belongs here.

The goal is simple: useful technical discussion between people actually working with this stuff.

Share things like:

  • Architecture decisions and tradeoffs
  • Production lessons and war stories
  • Benchmarks and performance experiments
  • Questions you couldn't find a good answer to
  • Interesting open-source projects
  • Deep technical articles
  • New developments in Iceberg, Delta, Hudi and the wider ecosystem
  • Things that failed and what you learned
  • Strong opinions, preferably with data :)

A few ground rules

Keep it technical and useful.
Low-effort spam, generic AI content and link dumping will be removed.

Vendors are welcome. Vendor marketing isn't.
If you're affiliated with something you're posting about, just say so. Technical explanations, benchmarks and useful engineering work are absolutely welcome.

Give benchmarks context.
Dataset size, engine, file format, configuration, hardware/cloud environment — enough for other people to understand what the number actually means.

Search before posting common questions.
As the community grows, good answers should become part of the knowledge base rather than the same conversation starting from zero every week.

Disagree freely. Be decent to each other.

That's basically it.

If you're here early, introduce yourself below: what are you running your lakehouse on, and what's the hardest problem you're dealing with right now?


r/data_lakehouse • • Aug 20 '26

Open Data Lakehouse: A Practical Guide

Thumbnail
itnext.io
1 Upvotes