Small File Problem in Data Lakehouse - Apache Iceberg Compaction
Small files are a common problem in Lakehouse tables such as Apache Iceberg, particularly with streaming workloads that continuously commit data in small batches. In this episode, Dipankar explores how Apache Iceberg compaction helps address the small file problem.