Smart Talk Episode 9: Apache Iceberg And Streaming Data Architectures
RTInsights, Thursday, February 6th, 2025
Tomer Shiran, Co-Founder of Dremio, provides an insider's perspective about Apache Iceberg, its emergence as a standard table format, and how AI is optimizing query performance.
While data lakes seemed to be an innovative and relevant solution to many data challenges a few years ago, they were still rife with issues pertaining to data management, ACID compliance with transactions, query optimization etc.
A need for a common table format arose and several open standards started competing for universal acceptance. Apache Iceberg emerged as the clear winner in spite of Delta Lake and Apache Hudi having a huge fan base as well. Dremio is one of the companies that has backed Iceberg since the early days.
In this episode, Dinesh Chandrasekhar, Chief Analyst and Founder, Stratola interviews Tomer Shiran, Co-founder of Dremio to get an insider's perspective about Apache Iceberg and how it is adopted in the industry today.