Still Too Much Duct Tape In Data Transformation, Dbt Labs' Handy Says
BigDATAwire, Tuesday, October 8th, 2024
While real progress has been made in streamlining some aspects of big data analytics workflows, there is still too much duct tape keeping it all together, according to Tristan Handy, the founder and CEO of dbt Labs, which today unveiled a slew of enhancements to dbt Cloud at its annual user conference.
Dbt has emerged as one of the most popular tools for preparing data for analytics. Instead of writing raw SQL code, data engineers write dbt's syntax to create models that define the data transformations that need to be performed, while respecting dependencies up and down the stack. At runtime, a dbt user calls one model or series of models to execute a transformation in a defined, declarative manner. It's DevOps discipline meets data engineering, or DataOps.