AWS Glue Data Quality Is Generally Available
AWS News, Tuesday, June 6,2023
We are excited to announce the General Availability of AWS Glue Data Quality.
Our journey started by working backward from our customers who create, manage, and operate data lakes and data warehouses for analytics and machine learning. To make confident business decisions, the underlying data needs to be accurate and recent. Otherwise, data consumers lose trust in the data and make suboptimal or incorrect decisions.
For example, medical researchers found that across 79,000 emergency department encounters of pediatric patients in a hospital, incorrect or missing patient weight measurements led to medication dosing errors in 34% of cases. A data quality check to identify missing patient weight measurements or a check to ensure patients' weights are trending within certain thresholds would have alerted respective teams to identify these discrepancies.