IBM Databand: Self-Learning For Anomaly Detection
IBM News, Friday, February 2nd, 2024
Almost a year ago, IBM encountered a data validation issue during one of our time-sensitive mergers and acquisitions data flows. We faced several challenges as we worked to resolve the issue, including troubleshooting, identifying the problem, fixing the data flow, making changes to downstream data pipelines and performing an ad hoc run of an automated workflow.
After the immediate issue was resolved, a retrospective analysis revealed that proper data validation and intelligent monitoring might have alleviated the pain and accelerated the time to resolution. Instead of developing a custom solution solely for the immediate concern, IBM sought a widely applicable data validation solution capable of handling not only this scenario but also potential overlooked issues.