…sights bounded to mins by automating data availability to be directly proportional to data quality. This approach also eliminates the unsustainable fire-fighting required for verifying-&-fixing metrics/reports on a case-by-case basis.The rest of the blog describes details for implementing and deploying circuit breakers and divided i…
This is very interesting. Currently we don’t want to stop data, event if it is dirty. We do add error message instead inside the data so that downstream process could decide.
However, that means dirty data can come through and make downstreams dirty.
We might need to consider this design decision sometime in the future, whether it’s better to give data user two choice only 1) data exist and correct 2) data is not exist and incorrect