Configurable data quality checks

[HamiltonRepoMigrationBot]

Issue by skrawcz
Tuesday Aug 02, 2022 at 16:54 GMT
Originally opened as stitchfix/hamilton#164

---

Is your feature request related to a problem? Please describe.
We should be able to configure whether we want data quality to run or not at DAG build/run time.

Describe the solution you'd like
Allowing for fine-grained control over the behavior of specific checks. This will enable the user to turn on and off certain checks at runtime.

i.e. some configuration that a user can adjust/modify via JSON or YAML or both...

Describe alternatives you've considered
N/A

Additional context
stitchfix/hamilton#149 prototypes some approaches here.

[elijahbenizzy]

Solving this in: #62. Currently, it works on a per-node basis, and everything is done at compile-time (E.G. through config). You have the option to disable/set importance level for

1. all validators just for that node
2. all validators globally

Which I thnk is enough for now. Next would be the option to turn off on a per-check basis. The problem is that we don't expose the check names, so its not easy to know how to turn it off...