- When Production and Staging environments are not built using the same data. For example, if Staging is built using a subset of production data, filters can be applied to ensure that both environments are on par and can be diffed.
- To improve Datafold CI performance by reducing the volume of data compared, e.g., only comparing the last 3 months of data.
WHERE
clause to allow you to filter data on both sides using standard SQL filter expressions. They can be added to dbt YAML under the meta.datafold.datadiff.filter
tag: