Datafold home pagelogo
  • Login
  • Request a Demo
  • Request a Demo
Documentation
API Reference
Frequently Asked Questions
Datafold home pagelogo
  • About Datafold
  • Blog
  • FAQ
    • Overview
    • Data Diffing
    • CI/CD Testing
    • Data Migration Automation
    • Data Reconciliation
    • Data Monitoring and Observability
    • Integrating Datafold with dbt
    • Data Storage and Security
    • Performance and Scalability
    • Resource Management
    FAQ

    Data Storage and Security

    Datafold ingests and stores various types of data to ensure accurate data quality checks and insights:

    • Metadata: This includes table names, column names, and queries executed in the data warehouse.
    • Data for Data Diffs:
      • For in-database diffs, all data visible in the app, including data samples, is fetched and stored.
      • For cross-database diffs, all data visible in the app, including data samples, is fetched and stored. Larger amounts of data are fetched for comparison purposes, but only data samples are stored.
    • Table Profiling in Data Explorer: Datafold stores samples and distributions of data to provide detailed profiling.
    Integrating Datafold with dbtPerformance and Scalability
    linkedinxgithubyoutube
    Powered by Mintlify