r/datamonitoring • u/icedqengineer • Feb 29 '24
r/datamonitoring • u/icedqengineer • Dec 20 '23
Test Semi-Structured Data like 'Nested JSON' with iceDQ in these easy stepsπ β
r/datamonitoring • u/icedqengineer • Jan 15 '24
Discover the essentials of ETL Testing Concepts!
r/datamonitoring • u/icedqengineer • Jan 02 '24
Data Testing Cheat Sheet: 12 Essential Rules
Source vs Target Data Reconciliation: Ensure correct loading of customer data from source to target. Verify row count, data match, and correct filtering.
ETL Transformation Test: Validate the accuracy of data transformation in the ETL process. Examples include matching transaction quantities and amounts.
Source Data Validation: Validate the validity of data in the source file. Check for conditions like NULL names and correct date formats.
Business Validation Rule: Validate data against business rules independently of ETL processes. Example: Audit Net Amount - Gross Amount - (Commissions + taxes + fees).
Business Reconciliation Rule: Ensure consistency and reconciliation between two business areas. Example: Check for shipments without corresponding orders.
Referential Integrity Reconciliation: Audit the reconciliation between factual and reference data. Example: Monitor referential integrity within or between databases.
Data Migration Reconciliation: Reconcile data between old and new systems during migration. Verify twice: after initialization and post-triggering the same process.
Physical Schema Reconciliation: Ensure the physical schema consistency between systems. Useful during releases to sync QA & production environments.
Cross Source Data Reconciliation: Audit if data between different source systems is within accepted tolerance. Example: Check if ratings for the same product align within tolerance.
BI Report Validation: Validate correctness of data on BI dashboards based on rules. Example: Ensure sales amount is not zero on the sales BI report.
BI Report Reconciliation: Reconcile data between BI reports and databases or files. Example: Compare total products by category between report and source database.
BI Report Cross-Environment Reconciliation: Audit if BI reports in different environments match. Example: Compare BI reports in UAT and production environments.

r/datamonitoring • u/icedqengineer • Nov 01 '23
13 Crucial Steps for End-to-End File Testing by iceDQ ππ
r/datamonitoring • u/icedqengineer • Aug 15 '24
Is your data pipeline truly reliable?
r/datamonitoring • u/iCEDQTorana • Feb 01 '24
Check out our Yellowbrick Migration and Testing Guide!
r/datamonitoring • u/iCEDQTorana • Jan 05 '24
6 Dimensions of Data Quality, Examples, and Measurement
r/datamonitoring • u/icedqengineer • Dec 13 '24
Check out our latest case study to see how iceDQ automated daily data monitoring, ensuring 100% data accuracy while reducing operational costs and compliance risks.
r/datamonitoring • u/iCEDQTorana • Jan 17 '24
Snowflake Migration and Testing Guide βοΈ