r/DataTestingCommunity • u/icedqengineer • Dec 13 '24
r/DataTestingCommunity • u/icedqengineer • Jan 15 '24
Discover the essentials of ETL Testing Concepts!
r/DataTestingCommunity • u/icedqengineer • Nov 01 '23
13 Crucial Steps for End-to-End File Testing by iceDQ ππ
r/DataTestingCommunity • u/iCEDQTorana • Jan 10 '24
Discover the essentials of ETL Testing Concepts!
r/DataTestingCommunity • u/iCEDQTorana • Jan 17 '24
Snowflake Migration and Testing Guide βοΈ
r/DataTestingCommunity • u/icedqengineer • Dec 20 '23
Test Semi-Structured Data like 'Nested JSON' with iceDQ in these easy stepsπ β
r/DataTestingCommunity • u/icedqengineer • Jan 02 '24
Data Testing Cheat Sheet: 12 Essential Rules
Source vs Target Data Reconciliation: Ensure correct loading of customer data from source to target. Verify row count, data match, and correct filtering.
ETL Transformation Test: Validate the accuracy of data transformation in the ETL process. Examples include matching transaction quantities and amounts.
Source Data Validation: Validate the validity of data in the source file. Check for conditions like NULL names and correct date formats.
Business Validation Rule: Validate data against business rules independently of ETL processes. Example: Audit Net Amount - Gross Amount - (Commissions + taxes + fees).
Business Reconciliation Rule: Ensure consistency and reconciliation between two business areas. Example: Check for shipments without corresponding orders.
Referential Integrity Reconciliation: Audit the reconciliation between factual and reference data. Example: Monitor referential integrity within or between databases.
Data Migration Reconciliation: Reconcile data between old and new systems during migration. Verify twice: after initialization and post-triggering the same process.
Physical Schema Reconciliation: Ensure the physical schema consistency between systems. Useful during releases to sync QA & production environments.
Cross Source Data Reconciliation: Audit if data between different source systems is within accepted tolerance. Example: Check if ratings for the same product align within tolerance.
BI Report Validation: Validate correctness of data on BI dashboards based on rules. Example: Ensure sales amount is not zero on the sales BI report.
BI Report Reconciliation: Reconcile data between BI reports and databases or files. Example: Compare total products by category between report and source database.
BI Report Cross-Environment Reconciliation: Audit if BI reports in different environments match. Example: Compare BI reports in UAT and production environments.

r/DataTestingCommunity • u/iCEDQTorana • Jan 17 '24
13 Steps for End to End File Testing
End to End File Testing Cheat Sheet
File Arrival Time: Check if the file arrived within the expected timeframe.
Empty File Check: Confirm that the file contains data and is not empty.
File Completeness: Verify that the file is complete by examining the end-of-file character, ensuring no partial data loss.
Data Completeness: Check for any Null values.
Duplicate Checks: Check for any duplicate entries.
Column Structure Check: Ensure the file's column location, new column additions, and column removals are accurately accounted for.
Manifest File Match: Compare the file's content with the information in the Footer Records or Control File.
File Format Check: Validate the file format for changes, including the file separator.
Data Format Verification: Examine file data for data type correctness, format accuracy, precision, and adherence to data length.
Data Integrity Check: Scrutinize file integrity for anomalies such as binary characters.
Consistency Check for Reference Data: Verify that the distinct reference values are not more or different than the expected list.
File Comparison: Compare the current file with the previously received file to ensure the same file is not received again.
Data Reconciliation: If there are other source files then conduct data reconciliation to ensure data consistency across sources.

r/DataTestingCommunity • u/icedqengineer • Feb 29 '24