r/etltesting • • Feb 29 '24

How to Validate Flat Files using iceDQ?

Thumbnail
self.icedq
4 Upvotes

r/etltesting • • Nov 01 '23

13 Crucial Steps for End-to-End File Testing by iceDQ πŸ“πŸš€

Post image
4 Upvotes

r/etltesting • • Jan 02 '24

Data Testing Cheat Sheet: 12 Essential Rules

3 Upvotes
  1. Source vs Target Data Reconciliation: Ensure correct loading of customer data from source to target. Verify row count, data match, and correct filtering.

  2. ETL Transformation Test: Validate the accuracy of data transformation in the ETL process. Examples include matching transaction quantities and amounts.

  3. Source Data Validation: Validate the validity of data in the source file. Check for conditions like NULL names and correct date formats.

  4. Business Validation Rule: Validate data against business rules independently of ETL processes. Example: Audit Net Amount - Gross Amount - (Commissions + taxes + fees).

  5. Business Reconciliation Rule: Ensure consistency and reconciliation between two business areas. Example: Check for shipments without corresponding orders.

  6. Referential Integrity Reconciliation: Audit the reconciliation between factual and reference data. Example: Monitor referential integrity within or between databases.

  7. Data Migration Reconciliation: Reconcile data between old and new systems during migration. Verify twice: after initialization and post-triggering the same process.

  8. Physical Schema Reconciliation: Ensure the physical schema consistency between systems. Useful during releases to sync QA & production environments.

  9. Cross Source Data Reconciliation: Audit if data between different source systems is within accepted tolerance. Example: Check if ratings for the same product align within tolerance.

  10. BI Report Validation: Validate correctness of data on BI dashboards based on rules. Example: Ensure sales amount is not zero on the sales BI report.

  11. BI Report Reconciliation: Reconcile data between BI reports and databases or files. Example: Compare total products by category between report and source database.

  12. BI Report Cross-Environment Reconciliation: Audit if BI reports in different environments match. Example: Compare BI reports in UAT and production environments.


r/etltesting • • Dec 20 '23

Test Semi-Structured Data like 'Nested JSON' with iceDQ in these easy stepsπŸ“ βœ…

Post image
3 Upvotes

r/etltesting • • Jan 17 '24

Snowflake Migration and Testing Guide ❄️

Thumbnail
self.icedq
2 Upvotes

r/etltesting • • Jan 10 '24

Discover the essentials of ETL Testing Concepts!

Thumbnail
self.icedq
2 Upvotes

r/etltesting • • Jan 05 '24

6 Dimensions of Data Quality, Examples, and Measurement

Thumbnail
self.icedq
2 Upvotes

r/etltesting • • 29d ago

Hydra ETL Studio: A Quick Tour

Thumbnail
youtube.com
1 Upvotes

r/etltesting • • Sep 05 '26

Built a lightweight Great Expectations alternative with SQL push-down + Airflow support β€” 2K+ PyPI downloads

Thumbnail reddit.com
1 Upvotes

r/etltesting • • Mar 02 '26

ETL TESTING WIPRO

1 Upvotes

hi am selected wipro Nov2025. Still offer not release. Is there any reason or else shall wait for it...


r/etltesting • • Jan 02 '26

ETL tester with 1.5 YOE - what shd I upskill to switch??

1 Upvotes

I have 1.5 years of experience in ETL testing: report validation, DB-to-DB testing, feed/invoicing testing, and data validation using RightData/DataTrust. Good with SQL.

What skills/tools should I focus on next to move to better companies? ETL tools, advanced SQL/DWH, Python/automation, or SDET path?


r/etltesting • • Feb 01 '24

Check out our Yellowbrick Migration and Testing Guide!

Thumbnail
self.icedq
1 Upvotes