Key Responsibilities:
Develop and implement test strategies, test cases, and automation scripts to validate data pipelines in Azure and Databricks environments.
Perform data validation, reconciliation, and comparative analysis between source and target systems.
Validate ETL/ELT pipelines built using ADF and Databricks.
Collaborate with Data Engineers and Product Owners to understand STM (Source-to-Target Mapping) and ensure transformation logic is correctly implemented.
Monitor and validate data quality across Delta tables, and Data Warehouses.
Identify data anomalies, document defects, and drive them to resolution with the engineering team.
Support CI/CD pipelines by integrating data testing into DevOps workflows.
Contribute to test data management, metadata validation, and regression testing.
Provide regular reporting on test execution results, defect metrics, and QA health.
Required Skills:
Proven experience in data QA/validation in cloud-based data platforms.
Strong knowledge of Azure Data Factory, Databricks.
Proficiency in SQL and scripting languages such as Python.
Hands-on experience with data profiling, data reconciliation, and schema validation.
Understanding of SCD Type 2 and data transformation logic.
Familiarity with DevOps tools like Azure DevOps or GitHub Actions for CI/CD integration.
Experience working with large datasets, performance testing, and data lineage tools.
...At PwC, our people in business application consulting specialise in consulting services for a variety of business applications, helping... ...professional and technical standards (e.g. refer to specific PwC tax and audit guidance) the Firm's code of conduct, and independence...
...winning oyster and cocktail bar Maison Premiere is currently hiring Bartender/Bar Backs to join and grow with our bar team, under the... ...most successful bartenders joined our program with little to no experience. With a dual commitment from both our team and the right...
..., OPT, STEM OPT, CPT, TN, J-1, etc.) The Role: This Communications support will support the GM Motorsports Communications team across... ...and wellbeing benefit programs. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts...
...Well-established CPA firm in the West Hartford area for over 70 years. Seeking a college graduate to entry level staff accountant. The ideal candidate will be expected to assist on a variety of work including bookkeeping, payroll, and the preparation of financial statements...
...General Summary of the Position : Perform tasks necessary for the day to day operation of a water treatment facility, which includes the operation and maintenance of water wells, distribution system, wastewater treatment plant, collection system, and pump stations....