Etl Qa Databricks

Role: ETL QA -Databricks

We are looking for a Senior ETL QA Engineer with strong experience in ETL testing, SQL, data validation, and Azure Databricks. The candidate will be responsible for validating complex data pipelines, ensuring data accuracy and integrity, and developing scalable testing strategies for enterprise data platforms.

Key Responsibilities

• Design and execute comprehensive test strategies for ETL and data integration processes.
• Perform end to end ETL testing across source, transformation, and target systems.
• Develop complex SQL queries for data validation, reconciliation, and data quality testing.
• Validate data transformations, mappings, business rules, and data pipelines.
• Perform testing of data pipelines and workflows implemented in Azure Databricks.
• Validate data processing and transformations within Databricks environments.
• Identify data discrepancies, perform root cause analysis, and work closely with development and data engineering teams to resolve issues.
• Validate data completeness, accuracy, consistency, and integrity across multiple systems.
• Create and maintain detailed test cases, test scenarios, test scripts, and test execution reports.
• Perform regression, integration, system, and end to end testing.
• Support data quality initiatives and establish scalable validation processes.
• Analyze testing results and provide clear reporting on defects, risks, and data quality issues.
• Collaborate with Data Engineers, Developers, Business Analysts, and other QA professionals.
• Required Skills
• 8+ years of experience in QA and ETL testing.
• Strong hands on experience with ETL testing and data validation.
• Advanced SQL skills.
• Strong experience with Azure Databricks.
• Experience testing data pipelines and data transformations.
• Strong understanding of data warehousing and ETL concepts.
• Experience with data reconciliation and data quality validation.
• Strong analytical and problem solving skills.
• Experience with defect management and test management processes.
• Preferred Skills
• Experience with automated data testing or data automation tools.
• Experience working in Agile environments.
• Healthcare or financial domain experience is a plus.
• Candidate Requirements
• Must be local to Chicago, IL.
• Face to Face interview is required