ETL / Database Testing

Job Description

Job Description: We are seeking an experienced ETL / Database Testing Specialist with expertise in IceDQ and Java/Python scripting to join our dynamic data engineering team. This position will be responsible for ensuring the integrity, performance, and accuracy of data in various data pipelines, as well as performing ETL testing and quality checks to maintain high data standards. The successful candidate will have strong skills in database testing, data profiling, and automated scripting for quality assurance. Key Responsibilities: ETL Testing: Design, develop, and execute ETL test plans and test cases. Perform functional, regression, and performance testing for ETL processes. Validate data extraction, transformation, and loading into data warehouses and data lakes. Identify data discrepancies and work with development teams to resolve issues. Database Testing: Conduct database validation and integrity tests to ensure consistency across various environments (e.g., development, staging, production). Validate data transformation logic and perform checks for data accuracy and completeness. Work with SQL to write complex queries for database testing and troubleshooting. Ensure proper handling of database constraints, triggers, and stored procedures. IceDQ (Data Quality Tool) Testing: Utilize IceDQ tools for data profiling, cleansing, and quality checks. Configure and maintain IceDQ scripts for data validation. Work closely with data engineering teams to integrate IceDQ with data pipelines and automate data quality checks. Scripting and Automation: Write and maintain Java/Python scripts for automation of ETL processes and data validation tasks. Develop automated test cases for continuous integration/continuous delivery (CI/CD) pipelines. Enhance and optimize ETL test automation frameworks. Collaboration and Reporting: Collaborate with business analysts, data engineers, and other stakeholders to understand requirements and ensure proper test coverage. Provide regular test execution status updates and detailed reports to the project teams. Investigate and troubleshoot data issues, and provide solutions to improve the quality of data flows. Required Skills and Qualifications: Education: Bachelors degree in Computer Science, Information Technology, or a related field. Experience: 3+ years of experience in ETL Testing , Database Testing , and working with data quality tools. Strong expertise in IceDQ for data profiling and validation. Proficiency in Java and/or Python scripting for test automation and data validation tasks. Solid understanding of ETL processes , including data extraction, transformation, and loading. In-depth knowledge of SQL and experience writing complex queries for testing purposes. Familiarity with CI/CD processes and automation frameworks. Strong problem-solving skills and attention to detail. Excellent communication skills, with the ability to work well in cross-functional teams.