ETL Automation Engineer

As a QA Automation Engineer specializing in Data Warehousing, you will play a critical role in ensuring that our data solutions are of the highest quality. You will work closely with data engineers and analysts to develop, implement, and maintain automated testing frameworks for data validation, ETL processes, data quality, and integration. Your work will ensure that data is accurate, consistent, and performs optimally across our data warehouse systems.

Responsibilities

• Develop and Implement Automation Frameworks: Design, build, and maintain scalable test automation frameworks tailored for data warehousing environments.
• Test Strategy and Execution: Define and execute automated test strategies for ETL processes, data pipelines, and database integration across a variety of data sources.
• Data Validation: Implement automated tests to validate data consistency, accuracy, completeness, and transformation logic.
• Performance Testing: Ensure that the data warehouse systems meet performance benchmarks through automation tools and load testing strategies.
• Collaborate with Teams: Work closely with data engineers, software developers, and data analysts to understand business requirements and design tests accordingly.
• Continuous Integration: Integrate automated tests into the CI/CD pipelines, ensuring that testing is part of the deployment process.
• Defect Tracking and Reporting: Use defect-tracking tools (e.g., JIRA) to log and track issues found during automated testing, ensuring that defects are resolved in a timely manner.
• Test Data Management: Develop strategies for handling large volumes of test data while maintaining data security and privacy.
• Tool and Technology Evaluation: Stay current with emerging trends in automation testing for data warehousing and recommend tools, frameworks, and best practices.

Job Qualifications:

Requirements and skills

· At Least 4+ Years Experience

• Solid understanding of data warehousing concepts (ETL, OLAP, data marts, data vault,star/snowflake schemas, etc.).

· Proven experience in building and maintaining automation frameworks using tools like Python, Java, or similar, with a focus on database and ETL testing.

· Strong knowledge of SQL for writing complex queries to validate data, test data pipelines, and check transformations.

· Experience with ETL tools (e.g., Matillion, Qlik Replicate) and their testing processes.

· Performance Testing

· Experience with version control systems like Git

· Strong analytical and problem-solving skills, with the ability to troubleshoot complex data issues.

· Strong communication and collaboration skills.

· Attention to detail and a passion for delivering high-quality solutions.

· Ability to work in a fast-paced environment and manage multiple priorities.

· Enthusiastic about learning new technologies and frameworks.

Experience with the following tools and technologies are desired.

• QLIK Replicate

• Matillion ETL

• Snowflake

• Data Vault Warehouse Design

• Power BI

• Azure Cloud – Including Logic App, Azure Functions, ADF