Canarys Automations - ETL Test Engineer

• Design, develop, and execute comprehensive ETL test plans and test cases to ensure data quality, integrity, and accuracy across various data sources and targets.
• Perform extensive data validation, reconciliation, and transformation testing using complex SQL queries.
• Develop and maintain automated ETL test scripts using Python, leveraging frameworks and libraries for efficient testing.
• Test data pipelines and workflows built on AWS platforms, specifically demonstrating strong understanding and experience with AWS Airflow / DAG concepts.
• Lead and participate in Cloud Migration Testing initiatives, ensuring seamless and accurate data transfer during cloud transitions.
• Collaborate closely with data engineers, developers, and business analysts to understand data models, business rules, and transformation logic.
• Identify, document, and track defects, working with development teams to ensure timely resolution.
• Contribute to the continuous improvement of ETL testing processes, methodologies, and automation frameworks.
• Analyze complex data sets and identify potential data quality issues.
• (Nice to have) Explore and implement other automation skill sets to enhance testing efficiency.
  

Skills & Experience

Mandatory Skills

• Strong SQL proficiency : Ability to write complex queries for data validation, reconciliation, and analysis.
• Strong ETL Testing experience : Proven track record in testing data transformations, data loading, and data warehousing solutions.
• Strong Python programming skills : Experience in writing scripts for automation, data processing, and test execution.
• Strong AWS knowledge : Hands-on experience with AWS services relevant to data, specifically strong understanding of AWS Airflow / DAG concepts.
• Cloud Migration Testing : Demonstrated experience in testing data migration projects to cloud environments.
  

Desired Skills (Nice To Have)

• Experience with other automation tools or frameworks beyond Python.
• Familiarity with data visualization tools.
• Knowledge of data warehousing concepts and dimensional modeling