ETL Automation Test Engineer

5 - 9 years

0 Lacs

Posted:1 week ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

As an ETL Automation Test Engineer with expertise in Python development, ETL testing, and CI/CD implementation, you will play a crucial role in automating manual ETL processes using Python scripting. Your primary focus will be on designing, developing, and executing ETL test cases and scripts to ensure the validation of data pipelines. You will be responsible for performing data validation, reconciliation, and integrity checks across various source and target systems. Your role will involve implementing Python-based test automation frameworks for ETL workflows and integrating automated ETL tests into CI/CD pipelines to facilitate seamless deployments. You will collaborate closely with Data Engineers and DevOps teams to optimize ETL automation processes, debug issues, troubleshoot challenges, and enhance performance, accuracy, and scalability. To excel in this role, you must have a minimum of 5 years of hands-on experience in Python development and scripting. Your strong background in ETL testing, data validation, and data transformation testing, along with proficiency in SQL queries for data validation, will be essential. Additionally, hands-on experience with CI/CD tools such as Jenkins, GitHub Actions, GitLab CI, and Azure DevOps is required. Familiarity with ETL tools like Informatica, Talend, AWS Glue, or DBT, as well as experience working with data warehouses (e.g., Snowflake, Redshift, BigQuery), is highly desirable. You should possess a solid understanding of data pipelines, data governance, and data quality best practices to ensure the successful execution of ETL automation projects. Preferred qualifications for this role include experience with Cloud platforms (AWS, Azure, GCP) for ETL automation, familiarity with Apache Airflow, Kafka, or similar orchestration tools, and exposure to containerization technologies like Docker and Kubernetes. By joining our team, you will have the opportunity to work on cutting-edge ETL automation projects for a top-tier client. We offer a competitive salary, along with ample career growth opportunities, in a remote-friendly and flexible work environment.,

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You