ETL Development Lead

Key Responsibilities

• Develop, test, and maintain

  ETL pipelines

  using Python and related frameworks.
• Extract data from diverse sources (databases, APIs, flat files, cloud storage).
• Transform raw data into structured formats optimized for analytics and reporting.
• Load data into target systems such as

  data warehouses, data lakes, or relational databases

  .
• Collaborate with data analysts, engineers, and business stakeholders to understand requirements.
• Implement

  data validation, error handling, and logging

  to ensure pipeline reliability.
• Optimize ETL processes for

  performance and scalability

  .
• Monitor and troubleshoot production pipelines, ensuring timely resolution of issues.
• Document ETL workflows, data dictionaries, and technical specifications.

Required Skills

• Strong programming skills in

  Python

  (pandas, PySpark, SQLAlchemy, etc.).
• Experience with

  ETL tools

  (Airflow, Luigi, Prefect, or custom Python scripts).
• Solid understanding of

  SQL

  and relational databases (PostgreSQL, MySQL, SQL Server, Oracle).
• Familiarity with

  data warehousing concepts

  (star schema, snowflake schema, OLAP).
• Knowledge of

  cloud platforms

  (AWS, Azure, GCP) and their data services (Redshift, BigQuery, Snowflake).
• Experience with

  version control systems

  (Git) and CI/CD pipelines.
• Strong problem-solving and debugging skills.
• Ability to work in

  agile development environments

  .

Preferred Qualifications

• Experience with

  big data frameworks

  (Hadoop, Spark).
• Knowledge of

  containerization

  (Docker, Kubernetes).
• Exposure to

  data governance, security, and compliance

  practices.
• Familiarity with

  REST APIs

  and data integration patterns.