Senior ETL Developer

Skills Required Senior ETL Developer

Mandatory Skills

• ETL Development (8+ Years)

  Strong experience in designing and implementing ETL pipelines.

• AWS Expertise (4+ Years)

  Proven experience in deploying and running data solutions using:
• Amazon S3
• AWS Lambda
• Amazon SNS
• AWS Step Functions

• PySpark Scripting

  Expertise in building scalable data processing pipelines using PySpark.

• Python Programming

  Hands-on experience with libraries like

  NumPy

  and

  Pandas

  for data manipulation.

• Cloud-based ETL Pipelines

  Building and optimizing workflows in a cloud environment (AWS).

• Individual Contributor

  Ability to take ownership of tasks with minimal supervision.

• Data Governance

  (Good to Have) Knowledge of metadata management, data lineage, and governance best practices.

Good to Have Skills

• Large-scale Data Transformation

  Handling both structured and semi-structured data formats.

• Data Lake & Delta Lake

  Experience in building and configuring Delta tables in Data Lake architecture.

• AWS Cost Optimization

  Familiarity with performance tuning and cost-efficient computing strategies.

• Data Integration Frameworks

  Ability to understand the use case and build end-to-end integration solutions.

• Airflow Orchestration (MWAA)

  Working experience with Apache Airflow via Amazon MWAA.

Soft Skills

• Effective Communication

  Strong interpersonal skills to engage with IT stakeholders and business teams.

• Analytical Mindset

  Ability to identify delivery pain points and provide strategic solutions.

• Self-driven and Proactive

  Capable of working independently with a focus on delivery excellence.