Etl Developer

ETL Developer IBM DataStage / Snowflake / SQL / Unix

Location:

Banglore

Experience:

Min 4 year of experience

ETL Developer

This role ensures data is efficiently moved, cleaned, and transformed from various source systems into target databases (e.g., Snowflake, SQL Server, DataStage).

Key Responsibilities:

• Design, develop, and deploy

  ETL workflows

  using tools like

  IBM InfoSphere DataStage

  ,

  Informatica

  , or

  Python-based ETL frameworks

  .

• Design, develop, and maintain

  ETL workflows

  using Python and SQL.
• Develop automation scripts and data processing pipelines leveraging

  NumPy, Pandas, PySpark, and Py4J

  .
• Establish and manage

  database connections

  , fetch and process result sets, and ensure data integrity across systems.
• Perform

  file I/O operations

  , including CSV file processing, file validation, and email automation.
• Extract data from multiple sources (databases, APIs, flat files) and transform it into standardized formats.
  
• Optimize and tune ETL jobs for

  performance and scalability

  .
• Implement

  error handling, logging, and recovery mechanisms

  in ETL processes.
• Collaborate with data analysts, BI teams, and application developers to deliver reliable data pipelines.
  
• Maintain documentation for ETL jobs, data flows, and business rules.
  
• Troubleshoot ETL failures and support production data loads.
  
• Ensure

  data integrity, security, and quality

  across systems.

Required Skills:

• Proficiency in

  ETL tools

  (e.g.,

  IBM InfoSphere DataStage

  ,

  Informatica

  , or equivalent).
• Strong

  SQL

  and

  database query optimization

  skills.
• Experience with

  data warehouse concepts

  (staging, fact/dimension models).
• Working knowledge of

  Unix/Linux shell scripting

  .
• Familiarity with

  Snowflake

  or other cloud-based data platforms.
• Strong analytical and problem-solving abilities.
  

Role Objective:

seamless and efficient data movement