ETL Developer – Informatica & Databricks

Overview

We are seeking an experienced Senior Data Engineer with strong expertise in Informatica PowerCenter, Databricks, PySpark, SQL, and Unix scripting. The ideal candidate will be responsible for modernizing legacy ETL workflows, migrating Informatica pipelines to Databricks, and building scalable data engineering solutions across STG, EDW, and BI layers.

Responsibilities

• Develop, optimize, and maintain ETL pipelines in Databricks using PySpark and Spark SQL.
• Migrate existing Informatica mappings, Unix scripts, and SQL stored procedures to Databricks.
• Analyze legacy ETL workflows to understand data lineage, dependencies, and business logic.
• Build and manage STG, EDW, and BI layers using Delta Lake with proper partitioning, schema evolution, and optimization techniques.
• Implement incremental (SCD1) and full-load strategies with necessary error handling, logging, and recovery mechanisms.
• Support historical data migration, data reconciliation, and performance validation processes.
• Work closely with leads and cross-functional teams to ensure data quality, consistency, and efficiency in transformation logic.
• Participate in peer code reviews, apply performance optimization best practices, and contribute to continuous improvement.
• Assist with Databricks administrative tasks as needed.

Requirements

• 5–8 years of hands-on experience in Data Engineering.
• Strong expertise with Informatica PowerCenter, Databricks, PySpark, SQL Server, and Unix scripting.
• Prior experience with ETL modernization or migration from Informatica (or similar tools) to Databricks or other cloud platforms.
• Excellent proficiency in SQL, data validation techniques, and common ETL design patterns.
• Solid understanding of data warehousing concepts, including STG, EDW, and BI data layers.
• Experience with stored procedures, schema migrations, data profiling, and validation.
• Familiarity with CI/CD pipelines, GitHub/Bitbucket, and modern orchestration tools.
• Strong analytical, debugging, and problem-solving skills.

Location

Hyderabad, India

Salary

TBD

Job Type

Full-time

Date Posted

November 19th, 2025