Senior ETL Developer

Job Title: Senior ETL Developer

Location: Gurugram

Work mode: Monday- Friday (WFO) Odd Saturdays (WFH), Even Saturdays (Off)

Experience: 6+ Years in IT

Notice Period: Immediate to 15 days

Must-Have Experience: (Minimum 5+ years in ETL, with strong Apache NiFi expertise)

Required Skills - Apache Nifi, AWS, SQL, Data Pipeline development using ETL tool, Java/Python

Job Summary

We are seeking an experienced Senior ETL Developer with deep expertise in Apache NiFi, PostgreSQL, and large-scale data pipelines. This role involves building and optimizing high-performance ETL workflows across massive data environments (handling thousands of processors, e.g., 5000+ in a single PG setup). The ideal candidate is a problem solver who thrives in fast-paced environments and has hands-on experience with scalable, reliable, and secure data systems.

Key Responsibilities

• Design, develop, and maintain robust ETL pipelines for large and complex datasets.
• Build, optimize, and troubleshoot SQL/PLpgSQL queries in PostgreSQL, ensuring efficiency in high-concurrency environments.
• Manage and scale environments with 5000+ processor instances in PostgreSQL or equivalent setups.
• Ingest, process, and validate data from multiple sources while ensuring data integrity, consistency, and availability.
• Monitor ETL workflows, identify bottlenecks, and apply performance tuning techniques.
• Collaborate with data architects, analysts, and business stakeholders to define and deliver data requirements.
• Implement and maintain data quality, validation, and reconciliation across systems.
• Document ETL processes, pipelines, and data architectures.
• Ensure compliance with data security, governance, and privacy standards.

Required Skills & Experience

• 5+ years of ETL development experience with complex data workflows.
• Strong hands-on expertise in Apache NiFi (must-have).
• Advanced experience with PostgreSQL (query optimization, scaling in massively parallel systems).
• Proven ability to work in large-scale environments (e.g., 5000+ processor instances).
• Proficiency in SQL, PL/pgSQL, and performance tuning techniques.
• Hands-on experience with ETL tools like Talend, Informatica, Airflow, etc.
• Familiarity with big data ecosystems (Hadoop, Spark, Kafka) is a plus.
• Strong knowledge of data modeling, warehousing, and governance principles.
• Excellent problem-solving, debugging, and analytical skills.

Preferred Qualifications

• Experience with cloud platforms (AWS, GCP, Azure).
• Exposure to DevOps and CI/CD practices for data pipelines.
• Hands-on experience with real-time streaming data processing.
• Knowledge of scripting languages (Python, Bash, etc.).

Education

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.

Job Types: Full-time, Permanent

Pay: ₹2,500,000.00 - ₹3,200,000.00 per year

Application Question(s):

• How many years of experience you have in ETL, with strong Apache NiFi expertise?
• How many years of experience you have in AWS, SQL, Data Pipeline development using ETL tool, Java/Python?
• Notice Period?
• What's your current CTC?

Work Location: In person