Senior Data Engineer - ETL/Data Warehousing

About The Role

Key Responsibilities

• Design, develop, and maintain ETL/ELT pipelines for structured and unstructured data from multiple sources (loan management systems, payment gateways, transaction logs, external APIs like CIBIL).
• Build and manage data lakes and data warehouses for analytics and machine learning use cases.
• Optimize data ingestion and processing frameworks for real-time and batch workflows.
• Implement data quality, validation, and monitoring systems.
• Work closely with Data Scientists, AI Engineers, and BI teams to deliver high-quality datasets for model training and dashboards.
• Ensure data security and compliance with RBI guidelines, GDPR, and internal policies.
• Collaborate with MLOps engineers for model deployment pipelines.
• Troubleshoot data-related issues and optimize performance for scalability.
• Document data models, workflows, and processes.
  

Required Skills & Qualifications

Education :

Experience :

Technical Skills

• Strong programming skills in Python (Pandas, PySpark) or Java/Scala.
• Proficient in SQL and NoSQL databases (PostgreSQL, MongoDB, Cassandra).
• Experience with big data technologies : Apache Spark, Hadoop, Kafka.
• Hands-on with ETL tools (Airflow, Prefect, Luigi).
• Familiarity with cloud platforms (AWS/GCP/Azure) and data services (S3, BigQuery, Redshift).
• Knowledge of data lake and warehouse design.
  

Bonus Skills

• Experience with real-time streaming (Kafka, Kinesis).
• Exposure to MLOps and AI/ML data pipelines.
• Understanding of fintech data structures (KYC, transactions, credit scoring).
  

Soft Skills

• Strong problem-solving and analytical skills.
• Ability to work in a fast-paced, agile environment.
• Excellent communication and documentation skills.
  

Compliance & Security Awareness

• Familiarity with RBI guidelines, data localization, and data privacy regulations.
• Experience implementing data encryption and masking techniques.
  

Why Join Us?

• Work on cutting-edge AI and analytics solutions in the fintech domain.
• Be part of a new AI innovation team with high visibility and impact.
• Opportunity to design data architecture from the ground up.
• Competitive compensation, flexible work culture, and growth opportunities