Senior Data Engineer - Scala/Python

Job Title :

Location :

Experience Required :

Job Type :

Notice Period :

About The Role

Key Responsibilities

• Design, develop, and maintain scalable data pipelines, ETL/ELT workflows, and data integration solutions.
• Build and optimize data lake, data warehouse, and analytical data models.
• Work with large, complex datasets and ensure data reliability, quality, and timeliness.
• Implement best practices in data engineering, including CI/CD, code reviews, testing, and documentation.
• Collaborate with Data Science, Analytics, BI, and Product teams to deliver data solutions.
• Develop and manage batch and real-time data processing systems (streaming pipelines).
• Conduct performance tuning, troubleshooting, and optimization of big data jobs.
• Ensure security, governance, and compliance with data standards.
  

Required Skills & Technical Expertise

Core Tech Stack :

• Strong experience with Python / Scala / Java (at least one is mandatory).
  

Expertise In Big Data Frameworks

• Apache Spark, Hadoop ecosystem, Hive, HBase, Kafka
  

Hands-on With Cloud Platforms

• AWS (preferred) / Azure / GCP
  

Services :

• Strong SQL skills ability to write optimized, complex queries.
• Experience building distributed and scalable data systems.