Full Time Hiring -Scala Data Engineer- Bangalore - Hybrid

JD

Technical Skills:

• Languages: Scala, Java • Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie
• Big Data Processing: Hadoop, Kafka, Spark & Spark Structured Streaming.
• Experience on SOLID & DRY principles with Good Software Architecture & Design implementation experience
• Advanced Scala experience (e.g. Functional Programming, using Case classes, Complex Data Structures & Algorithms)
• Proficient in developing automated frameworks for unit & integration testing.
• Experience with Docker and Helm and related container technologies.
• Proficient in deploying and managing Spark workloads on Kubernetes clusters.
• Experience in evaluation and implementation of Data Validation & Data Quality
• Devops experience in Jenkins, Maven, Github, Github actions, CI/CD

Nice-to-Have Skills:

• Familiarity with data governance frameworks and compliance practices.
• Experience with wide range of Range of Big Data tools, databases & frameworks e.g. Kafka Connect, Apache Arrow, Apache Iceberg, Flink
• SQL & NoSQL DB: Cassandra, Dremio, Presto
• Security & Secrets Management like Ansible Vault, Snyk, Git Secrets, Hashi Corp Vault.

Mandatory Skills:

Senior Data Engineer

Scala

Spark

Hadoop

SQL

Azure Cloud

Python

Data Optimization & Performance Tuning