Senior Data Engineer

We are looking for a Sr Data Engineer who can start immediately

Mandatory skills:

1. Apache
2. Flink
3. Java
4. Kafka

Looking for Chennai candidates who can join in 15 days.

Client: Product based company ( Chennai)

WFO

Qualifications:

• 8+ years of data engineering experience with large-scale systems (petabyte-level).

• Expert proficiency in Java for data-intensive applications.

• Hands-on experience with lakehouse architectures, stream processing (Flink), and event streaming (Kafka/Pulsar).

• Strong SQL skills and familiarity with RDBMS/NoSQL databases.

• Proven track record in optimizing query engines (e.g., Spark, Presto) and data pipelines.

• Knowledge of data governance, security frameworks, and multi-tenant systems.

• Experience with cloud platforms (AWS, GCP, Azure) and infrastructure-as-code (Terraform). 

Key Responsibilities:

• Architect & Build Scalable Systems: Design and implement petabyte-scale lakehouse architectures (Apache Iceberg, Delta Lake) to unify data lakes and warehouses.

• Real-Time Data Engineering: Develop and optimize streaming pipelines using Kafka, Pulsar, and Flink to process structured/unstructured data with low latency.

• High-Performance Applications: Leverage Java to build scalable, high-throughput data applications and services.

• Modern Data Infrastructure: Leverage modern data warehouses and query engines (Trino, Spark) for sub-second operation and analytics on real-time data.

• Database Expertise: Work with RDBMS (PostgreSQL, MySQL, SQL Server) and NoSQL (Cassandra, MongoDB) systems to manage diverse data workloads.

• Data Governance: Ensure data integrity, security, and compliance across multi-tenant systems.

• Cost & Performance Optimization: Manage production infrastructure for reliability, scalability, and cost efficiency.

• Innovation: Stay ahead of trends in the data ecosystem (e.g., Open Table Formats, stream processing) to drive technical excellence.

• API Development (Optional): Build and maintain Web APIs (REST/GraphQL) to expose data services internally and externally.