Senior Data Engineer

Info Services

0 years

0 Lacs

chennai tamil nadu india

Posted:3 hours ago| Platform:

Apply

Skills Required

data integration aws databricks spark programming sql support analytics ai ml design etl redshift messaging code scala drive engineering automation devops apache processing versioning orchestration airflow scalability

Work Mode

On-site

Job Type

Full Time

Job Description

Job Title: Senior Data Engineer

Job Summary

Senior Data Engineer

Key Responsibilities

Design, build, and maintain scalable data pipelines for batch and near real-time data processing.
Develop and optimize ETL/ELT workflows using
Spark, Flink, and Databricks
.
Work extensively within the
AWS ecosystem
(S3, Glue, EMR, Redshift, Lambda, etc.) to build reliable data solutions.
Implement real-time data streaming and messaging solutions using
Kafka
.
Write efficient, reusable, and scalable code in
Scala and Python
.
Design, optimize, and maintain complex queries in
SQL and SparkSQL
.
Collaborate with data scientists, analysts, and other stakeholders to ensure data availability, quality, and governance.
Monitor, troubleshoot, and optimize data workflows for performance and cost-efficiency.
Drive best practices in data engineering, automation, and DevOps for data platforms.

Required Skills & Qualifications

Proven experience in
Batch & Near Real-Time Data Integration
.
Strong hands-on expertise with the
AWS ecosystem
(data services).
Solid experience with
Databricks, Apache Spark, Flink, and Kafka
.
Proficiency in
Scala and/or Python
programming.
Strong expertise in
Advanced SQL and SparkSQL
for data processing.
Strong understanding of distributed data processing and large-scale data architecture.

Preferred Skills

Experience with
Snowflake
for data warehousing and analytics.
Exposure to modern CI/CD, data versioning, and orchestration tools (Airflow, dbt, etc.).
Strong problem-solving skills with a focus on scalability and efficiency.

More Jobs at Info Services

Senior Software Engineer – C#.Net Developer

Chennai, Tamil Nadu, India

5 - 8 yrs

Salary: Not disclosed

Senior Salesforce Administrator with CRM SQL and Lightning Exp

Hyderabad, Telangana, India

Experience: Not specified

Salary: Not disclosed

Salesforce Architect

Hyderabad, Telangana, India

Experience: Not specified

Salary: Not disclosed

Senior Sharepoint Developer

Hyderabad, Telangana, India

Experience: Not specified

Salary: Not disclosed

Senior Salesforce Business Analyst

Hyderabad, Telangana, India

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start DevOps Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.