Data Engineer

Technodysis

5 years

0 Lacs

chennai tamil nadu india

Posted:5 hours ago| Platform:

Apply

Skills Required

data drive aws databricks design interface engineering compliance code scala spark kafka processing jenkins git monitoring stack

Work Mode

On-site

Job Type

Full Time

Job Description

Experience: 5+ years

Location: Chennai - WFO

Key job responsibilities:

Drive the backbone of our organizational data platform by building robust pipelines that turn complex data into actionable insights using AWS and the Databricks platform
Design scalable, maintainable data systems with strong observability
Monitor, log, alert, and ensure system robustness
Build efficient pipelines for structured and unstructured data
Interface with Product engineering, regulatory, and legal teams as necessary to ensure Lakehouse’s compliance adherence
Write clean, efficient code that handles massive amounts of structured and unstructured data

Key Requirements:

Must be proficient in the major languages such as Scala, Spark, and Kafka (any variant). Write elegant and maintainable code, and be comfortable with picking up new technologies.
Proficient in working with distributed systems and have experience with different distributed processing frameworks that can handle data in batch and near real-time pipelines.
Experience in working with AWS cloud services and Databricks (preferred) to build end-to-end data lake house solutions that bring different systems together
Capability to understand and implement metadata-based data processing framework and methodologies
Experience in working with CICD process - Jenkins, & GIT Actions
Experience in working with monitoring and control stack - Prometheus/Grafana

More Jobs at Technodysis

Data Analyst - Financial Crime

Chennai, Tamil Nadu, India

1.0 - 3.0 yrs

Salary: Not disclosed

Integration Engineer - API Connect and Kong

Bengaluru

6.0 - 10.0 yrs

INR 15 - 25 Lacs

Workday Functional Consultant Absence Time, Benefits, US Payroll

Bengaluru

2.0 - 5.0 yrs

INR 6 - 16 Lacs

SAP Consultant

Hosur, Tamil Nadu, India

5.0 - 5.0 yrs

Salary: Not disclosed

SAP Consultant

hosur, tamil nadu

5.0 - 9.0 yrs

INR 0 - 0 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.