Data Engineer

Integel Institute Of Technology Tamil Nadu

3 - 8 years

7 - 17 Lacs

hyderabad chennai bengaluru

Posted:1 month ago| Platform:

Apply

Skills Required

sql airflow hadoop kafka ci/cd jira data bricks apache spark jenkins docker snowflake agile git & ci/cd pipelines nosql databases data lake cloud data services data modeling etl python etl development

Work Mode

Hybrid

Job Type

Full Time

Job Description

contact@integeltechnology.com

Experience:

Interview Mode:

Data Engineer.

Roles & Responsibilities

Design, build, and maintain
ETL/ELT data pipelines
for batch and real-time processing.
Develop scalable data workflows using
Python, SQL, PySpark/Spark SQL
.
Implement and manage
data lakes and data warehouses
(Snowflake, Redshift, BigQuery, Synapse).
Integrate data from multiple sources using
Airflow, ADF, Glue, or other orchestration tools
.
Ensure
data quality, data validation, and governance
across all data assets.
Optimize data pipelines for
performance, scalability, and cost efficiency.
Work with big data frameworks like
Hadoop, Hive, Spark, Kafka
.
Collaborate with
Data Scientists, Analysts, Product Teams
to deliver data solutions.
Implement
monitoring, logging, and alerting
for pipelines and data platforms.
Maintain and enhance database systems (PostgreSQL, MySQL, MongoDB, Cassandra).
Ensure compliance with
security, privacy, and industry data standards
.

Required Skills

Strong expertise in
SQL
(advanced level).
Proficiency in
Python
for data engineering tasks.
Experience with
Apache Spark / PySpark
.
Hands-on with
Airflow / ADF / Glue
or similar tools.
Experience with
AWS / Azure / GCP
cloud services.
Knowledge of
data modeling
, schema design, and dimensional modeling.
Experience with
Snowflake / Redshift / BigQuery
(any one).
Knowledge of
Kafka / Streaming technologies.
Understanding of
data lake / delta lake architecture
.
Version control:
Git / GitLab / GitHub
.

contact@integeltechnology.com

More Jobs at Integel Institute Of Technology Tamil Nadu

IT Recruiter

Chennai

Experience: Not specified

INR 1 - 2 Lacs

Dot Net Developer 3 To 8 years

Hyderabad, Chennai, Bengaluru

3.0 - 8.0 yrs

INR 4 - 9 Lacs

Java Developer -3 To 10 years

Hyderabad, Chennai, Bengaluru

3.0 - 8.0 yrs

INR 7 - 17 Lacs

Quality Assurance Engineer (Manual & Automation Testing)

Hyderabad, Chennai, Bengaluru

3.0 - 8.0 yrs

INR 3 - 8 Lacs

IT Recruiter

Chennai

Experience: Not specified

INR 1 - 2 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.