Data Engineer

Brillminds Global

4 - 9 years

7 - 16 Lacs

bengaluru

Posted:3 days ago| Platform:

Apply

Skills Required

airflow sql python

Work Mode

Remote

Job Type

Full Time

Job Description

About the Role

Data Engineer

Key Responsibilities

Design, build, and manage
ETL/ELT pipelines
to process structured and unstructured data from multiple sources.
Develop, schedule, and monitor
data workflows using Apache Airflow
.
Write efficient and optimized
SQL queries
for data extraction, transformation, and loading.
Build reusable data components and automation frameworks using
Python
.
Ensure
data quality, integrity, and governance
across the data lifecycle.
Collaborate with Data Scientists, Analysts, and Product teams to deliver clean, reliable datasets.
Monitor and troubleshoot pipeline performance, ensuring high availability and scalability.
Implement data security, compliance, and best practices across systems.

Required Skills & Qualifications

Min 4 years
of experience as a
Data Engineer
(or relevant role).
Strong expertise in:

SQL
(complex queries, performance tuning, optimization)
Python
(data processing, scripting, automation, libraries like Pandas, PySpark preferred)
Apache Airflow
(DAGs, scheduling, orchestration)

Solid understanding of
data warehousing concepts
(e.g., star schema, fact/dimension modeling).
Experience with
cloud platforms
(AWS, GCP, or Azure) and cloud data warehouses (Snowflake, BigQuery, Redshift) is a plus.
Familiarity with
version control (Git)
and CI/CD for data workflows.
Strong problem-solving, debugging, and performance tuning skills.
Excellent communication and teamwork abilities.

Good to Have (Preferred but not Mandatory)

Experience with
big data frameworks
(Spark, Hadoop).
Knowledge of
containerization
(Docker, Kubernetes).
Exposure to
data lakes and streaming technologies
(Kafka, Flink).
Familiarity with
ML pipelines
and integration with AI/ML models.

More Jobs at Brillminds Global

Global Operations Lead - Reporting

Goregaon

7.0 - 12.0 yrs

INR 14 - 24 Lacs

Senior Sales Manager

bangalore rural

5.0 - 10.0 yrs

INR 10 - 16 Lacs

Data Engineer

bengaluru

4.0 - 9.0 yrs

INR 7 - 16 Lacs

Java Full Stack Developer

pune, chennai, bengaluru

5.0 - 8.0 yrs

INR 8 - 18 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.