Data Engineer

Teamware Solutions

5 - 10 years

17 - 30 Lacs

Bengaluru

Posted:1 day ago| Platform:

Apply

Skills Required

Data Modeling Data Architecture Data Governance

Work Mode

Work from Office

Job Type

Full Time

Job Description

Position Overview

Data Engineer

Key Responsibilities

Design and implement
scalable data pipelines
for batch and real-time processing.
Develop and maintain
data models
to support analytics and business intelligence.
Ensure
data governance
best practices, including data quality, lineage, and compliance.
Optimize and manage
Databricks
environments for efficient data processing.
Write and optimize
PySpark
jobs for large-scale data transformations.
Collaborate with stakeholders to define
data architecture
standards and best practices.
Automate data workflows and improve
ETL/ELT
processes.
Troubleshoot and resolve data-related issues in production environments.

Required Skills & Qualifications

Must-Have:

Strong experience in
Data Architecture
and
Data Modeling
(relational, dimensional, NoSQL).
Hands-on experience with
PySpark
for big data processing.
Proficiency in
Azure Databricks
(or Databricks on other clouds).
Knowledge of
Data Governance
frameworks (metadata management, data lineage, security).
Expertise in SQL and experience with cloud data platforms (Azure, AWS, or GCP).
Familiarity with
ETL/ELT
tools and workflow orchestration (e.g., Airflow, Azure Data Factory).

Nice-to-Have:

Experience with
Delta Lake, Snowflake, or Synapse
.
Knowledge of
CI/CD pipelines
for data engineering.
Understanding of
machine learning data pipelines
.
Certifications in
Databricks, Azure Data Engineer, or AWS Big Data
.

Mock Interview

Practice Video Interview with JobPe AI

Start Data Modeling Interview Now

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.