Aws Data Engineer

Saransh Software Solutions

6 - 11 years

12 - 15 Lacs

bengaluru

Posted:1 day ago| Platform:

Apply

Skills Required

pyspark data bricks delta lake aws python etl pipelines data engineering aws glue aws emr sql aws lambda glue amazon redshift spark data warehousing

Work Mode

Hybrid

Job Type

Full Time

Job Description

Job Title:

Duration

Experience:

Job Summary:

Senior Data Engineer

Key Responsibilities:

Design, develop, and maintain robust
ETL/ELT pipelines
using
Databricks
(Bronze Silver Gold layers).
Implement reusable transformation frameworks including
conformance, SCD, deduplication, enrichment, and schema evolution
.
Develop high-performance data processing solutions using
PySpark and Spark SQL
.
Integrate data pipelines with orchestration tools such as
Airflow, AWS Glue, or Databricks Workflows
.
Optimize Spark workloads for
performance, scalability, and cost efficiency
.
Implement metadata capture and improve
monitoring and observability
of data pipelines.
Collaborate with Data Quality teams to embed
data validation, profiling, and rule checks
.
Participate in
code reviews
, CI/CD practices, and mentor junior engineers.
Work closely with cross-functional teams to design reliable and reusable data patterns.

Mandatory Skills:

Strong hands-on experience with
AWS Cloud
Expertise in
PySpark & Python
Extensive experience with
Databricks
(Delta Lake, Workflows, Repos, cluster management)
Proficient in
Spark SQL
Strong understanding of
Medallion Architecture
and modern data modeling concepts

Additional Skills (Preferred):

Experience with
CI/CD pipelines
,
Git
, and DevOps practices
Knowledge of
schema evolution, SCD Type 1/2
, and metadata-driven frameworks
Comfortable working with
YAML/JSON configurations
Experience with data orchestration tools like
Airflow or AWS Glue

Why Join Us:

Work on enterprise-scale data platforms
Opportunity to define data engineering best practices
High ownership, strong engineering culture, and continuous learning environment

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.