Data Engineer

Wishtree Technologies

4 - 5 years

3 - 6 Lacs

pune

Posted:20 hours ago| Platform:

Apply

Skills Required

performance tuning automation data modeling postgresql shell scripting data processing data quality sql python data extraction

Work Mode

Work from Office

Job Type

Full Time

Job Description

Overview:

We are looking for a skilled Data Engineer with strong experience across Databricks, SQL, Python, and AWS data services. The ideal candidate should be proficient in building end-to-end data pipelines, working with large datasets, and ensuring efficient data processing and transformation.

Key Responsibilities

Design, develop, and maintain
end-to-end data pipelines
using Databricks.
Work extensively with
SQL
and
Python
to support data transformations, processing, and analysis.
Implement and optimize data workflows across
AWS services
such as S3, Secrets Manager, and other foundational cloud components.
Leverage
AWS Athena, Glue, and Redshift
for data extraction, cataloging, processing, and warehousing.
Develop and maintain
shell scripts
for automation and operational workflows.
Work with
PostgreSQL
databases for data modeling, querying, and optimization.
Collaborate with cross-functional teams to understand data requirements and ensure data quality, consistency, and availability.
Troubleshoot data issues, optimize query performance, and ensure efficient data processing.
Apply strong data engineering and data understanding skills to solve complex business challenges.

Required Skills & Experience

4-5 years
of experience in Data Engineering.
Strong hands-on experience with:
Databricks
(end-to-end development)
SQL
(advanced querying, performance tuning)
Python
(data processing, automation)
Solid knowledge of
AWS Cloud
services including S3, Secrets Manager, and other basic AWS components.
Experience with
Athena, Glue, and Redshift
.
Basic understanding of
Shell scripting
.
Strong data modeling, data pipeline design, and data troubleshooting skills.
Experience with
PostgreSQL
.

Nice to Have

Exposure to data governance, data validation, or CI/CD for data pipelines.
Experience with any orchestration tools (e.g., Airflow, AWS Step Functions).

More Jobs at Wishtree Technologies

MEAN Stack Developer

Ahmedabad

5.0 - 5.0 yrs

INR 3 - 7 Lacs

MEAN Stack Developer

Ahmedabad, Gujarat, India

5.0 - 5.0 yrs

Salary: Not disclosed

DevOps Engineer

Pune, Maharashtra, India

2.0 - 4.0 yrs

Salary: Not disclosed

DevOps Engineer

Pune

2.0 - 4.0 yrs

INR 2 - 6 Lacs

MEAN Stack Developer - Node.js/AngularJS

Ahmedabad, Gujarat, India

5.0 - 5.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.