Data Engineer / F2F

Lancesoft

5 - 8 years

8 - 11 Lacs

bengaluru

Posted:5 hours ago| Platform:

Apply

Skills Required

data engineering sql python pyspark snowflake aws data bricks

Work Mode

Work from Office

Job Type

Full Time

Job Description

Role & responsibilities

Responsibilities:

Design and implement scalable data pipelines for batch and near real-time use cases in cloud environments
Write optimized, complex
SQL
queries for data transformation and analysis in cloud data warehouses
Develop efficient
Python
and
PySpark
scripts for large-scale data processing and ETL workflows
Create and maintain data models in
Databricks
, ensuring data quality and consistency
Optimize queries and scripts over large-scale datasets (TBs) with a focus on performance and cost-efficiency
Implement data governance and security best practices in cloud environments
Collaborate across teams to translate business requirements into robust technical solutions

Preferred candidate profile

Mandatory skill sets:

5+ years of hands-on experience in Data Engineering
Strong command over
SQL
,
Python
, and
PySpark
for data manipulation and analysis
Deep experience with data warehousing concepts and implementation in cloud environments (
Azure
/
AWS
)
Proficiency in data modeling techniques for cloud-based systems (
Databricks, Snowflake
)
Solid understanding of ETL/ELT processes and best practices in cloud architectures
Experience with dimensional modeling, star schemas, and data mart design
Strong analytical thinking and problem-solving skills

Preferred skill sets:

Familiarity with data lake architectures and delta lake concepts
Familiarity with Snowflake/Databricks
Data Warehouse
Knowledge of data warehouse migration strategies to cloud
Experience with real-time data streaming technologies (e.g., Apache Kafka, Azure Event Hubs)
Exposure to data quality and data governance tools and methodologies
Understanding of data virtualization and federated query engines
Understanding of performance optimization techniques for cloud-based data warehouses
Apache Airflow
– Workflow orchestration and scheduling
Certifications in Azure or AWS or Databricks

More Jobs at Lancesoft

Java Full Stack Developer - Angular / React

Chennai, Bengaluru, Hyderabad

5 - 10 yrs

INR 15 - 30 Lacs

GCP Cloud DevOps Engineer

Pune, Hyderabad

6 - 10 yrs

INR 15 - 30 Lacs

Service Desk Associate

Bengaluru

Experience: Not specified

INR 2 - 3 Lacs

Java Full Stack Developer Angular + Reac

Hyderabad, Pune, Bengaluru

6 - 11 yrs

INR 6 - 15 Lacs

Team Lead

Vadodara

4 - 9 yrs

INR 3 - 8 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.