Jobs
Interviews
Devlats Pvt Ltd logo

Senior Data Engineer - PySpark/Big Data

0 years

0 Lacs

Greater Kolkata Area

Posted:3 weeks ago| Platform: Linkedin logo

Apply

Skills Required

data pyspark engineering pipeline design azure databricks etl checks monitoring automate security governance compliance programming python hadoop hive sql devops git jenkins airflow kafka communication agile scrum development certification

Work Mode

On-site

Job Type

Full Time

Job Description

Job Summary

We are seeking an experienced and highly motivated Senior Data Engineer to join our data engineering team. The ideal candidate will have strong expertise in big data technologies, cloud platforms, data pipeline design, and strong problem-solving skills. You will work closely with data architects, analysts, and other stakeholders to build scalable and efficient data solutions.

Key Responsibilities

  • Design, build, and maintain scalable and robust data pipelines using PySpark and big data frameworks.
  • Architect and implement data solutions on Azure (Data Factory, Databricks, Azure Functions, App Services).
  • Develop and optimize ETL workflows for large-scale data processing.
  • Implement data quality checks, monitoring, and performance tuning.
  • Collaborate with cross-functional teams for data modeling and integration.
  • Manage and process structured and unstructured data from multiple sources.
  • Build CI/CD pipelines to automate data workflows and deployments.
  • Ensure data security, governance, and compliance standards are met.

Technical Skills Required

  • Programming : Python, PySpark
  • Cloud Platforms : Azure (Data Factory, Databricks, Azure Functions, App Services)
  • Big Data : Hadoop, Hive, Spark
  • Data Modeling & Warehousing : SQL, Data Lakes, Star/Snowflake schema
  • CI/CD Tools : Azure DevOps, Git, Jenkins (preferred)
  • Other Tools : Airflow (a plus), Kafka, Delta Lake.

Preferred Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • Strong analytical and communication skills.
  • Experience in Agile/Scrum development processes.
  • Azure certification is a plus.
(ref:hirist.tech)

More Jobs at Devlats Pvt Ltd

Sr Java Developer

Hyderabad, Telangana, India

5 - 6 yrs
|

Salary: Not disclosed

Technical Lead - Cloud Infrastructure

Greater Kolkata Area

6.0 - 12.0 yrs
|

Salary: Not disclosed

GCP Technical Lead

India

6.0 - 6.0 yrs
|

Salary: Not disclosed

Frontend Developer - AngularJS/TypeScript

Hyderabad, Telangana, India

8.0 - 8.0 yrs
|

Salary: Not disclosed

Senior Software Engineer - Java/J2EE

Chennai, Tamil Nadu, India

5.0 - 5.0 yrs
|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Devlats Pvt Ltd logo
Devlats Pvt Ltd

RecommendedJobs for You

Devlats Pvt Ltd logo

Senior Data Engineer - PySpark/Big Data

Devlats Pvt Ltd

Greater Kolkata Area

Devlats Pvt Ltd logo

Senior Data Engineer - PySpark/Big Data

Devlats Pvt Ltd

Greater Kolkata Area