5 - 10 years

9 - 17 Lacs

Posted:3 hours ago| Platform: Naukri logo

Apply

Work Mode

Hybrid

Job Type

Full Time

Job Description

Job Title: Senior Data Engineer --- PySpark

Location:

Job Summary:

Senior Data Engineer

Key Responsibilities:

  • Design, implement, and maintain scalable and efficient

    ETL/ELT pipelines

    using

    PySpark

    .
  • Work with

    big data frameworks

    such as Apache Spark, Hadoop, Hive, and Delta Lake.
  • Handle large volumes of structured and unstructured data across various sources (databases, APIs, flat files, etc.).
  • Develop and optimize complex

    data transformation workflows

    and batch/streaming jobs.
  • Ensure data quality, integrity, and governance throughout the data lifecycle.
  • Collaborate closely with data scientists, analysts, DevOps, and business stakeholders.
  • Troubleshoot performance issues and optimize PySpark jobs for distributed environments.
  • Manage workflows using orchestration tools such as

    Apache Airflow

    or similar.
  • Contribute to the architecture and design of scalable, fault-tolerant data platforms.

Required Skills & Qualifications:

  • 5+ years

    of experience in data engineering roles.
  • Strong hands-on experience with PySpark

    for data transformation and processing.
  • Proficient in

    SQL

    and

    Python

    .
  • Deep understanding of

    distributed computing concepts

    , data partitioning, and performance tuning.
  • Experience with cloud platforms such as

    AWS

    ,

    Azure

    , or

    Google Cloud Platform

    .
  • Experience with data lakehouse architectures (e.g.,

    Delta Lake

    ,

    Databricks

    ).
  • Knowledge of version control (Git), CI/CD, and agile methodologies.

Nice to Have:

  • Exposure to

    streaming data

    technologies like Kafka, Spark Streaming, or Flink.
  • Experience with

    Snowflake

    ,

    Redshift

    , or

    BigQuery

    .
  • Knowledge of data governance, data lineage, and cataloging tools (e.g., Collibra, Alation).
  • Familiarity with containerization (Docker, Kubernetes).

Share your resume @ avinash.allure@bhasaka.com

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Bhasaka Technologies logo
Bhasaka Technologies

Information Technology

Silicon Valley

RecommendedJobs for You

hyderabad, gurugram, chennai, bengaluru

kochi, thiruvananthapuram