Talent21 logo

Data Engineer

10 - 12 years

18 - 25 Lacs

hyderabad

Posted:1 month ago| Platform: Naukri logo

Apply

Skills Required

pyspark spark data bricks python sql

Work Mode

Work from Office

Job Type

Full Time

Job Description

Job Title: Data Engineer

Experience:

Location:

Data Engineer

Key Responsibilities

  • Design, build, and maintain

    ETL/ELT pipelines

    for large-scale data processing.
  • Write high-quality, optimized

    Python code

    for data transformation.
  • Develop and optimize

    Databricks SQL

    queries and notebooks.
  • Build distributed data processing solutions using

    Spark

    and

    PySpark

    .
  • Work with structured and unstructured datasets across big data platforms.
  • Ensure data quality, validation, and reliability across all pipelines.
  • Collaborate with data architects, analysts, and business teams.
  • Participate in performance tuning, troubleshooting, and code reviews.
  • Implement best practices for data governance, security, and version control.

Required Skills

  • Strong Python coding

    skills (mandatory).
  • Hands-on experience with:

    • Databricks SQL

    • Apache Spark

    • PySpark

  • Solid understanding of data warehousing concepts and data modeling.
  • Experience working with cloud platforms (AWS/Azure/GCP preferred).
  • Proficient in Git, CI/CD pipelines, and Agile methodologies.

Good to Have

  • Experience with Delta Lake, Lakehouse architecture.
  • Knowledge of Airflow or other orchestration tools.
  • Exposure to ML pipelines or data science workflows.
  • Experience with NoSQL databases (MongoDB, Cassandra, DynamoDB).

Soft Skills

  • Strong analytical and problem-solving abilities.
  • Excellent communication and collaboration skills.
  • Ability to work independently and mentor junior engineers.

More Jobs at Talent21

Down Stream Process Executives & Operators

Hyderabad

2 - 6 yrs
|

INR 2 - 5 Lacs

Dy Manager / Manager (Pharma -Production)

Hyderabad

10 - 15 yrs
|

INR 6 - 13 Lacs

Dy Manager/Manager

Hyderabad

10 - 15 yrs
|

INR 8 - 10 Lacs

IBM App Connect Support Engineer

Bengaluru

3.0 - 5.0 yrs
|

INR 0 - 0 Lacs

Downstream process executives & operators Required

Hyderabad

2.0 - 5.0 yrs
|

INR 0 - 3 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Talent21 logo
Talent21

Staffing and Recruitment

Human Resource City

RecommendedJobs for You

Data Engineer

Onzestt Services

hyderabad, chennai, bengaluru

Data Engineer

Nexgile Technologies

hyderabad

Data Engineer

Onzestt Services

hyderabad, chennai, bengaluru

Suzva Software Technologies logo

Data Engineer

Suzva Software Technologies

mumbai

Razorthink logo

Data Engineer

Razorthink

chennai, bengaluru, delhi / ncr, remote

IOSPL Technology Services Private Limited logo

Data Engineer

IOSPL Technology Services Private Limited

kolkata, pune, chennai

Evnek logo

Data Engineer

Evnek

chennai, delhi / ncr, bengaluru

Accenture logo

Data Engineer

Accenture

bengaluru

Accenture logo

Data Engineer

Accenture

bengaluru

Virtusa logo

Data Engineer

Virtusa

andhra pradesh