Data Engineer

Hiring:

Location:

Experience:

Interview Mode:

Interview Date:

Python Data Engineer

Ideal Candidate:

• 5-8 years of hands-on experience in

  Python Development

  .
• Strong expertise in

  PySpark, Pandas, NumPy, and SQL

  .
• Experience in building large-scale

  Data Engineering and ETL solutions

  .
• Strong working knowledge of

  Azure Cloud Services

  and

  Azure Data Lake Storage (ADLS)

  .
• Hands-on experience with

  Azure Databricks

  .
• Understanding of

  DevOps practices

  , CI/CD pipelines, and automation.
• Experience in data modeling, data transformation, and performance tuning.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and stakeholder management skills.

Key Responsibilities

• Design, develop, and maintain scalable

  data pipelines

  using Python, PySpark, and SQL.
• Build and implement data processing algorithms leveraging

  Pandas, NumPy, PySpark

  , and related libraries.
• Develop and optimize

  ETL/ELT workflows

  for extracting, transforming, and loading large datasets.
• Work extensively with

  Azure Data Lake Storage (ADLS)

  and Azure data services.
• Utilize

  Databricks

  to develop and deploy scalable data engineering solutions.
• Collaborate with Engineers, Data Scientists, and Researchers to gather requirements and deliver end-to-end data solutions.
• Perform data analysis, validation, and experimentation to ensure solution accuracy and reliability.
• Optimize data pipelines and processing jobs for performance, scalability, and efficiency.
• Independently develop, test, debug, and support applications of varying complexity.