Data Engineer | PySpark | Databricks | Azure Data Factory

2 - 5 years

Hyderabad Pune Bengaluru

Posted:1 week ago

Apply

Job Description

Responsibilities

  • Design, develop, and maintain scalable data pipelines using

    PySpark, Spark, Databricks, Azure Data Factory (ADF), and AWS Glue

    .
  • Build and optimize ETL/ELT workflows for processing large-scale structured and unstructured data.
  • Develop and manage cloud-based data solutions on

    AWS, Azure, and GCP

    platforms.
  • Work with

    Databricks, Delta Lake, ADLS, S3, BigQuery, Redshift, and Snowflake

    for data ingestion, transformation, and storage.
  • Implement data quality, monitoring, and performance optimization best practices.
  • Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver scalable solutions.
  • Ensure data security, governance, and compliance standards are followed across cloud platforms.
  • Optimize Spark jobs and SQL queries for improved performance and cost efficiency.
  • Support real-time and batch data processing frameworks.
  • Participate in code reviews, troubleshooting, and production support activities.
  • Create technical documentation and maintain data engineering standards and best practices.

Skills Required

Lambda Expressions Data Engineering GCP Azure Data Factory Microsoft Azure Pipeline Glue AWS Lambda

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Work Mode

Hybrid

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Infosys logo
Infosys

IT Services and IT Consulting

Bangalore Karnataka

RecommendedJobs for You