Data Engineer - PySpark | Spark | SQL

2 - 5 years

Bengaluru

Posted:1 week ago

Apply

Job Description

Position: PySpark ,

Roles & Responsibilities

  • Design, develop, and maintain data pipelines using Azure Data Factory (ADF).
  • Build scalable data processing solutions using Azure Databricks, Python, and PySpark.
  • Develop ETL/ELT workflows for data ingestion, transformation, and loading.
  • Work with Azure Data Lake Storage (ADLS), Azure SQL, and other Azure data services.
  • Optimize Spark jobs and Databricks notebooks for performance and scalability.
  • Implement data quality checks, validation rules, and monitoring processes.
  • Create and manage end-to-end data integration solutions across multiple data sources.
  • Collaborate with business stakeholders and data teams to understand data requirements.
  • Troubleshoot and resolve data pipeline and performance issues.
  • Follow coding standards, version control, and CI/CD best practices.
  • Support data warehousing and analytics initiatives.
  • Prepare technical documentation and maintain deployment artifacts.

Skills Required

Data modeling Azure Data Factory Microsoft Azure Modeling Apache Data warehousing Oracle ADF Development

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Work Mode

Work from Office

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Infosys logo
Infosys

IT Services and IT Consulting

Bangalore Karnataka

RecommendedJobs for You