PERSOL logo

Data Engineer

PERSOL

3 - 8 years

Bengaluru

Posted:6 days ago

Job Description

Key responsibilities:

  • Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric).
  • Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs. (e.g., Azure Data Lake Storage Gen 2 & Azure Blob storage).
  • Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions.
  • Optimize data pipelines in the Azure environment for performance, scalability, and reliability.
  • Ensure data quality and integrity through data validation techniques and frameworks.
  • Develop and maintain documentation for data processes, configurations, and best practices.
  • Monitor and troubleshoot data pipeline issues to ensure timely resolution.
  • Stay current with industry trends and emerging technologies to ensure our data solutions remain cutting-edge.
  • Manage the CI/CD process for deploying and maintaining data solutions.

Required Qualifications:

  • Bachelors degree in Computer Science, Engineering, or a related field (or equivalent experience) and able to demonstrate high proficiency in programming fundamentals with 5 -7 years experience
  • At least 2-8 years of proven experience as a Data Engineer or similar role dealing with data and ETL processes.
  • Strong knowledge of Microsoft Azure services, including Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage and Azure Data Lake Gen 2.
  • Experience utilizing SQL DML to query modern RDBMS in an efficient manner (e.g., SQL Server, PostgreSQL).
  • Strong understanding of Software Engineering principles and how they apply to Data Engineering (e.g., CI/CD, version control, testing).
  • Experience with big data technologies (e.g., Spark).
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration skills.

Skills Required

Factory SQL Data Python Microsoft Azure Data Engineering Azure Databricks Spark

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Work Mode

Hybrid

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
PERSOL logo
PERSOL

RecommendedJobs for You

Meghaz Software Solutions logo

Data Engineer

Meghaz Software Solutions

Bengaluru

Independent Recruitment Consultant (freelancer) logo

Data Engineer

Independent Recruitment Consultant (freelancer)

India

People Tech Technology logo

Data Engineer

People Tech Technology

Hyderabad

WPP logo

Chennai

Krato Solutions logo

Data Engineer

Krato Solutions

Chennai

Applied Systems logo

Data Engineer

Applied Systems

Bengaluru

HP logo

Bengaluru