Data Engineer

Name: Jobpe
Address: T-Hub, Plot No 1/C, Sy No 83/1, Raidurgam panmaktha, Knowledge City Rd, Hyderabad, Telangana, 500081, IN
Telephone: +91-83339-09630
Price range: Free

MASTER MIND CONSULTANCY

5 - 10 years

Bengaluru

Posted:6 hours ago

Apply

Job Description

Job Title : Data Engineer
Experience : 5 TO 10 Years Location : Bangalore Roles & Responsibilities

Oversee the entire data infrastructure to ensure scalability, operation efficiency and resiliency
Mentor junior data engineers within the organization
Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric)
Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs. (e.g., Azure Data Lake Storage Gen 2 & Azure Blob storage)
Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions
Optimize data pipelines in the Azure environment for performance, scalability, and reliability
Ensure data quality and integrity through data validation techniques and frameworks
Develop and maintain documentation for data processes, configurations, and best practices
Monitor and troubleshoot data pipeline issues to ensure timely resolution
Stay current with industry trends and emerging technologies to ensure our data solutions remain cutting-edge
Manage the CI/CD process for deploying and maintaining data solutions

Requisites

Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience) and able to demonstrate high proficiency in programming fundamentals
Relevant years of proven experience as a Data Engineer or similar role dealing with data and ETL processes. 5 - 10 years of experience
Strong knowledge of Microsoft Azure services, including Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage and Azure Data Lake Gen 2
Experience utilizing SQL DML to query modern RDBMS in an efficient manner (e.g., SQL Server, PostgreSQL)
Strong understanding of Software Engineering principles and how they apply to Data Engineering (e.g., CI/CD, version control, testing)
Experience with big data technologies (e.g., Spark)
Strong problem-solving skills and attention to detail · Excellent communication and collaboration skills

Skills Required

ETL Microsoft Azure Azure Data Factory Azure Synapse Azure Databricks Azure Data Pipeline Azure Data Lake Data Quality Data Validation Emerging Technologies Ci/cd

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

MASTER MIND CONSULTANCY

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Data Engineer