Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in mumbai
>
Forward Eye Technologies
>
Data Engineer - Synapse Analytics

Data Engineer - Synapse Analytics

Forward Eye Technologies

5 - 10 years

6 - 10 Lacs

mumbai bengaluru delhi / ncr

Posted:5 hours ago| Platform:

Apply

Skills Required

continuous integration python pyspark data bricks ci cd pipeline azure data warehouse azure data lake version control data processing azure synapse microsoft azure ci/cd azure data factory git apache data modeling gcp aws etl data integration

Work Mode

Work from Office

Job Type

Full Time

Job Description

Job Responsibilities :Data Integration and Orchestration :

- Design, develop, and maintain ETL pipelines using Azure Data Factory (ADF) to integrate data from various sources into the data lake or data warehouse. - Implement data workflows and orchestrate data movement and transformation processes within the ADF environment.

Data Processing and Analytics :

- Utilize Databricks to develop and manage scalable data processing pipelines. - Write and optimize PySpark scripts for data transformation, aggregation, and analysis within Databricks. - Perform real-time and batch data processing on large datasets to support analytics and reporting needs.

Python Scripting and Automation :

- Develop Python scripts to automate data processing tasks, enhance data pipelines, and integrate with other Azure services. - Implement data validation and error-handling mechanisms within Python scripts to ensure data accuracy and reliability.

Data Modeling and Storage :

- Design and implement data models that support efficient querying, storage, and retrieval of data in the Azure ecosystem. - Optimize data storage solutions within Azure, including Azure Data Lake, Azure SQL Data Warehouse, and other related services.

Collaboration and Stakeholder Engagement :

- Work closely with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions. - Provide technical expertise and guidance on best practices for data engineering and cloud-based solutions.

Performance Tuning and Optimization :

- Monitor, troubleshoot, and optimize data pipelines for performance, scalability, and cost efficiency. - Implement best practices for data security, governance, and compliance within the Azure environment.

Required Qualifications :Experience :

- Minimum of 5 years of experience in data engineering or related roles. - Strong hands-on experience with Azure Data Factory for data integration and orchestration. - Proven expertise in using Databricks for data processing and analytics. - Proficiency in Python scripting, particularly in the context of data processing and automation.

Technical Skills :

- In-depth knowledge of PySpark for large-scale data processing. - Familiarity with Azure services such as Azure Data Lake, Azure SQL Data Warehouse, and Azure Synapse Analytics. - Experience with data modeling, ETL processes, and data architecture design in cloud environments. - Strong understanding of CI/CD pipelines and version control using Git.

Soft Skills :

- Excellent problem-solving skills with the ability to debug and resolve complex data engineering challenges. - Strong communication skills for effective collaboration with technical and non-technical stakeholders. - Ability to work independently and manage multiple priorities in a fast-paced environment.

Preferred Qualifications :

- Experience with data orchestration tools such as Apache Airflow. - Familiarity with other cloud platforms (e.g., AWS, GCP) is a plus. - Understanding of data governance and security practices in the cloud.

Keywords :

- Azure Data Factory (ADF) - Databricks - PySpark - Python - Data Engineering - Cloud Data Solutions - ETL Pipelines - Data Integration - Data Modeling - Azure Data Lake.

Location

- Hyderabad , Ahmedabad , pune , chennai , kolkata.

More Jobs at Forward Eye Technologies

Senior SAP PM/MRS Consultant - Integration & Implementation

Kolkata

8 - 13 yrs

INR 16 - 22 Lacs

SAP APO Consultant - SNP Module

Surat

7 - 12 yrs

INR 8 - 14 Lacs

Senior SAP FICO Consultant - Implementation & Support

Ahmedabad

8 - 13 yrs

INR 17 - 25 Lacs

SAP CPI Consultant - PI/PO Module

Hyderabad

6 - 11 yrs

INR 8 - 14 Lacs

SAP FICO Consultant - Support & Implementation

Ahmedabad

7 - 12 yrs

INR 8 - 14 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Forward Eye Technologies

E-Learning Providers

Noida

Login to

Please Verify Your Phone or Email

Confirm Action

Data Engineer - Synapse Analytics