Azure Data Engineer

Position Code

Azu-ETP-Pun-1087

Min. Experience

3.0 years

Max. Experience

4.0 years

Skills

databricks ADF ADLS Data Bricks Azure Synapse Pyspark Azure Data Lake Data Lake Storage Data Lake Azure Azure Data Factory Azure Databricks sql data modeling microsoft azure data warehousing ETL

Azure Databricks

Azure Data Factory Azure Data Lake Microsoft Azure Pyspark Azure Synapse Azure Analysis Services Microsoft Azure Architecture SSMS SQL Azure ADF Adb Adl adls Power Bi SSAS Dax Azure Analytics Azure Databricks

ADF pipelines

Microsoft Fabric

t-sql

azure functions

Azure LogicApps

Location

Pune

Other

Job Summary:

Minimum 3-4 Years of Experience in Data Integration platform on cloud (Azure preferred)

Responsibilities:

• Solution Design and Architecture:

• Collaborate with stakeholders to understand business requirements and design scalable data solutions on the Azure platform.
• Create and maintain data architecture diagrams and documentation.

• Data Ingestion and ETL:

• Develop and implement ETL processes using Azure Data Factory, Azure Databricks, and other relevant tools.
• Design and optimize data pipelines to ensure efficient data processing and transformation.

• Data Storage and Management:

• Implement and manage Azure SQL Database, Azure Data Lake Storage, and other Azure data storage solutions.
• Ensure data integrity, security, and compliance with industry best practices and organizational standards.

• Data Transformation and Processing:

• Utilize Azure Databricks and other tools for data transformation and processing.
• Optimize queries and data processing workflows for performance and efficiency.

• Monitoring and Optimization:

• Implement monitoring solutions to track the performance and health of data solutions.
• Identify and resolve performance bottlenecks and optimize data processing workflows.

• Collaboration and Communication:

• Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders.
• Communicate effectively with technical and non-technical audiences, providing insights and recommendations.

• Automation and Scripting:

• Develop scripts and automation processes to streamline data engineering tasks.
• Implement infrastructure as code (IaC) for managing Azure resources.

Qualifications:

1. Bachelor's degree in Computer Science, Information Technology, or a related field.
2. Proven experience as a Data Engineer with a focus on Azure cloud technologies.
3. In-depth knowledge of Azure Data Factory, Azure SQL Database, Azure Databricks, and other relevant Azure services.
4. Strong proficiency in SQL, Python, and/or other scripting languages.
5. Experience with data modeling, schema design, and database performance tuning.
6. Familiarity with data warehousing concepts and best practices.
7. Excellent problem-solving and analytical skills.
8. Effective communication and collaboration skills.
9. Relevant certifications such as Microsoft Certified: Azure Data Engineer Associate are a plus.

If you meet these qualifications and are excited about the opportunity to work with cutting-edge Azure technologies to solve complex data challenges, we encourage you to apply. Join our team and be a key contributor to the success of our data-driven initiatives.