Senior Data Engineer

Dreaming big is in our DNA. It’s who we are as a company. It’s our culture. It’s our heritage. And more than ever, it’s our future. A future where we’re always looking forward. Always serving up new ways to meet life’s moments. A future where we keep dreaming bigger. We look for people with passion, talent, and curiosity, and provide them with the teammates, resources and opportunities to unleash their full potential. The power we create together – when we combine your strengths with ours – is unstoppable. Are you ready to join a team that dreams as big as you do?

Job Title: Azure Data Engineer

Location: Bengaluru

Reporting to: Senior Manager Data Engineering

• Purpose of the role
  

• Key tasks & accountabilities
• Design, develop, and maintain scalable data pipelines and workflows using Azure Data Factory, Azure Databricks, and other relevant tools.
• Implement and optimize data storage solutions in Azure, including Azure PostgreSQL Database, Azure Blob Storage.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and implement solutions that align with business objectives.
• Ensure data quality, integrity, and security in all data-related processes and implementations.
• Work with both structured and unstructured data and implement data transformation and cleansing processes.
• Optimize and fine-tune performance of data solutions to meet both real-time and batch processing requirements.
• Troubleshoot and resolve issues related to data pipelines, ensuring minimal downtime and optimal performance.
• Stay current with industry trends and best practices, and proactively recommend improvements to existing data infrastructure.

3. Qualifications, Experience, Skills

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer with a focus on Microsoft Azure technologies.
• Hands-on experience with Azure services such as Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Data Lake Storage, and Azure Synapse Analytics.
• Strong proficiency in SQL and experience with data modeling and ETL processes.
• Familiarity with data integration and orchestration tools.
• Knowledge of data warehousing concepts and best practices.
• Experience with version control systems, preferably Git.
• Excellent problem-solving and communication skills.
  

Level Of Educational Attainment Required

• B.Tech
  

Previous Work Experience

• 7+ Years of Experience
  

Technical Expertise

• Proven experience in Azure Databricks and ADLS architecture and implementation.
• Strong knowledge of medallion architecture and data lake design.
• Expertise in SQL, Python, and Spark for building and optimizing data pipelines.
• Familiarity with data integration tools and techniques, including Azure-native solutions.