Data Engineer

As a Software Engineer - Cloud Data Platform (Azure) at Incedo, you will be responsible for managing and optimizing the Microsoft Azure environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments.

You will be skilled in cloud computing platforms such as AWS or GCP and have experience with data warehousing technologies such as Azure Synapse Analytics. You will be responsible for configuring and optimizing the Azure environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team to ensure that the Azure environment is secure and complies with relevant regulations.

Roles & Responsibilities:

• Designing, developing and deploying cloud-based data platforms using Microsoft Azure Integrating and processing large amounts of structured and unstructured data from various sources
• Implementing and optimizing ETL processes and data pipelines
• Developing and maintaining security and access controls
• Collaborating with other teams to ensure the consistency and integrity of data Troubleshooting and resolving data platform issues

Skills Requirements:

• Expertise in Azure services and tools such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics
• Experience in building scalable and reliable data pipelines using Azure services, Apache Spark, and related big data technologies
• Familiarity with cloud-based infrastructure and deployment, specifically on Azure
• Strong knowledge of programming languages such as Python, C#, and SQL Must have excellent communication skills and be able to communicate complex technical information to non-technical stakeholders in a clear and concise manner
• Must understand the company's long-term vision and align with it

3-5 years of work experience in relevant field B.Tech/B.E/M.Tech or MCA degree from a reputed university. Computer science background is preferred