ADF Data Engineer

As an experienced Data Engineer in our team, your focus will be on enhancing and supporting existing Data & Analytics solutions by leveraging Azure Data Engineering technologies. You will be responsible for designing, developing, and supporting data pipelines and solutions using Azure data engineering services. Your role will involve implementing data flow and ETL techniques using Azure Data Factory, Databricks, and Synapse, as well as cleansing, transforming, and enriching datasets using Databricks notebooks and PySpark. Additionally, you will orchestrate and automate workflows across services and systems, collaborating with business and technical teams to deliver robust and scalable data solutions. Your support role will include resolving incidents, handling change/service requests, and monitoring performance. Furthermore, you will contribute to CI/CD pipeline implementation using Azure DevOps. Key Responsibilities: - Design, develop, and support data pipelines and solutions using Azure data engineering services. - Implement data flow and ETL techniques leveraging Azure Data Factory, Databricks, and Synapse. - Cleanse, transform, and enrich datasets using Databricks notebooks and PySpark. - Orchestrate and automate workflows across services and systems. - Collaborate with business and technical teams to deliver robust and scalable data solutions. - Work in a support role to resolve incidents, handle change/service requests, and monitor performance. - Contribute to CI/CD pipeline implementation using Azure DevOps. Qualifications Required: - 3 to 6 years of experience in IT and Azure data engineering technologies. - Strong experience in Azure Databricks, Azure Synapse, and ADLS Gen2. - Proficient in Python, PySpark, and SQL. - Experience with file formats such as JSON and Parquet. - Working knowledge of database systems, with a preference for Teradata and Snowflake. - Hands-on experience with Azure DevOps and CI/CD pipeline deployments. - Understanding of Data Warehousing concepts and data modeling best practices. - Familiarity with SNOW (ServiceNow) for incident and change management. The company also values your ability to work independently and collaboratively in virtual teams across geographies, your strong analytical and problem-solving skills, experience in Agile development practices, effective task and time management skills, and clear communication and documentation skills for project updates and technical processes. Additional Company Details: - Domain: FMCG/Foods/Beverage - Location: Chennai, Tamilnadu, India Please note that the job is full-time and requires 3 to 6 years of experience in the specified domain.,