Job
Description
Technical Requirements: 3 to 6 Years of IT & Azure Data engineering technologies experience Prior experience in ETL, data pipelines, and data flow techniques using Azure Data Services Working experience in Python, PySpark, Azure Data Factory, Azure Data Lake Gen2, Databricks, Azure Synapse, and file formats like JSON & Parquet. Experience in creating ADF Pipelines to source and process data sets. Experience in creating Databricks notebooks to cleanse, transform, and enrich data sets. Development experience in the orchestration of pipelines Good understanding of SQL, Databases, and data warehouse systems, preferably Teradata Experience in deployment and monitoring techniques Working experience with Azure DevOps CI/CD pipelines to deploy Azure resources. Experience in handling operations/Integration with source repository Must have good knowledge of Data Warehouse concepts and Data Warehouse modelling. Working knowledge of SNO, M, S, including resolving incidents, handling Change requests /Service requests, and reporting on metrics to provide insights. Collaborate with the project team to understand tasks to model tables using data warehouse best practices and develop data pipelines to ensure the efficient delivery of data. Non-technical requirement: Work with project leaders to model tables using data warehouse best practices and develop data pipelines to ensure the efficient delivery of data. Think and work agile, from estimation to development, including testing, continuous integration, and deployment. Manage numerous project tasks concurrently and strategically, prioritizing when necessary. Proven ability to work as part of a virtual team of technical consultants working from different locations (including onsite) around project delivery goals. Technologies: Azure data factory Azure Data bricks Azure Synapse PySpark/SQL ADLS, BLOB Azure DevOps with CI/CD implementation. Nice to have skill sets: Business Intelligence tools (preferred Power BI) DP-203 Certified. Locations : Mumbai, Delhi / NCR, Bengaluru , Kolkata, Chennai, Hyderabad, Ahmedabad, Pune, Remote
