Job
Description
Work Mode - Hybrid(3days WFO) ROLE PURPOSE Data Platform Support Engineer will ensure seamless data pipeline executions and timely resolution of issues to maintain business continuity. The role is responsible for overseeing and maintaining health and reliability of data systems, driving root cause analysis, and implementing proactive measures to minimize disruptions. KEY ACCOUNTABILITIES Monitor and manage the health and performance of Azure Data Factory pipelines, Databricks workflows, and SQL databases to ensure seamless data processing. Troubleshoot and resolve production incidents in Azure-based data pipelines, conducting root cause analysis and implementing preventive measures. Oversee and optimize the performance of Databricks notebooks and clusters to support efficient data transformations and analytics. Ensure the reliability and scalability of data integration workflows by leveraging Azure-native monitoring tools and alerts. Collaborate with development teams to deploy and support new Azure Data Factory pipelines, SQL scripts, and Databricks jobs into production. Maintain compliance with data governance, security, and backup policies across the Azure platform. Coordinate with stakeholders to provide clear updates on production incidents, resolutions, and performance improvements Plan and execute disaster recovery and failover strategies for Azure Data Factory, Databricks, and SQL components to ensure business continuity. Document operational processes, troubleshooting steps, and best practices for the Azure platform to build a comprehensive knowledge base. On-Call support FUNCTIONAL / TECHNICAL SKILLS Skills and Experience: Azure Data Factory and Databricks Expertise: Skilled in building, managing, and optimizing pipelines, workflows, and clusters. SQL Proficiency: Strong skills in writing, troubleshooting, and optimizing queries for performance. Monitoring and Alerting: Experience with Azure Monitor, Log Analytics, and proactive issue detection. Incident Management: Strong problem-solving skills for root cause analysis and implementing preventive solutions. Data Governance and Security: Knowledge of compliance standards, role-based access control (RBAC), and secure Azure networking. Process Improvement: Experience in optimizing workflows and implementing best practices for operational efficiency. Documentation: Strong skills in creating and maintaining operational guides and troubleshooting documentation. If you are interested in this role, please send your updated CV to bhavya.vemuri@invokhr.com
