Azure Databricks

Role Overview: As an Analyst in the IT Infrastructure Services team, you will be responsible for designing and implementing scalable, secure, and high-performance data pipelines using Azure-native services and Azure Databricks. Your primary focus will be on developing and maintaining ETL/ELT processes to ingest, transform, and integrate data from diverse sources. Additionally, you will collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver actionable insights. Key Responsibilities: - Build and optimize data workflows using Databricks notebooks, PySpark, and SparkSQL for both batch and streaming data - Monitor, troubleshoot, and resolve issues in data workflows and pipelines - Implement data governance, security, and privacy best practices - Contribute to DevSecOps practices, including CI/CD automation and infrastructure as code - Stay current with emerging Azure and Databricks technologies to drive continuous improvement Qualification Required: - Bachelor of Computer Science Additional Company Details: N/A Role Overview: As an Analyst in the IT Infrastructure Services team, you will be responsible for designing and implementing scalable, secure, and high-performance data pipelines using Azure-native services and Azure Databricks. Your primary focus will be on developing and maintaining ETL/ELT processes to ingest, transform, and integrate data from diverse sources. Additionally, you will collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver actionable insights. Key Responsibilities: - Build and optimize data workflows using Databricks notebooks, PySpark, and SparkSQL for both batch and streaming data - Monitor, troubleshoot, and resolve issues in data workflows and pipelines - Implement data governance, security, and privacy best practices - Contribute to DevSecOps practices, including CI/CD automation and infrastructure as code - Stay current with emerging Azure and Databricks technologies to drive continuous improvement Qualification Required: - Bachelor of Computer Science Additional Company Details: N/A