Job
Description
Role Overview: You are a highly skilled Azure PySpark Solution Architect responsible for designing and implementing scalable data solutions on Microsoft Azure. Your expertise in Azure services, PySpark, and enterprise-grade solution architecture will drive efficient data processing and analytics workflows. Key Responsibilities: - Design and implement end-to-end data solutions using Azure Data Services and PySpark. - Develop high-performance ETL pipelines leveraging Azure Databricks, Azure Data Factory, and Synapse Analytics. - Architect scalable, secure, and cost-efficient cloud solutions aligning with business goals. - Collaborate with data engineers, data scientists, and stakeholders to define technical requirements and solution roadmaps. - Optimize big data processing while ensuring adherence to data governance, security, and compliance standards. - Provide technical leadership and establish best practices for Azure and PySpark-based data solutions. - Conduct performance tuning and troubleshoot PySpark workloads. - Ensure seamless integration with third-party tools, APIs, and enterprise systems. Qualification Required: - Expertise in Azure Cloud Services: Azure Databricks, Data Factory, Synapse Analytics, Azure Storage, ADLS. - Strong hands-on experience with PySpark for data processing and transformation. - Deep understanding of solution architecture, including microservices, event-driven, and cloud-native patterns. - Proficient in SQL, NoSQL databases, and data modeling within Azure ecosystems. - Knowledge of CI/CD pipelines, DevOps practices, and Infrastructure-as-Code tools such as Terraform, ARM templates, or Bicep. - Strong analytical and problem-solving skills with the ability to optimize large-scale data workloads. - Excellent communication and stakeholder management capabilities. About UST: UST is a global digital transformation solutions provider with over 30,000 employees in 30 countries. They work with the world's best companies to make a real impact through transformation. UST partners with clients from design to operation, embedding innovation and agility into their organizations with a deep domain expertise and future-proof philosophy. Role Overview: You are a highly skilled Azure PySpark Solution Architect responsible for designing and implementing scalable data solutions on Microsoft Azure. Your expertise in Azure services, PySpark, and enterprise-grade solution architecture will drive efficient data processing and analytics workflows. Key Responsibilities: - Design and implement end-to-end data solutions using Azure Data Services and PySpark. - Develop high-performance ETL pipelines leveraging Azure Databricks, Azure Data Factory, and Synapse Analytics. - Architect scalable, secure, and cost-efficient cloud solutions aligning with business goals. - Collaborate with data engineers, data scientists, and stakeholders to define technical requirements and solution roadmaps. - Optimize big data processing while ensuring adherence to data governance, security, and compliance standards. - Provide technical leadership and establish best practices for Azure and PySpark-based data solutions. - Conduct performance tuning and troubleshoot PySpark workloads. - Ensure seamless integration with third-party tools, APIs, and enterprise systems. Qualification Required: - Expertise in Azure Cloud Services: Azure Databricks, Data Factory, Synapse Analytics, Azure Storage, ADLS. - Strong hands-on experience with PySpark for data processing and transformation. - Deep understanding of solution architecture, including microservices, event-driven, and cloud-native patterns. - Proficient in SQL, NoSQL databases, and data modeling within Azure ecosystems. - Knowledge of CI/CD pipelines, DevOps practices, and Infrastructure-as-Code tools such as Terraform, ARM templates, or Bicep. - Strong analytical and problem-solving skills with the ability to optimize large-scale data workloads. - Excellent communication and stakeholder management capabilities. About UST: UST is a global digital transformation solutions provider with over 30,000 employees in 30 countries. They work with the world's best companies to make a real impact through transformation. UST partners with clients from design to operation, embedding innovation and agility into their organizations with a deep domain expertise and future-proof philosophy.