Azure Synapse, Python, Pyspark, SQL, Azur Professional

Job Description

No of years experience 7+ years Detailed job description - Skill Set: Expert level skills writing and optimizing complex SQL and Python is a must Experience with complex data modelling, ETL design, and using large databases in a business environment Experience with large scale on-prem to cloud data-migration Experience with big-data technologies, data-lake/delta-lake solutions, cloud-based data platforms Experience in designing data pipelines for optimal performance, resiliency, and cost efficiency Fluent with industry standard technologies like Spark, Kafka Expert level understanding of Azure data ecosystem like Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, Azure Fabric, Azure Cosmos DB is required Experience is designing data integration strategies leveraging batch and real-time data ingestion methods Any exposure to managing infrastructure or CI/CD around data technologies is a plus Implementing data security measures, including encryption, access controls, and auditing, to protect sensitive information Automating data pipelines and workflows to streamline data ingestion, processing, and distribution tasks Mandatory Skills Azure Synapse , Python, Pyspark , SQL, Azure data factory Good to have CI/CD, Kafka