Job
Description
Azure Data Engineer - Soulpage IT Solutions Home Azure Data Engineer March 6, 2025 Position: Azure Data Engineer Skill set: Azure Databricks and Data Lake implementation Experience: 3+ years Notice Period: Immediate Immediate to 15 days Location: WFO, Hyderabad Job Type : Full-Time Positions: 2 Job Summary: We are looking for a highly skilled Azure Data Engineer with expertise in Azure Databricks and Data Lake implementation to design, develop, and optimize our data pipelines. The engineer will be responsible for integrating data from multiple sources, ensuring data is cleaned, standardized, and normalized for ML model building. This role involves working closely with stakeholders to understand data requirements and ensuring seamless data flow across different platforms. Key Responsibilities: Data Lake & Pipeline Development Design, develop, and implement scalable Azure Data Lake solutions . Build robust ETL/ELT pipelines using Azure Databricks, Data Factory, and Synapse Analytics . Optimize data ingestion and processing from multiple structured and unstructured sources. Implement data cleaning, standardization, and normalization processes to ensure high data quality. Implement best practices for data governance, security, and compliance . Optimize data storage and retrieval for performance and cost-efficiency. Monitor and troubleshoot data pipelines, ensuring minimal downtime. Work closely with data scientists, analysts, and business stakeholders to define data needs. Maintain thorough documentation for data pipelines, transformations, and integrations. Assist in developing ML-ready datasets by ensuring consistency across integrated data sources. Required Skills & Qualifications: 3+ years of experience in data engineering, with a focus on Azure cloud technologies . Expertise in Azure Databricks, Data Factory, Data Lake Strong proficiency in Python, SQL, and PySpark for data processing and transformations. Understanding of ML data preparation workflows , including feature engineering and data normalization. Knowledge of data security and governance principles . Experience in optimizing ETL pipelines for scalability and performance. Strong analytical and problem-solving skills. Excellent written and verbal communication skills. Preferred Qualifications: Azure Certifications Azure Data Engineer Associate, Azure Solutions Architect . Why Join Us? Work on cutting-edge Azure cloud and data technologies . Collaborate with a dynamic and innovative team solving complex data challenges. Competitive compensation and career growth opportunities. Application Process: Interested candidates can send their resumes to [email protected] with the subject line: Application for Azure Data Engineer We look forward to welcoming passionate individuals to our team!
