Azure Data Engineer

As a Data Engineer with over 5 years of experience in data analysis, engineering, and science, your role will involve the following key responsibilities: - Proficiency in Azure Data Factory, Azure DataBricks, Python, PySpark, SQL, and PLSQL or SAS. - Designing, developing, and maintaining ETL pipelines using Azure Data Bricks, Azure Data Factory, and other relevant technologies. - Managing and optimizing data storage solutions using Azure Data Lake Storage (ADLS). - Developing and deploying data processing workflows using Pyspark and Python. - Collaborating with data scientists, analysts, and other stakeholders to understand data requirements and ensure data quality. - Implementing data integration solutions and ensuring seamless data flow across systems. - Utilizing Github for version control and collaboration on the codebase. - Monitoring and troubleshooting data pipelines to ensure data accuracy and availability. - Staying updated with the latest industry trends and best practices in data engineering. Qualifications Required: - Strong background in data analysis, engineering, and science. - Proficiency in Azure Data Factory, Azure DataBricks, Python, PySpark, SQL, and PLSQL or SAS. - Experience in designing and maintaining ETL pipelines, managing data storage solutions, and developing data processing workflows. - Excellent collaboration skills to work effectively with data scientists, analysts, and stakeholders. - Keeping abreast of the latest industry trends and best practices in data engineering is crucial for this role.,