Job
Description
As a highly skilled Senior Developer with 7 to 10 years of experience, you will be responsible for developing and maintaining scalable data solutions using Databricks Unity Catalog and Azure Data Lake Store to enhance data accessibility and security. Your role will involve collaborating with cross-functional teams to integrate Azure DevOps into the development lifecycle, ensuring seamless deployment and continuous integration. Utilizing Python and PySpark, you will design and implement efficient data processing pipelines to optimize performance and reliability. Additionally, you will create and manage Databricks SQL queries to extract, transform, and load data, supporting business intelligence and analytics initiatives. Your responsibilities will also include overseeing the execution of Databricks Workflows, providing technical expertise and support to team members, and analyzing complex data sets to identify trends and insights for data-driven decision-making processes. Ensuring data quality and integrity, staying updated with industry trends, and collaborating with stakeholders to understand business requirements are key aspects of this role. Moreover, you will document technical designs, processes, and procedures for knowledge sharing and future reference, support the development of data management strategies, and contribute to the continuous improvement of development practices. Key Responsibilities: - Develop and maintain scalable data solutions using Databricks Unity Catalog and Azure Data Lake Store - Collaborate with cross-functional teams to integrate Azure DevOps into the development lifecycle - Utilize Python and PySpark to design and implement efficient data processing pipelines - Create and manage Databricks SQL queries to support business intelligence and analytics initiatives - Oversee the execution of Databricks Workflows and ensure timely and accurate data processing - Provide technical expertise and support to team members - Analyze complex data sets to identify trends and insights - Ensure data quality and integrity by implementing validation and error-handling mechanisms - Stay updated with industry trends and apply new knowledge to improve systems and processes - Collaborate with stakeholders to understand business requirements and translate them into technical specifications - Document technical designs, processes, and procedures for knowledge sharing - Support the development of data management strategies and contribute to the continuous improvement of development practices Qualifications: - Proficiency in Databricks Unity Catalog, Azure Data Lake Store, and Azure DevOps - Strong programming skills in Python and PySpark - Experience in Databricks SQL and Workflows - Background in Data Management, Hedge Fund Accounting, or Account Management - Ability to work in a hybrid model with excellent communication and collaboration skills Certifications Required: - Databricks Certified Data Engineer Associate - Microsoft Certified: Azure Data Engineer Associate As a highly skilled Senior Developer with 7 to 10 years of experience, you will be responsible for developing and maintaining scalable data solutions using Databricks Unity Catalog and Azure Data Lake Store to enhance data accessibility and security. Your role will involve collaborating with cross-functional teams to integrate Azure DevOps into the development lifecycle, ensuring seamless deployment and continuous integration. Utilizing Python and PySpark, you will design and implement efficient data processing pipelines to optimize performance and reliability. Additionally, you will create and manage Databricks SQL queries to extract, transform, and load data, supporting business intelligence and analytics initiatives. Your responsibilities will also include overseeing the execution of Databricks Workflows, providing technical expertise and support to team members, and analyzing complex data sets to identify trends and insights for data-driven decision-making processes. Ensuring data quality and integrity, staying updated with industry trends, and collaborating with stakeholders to understand business requirements are key aspects of this role. Moreover, you will document technical designs, processes, and procedures for knowledge sharing and future reference, support the development of data management strategies, and contribute to the continuous improvement of development practices. Key Responsibilities: - Develop and maintain scalable data solutions using Databricks Unity Catalog and Azure Data Lake Store - Collaborate with cross-functional teams to integrate Azure DevOps into the development lifecycle - Utilize Python and PySpark to design and implement efficient data processing pipelines - Create and manage Databricks SQL queries to support business intelligence and analytics initiatives - Oversee the execution of Databricks Workflows and ensure timely and accurate data processing - Provide technical expertise and support to team
