Databricks Developer

Role Overview: You will be responsible for utilizing your 4 to 6 years of relevant experience as a Databricks Developer, with a minimum of 5 years working experience specifically in this role. Your expertise should also include a minimum of 3 years working experience in PySpark and AWS, along with 5+ years of progressive data engineering experience. Your deep technical knowledge in Databricks, Python, Scala, Microsoft Azure architecture, and platforms like Synapse and Azure Data Factory will be crucial for success in this role. Additionally, you will work on data pipelines integrating various source and target locations, leveraging engineering practices, and developing scalable data applications and processes. Key Responsibilities: - Develop batch ETL pipelines, with the opportunity to work on real-time pipelines as well - Utilize advanced data engineering concepts such as dimensional modeling, ETL, data governance, and data warehousing for both structured and unstructured data - Collaborate with cross-functional teams to support dynamic environments and provide insights from large datasets - Mentor and coach other data professionals on data standards and practices - Drive a culture of sharing, re-use, scalability, and operational efficiency in data and analytic solutions - Participate in technical architecture development for strategic enterprise projects and initiatives - Solve complex data problems to deliver actionable insights for organizational goals - Willingness to work in shifts and handle 7 night shifts per month due to the 24*7 production support project Qualifications Required: - Bachelor's degree in Computer Science, Engineering, or related field - Proven experience with Databricks, PySpark, AWS, Python, and CI/CD - Strong background in SQL, including T-SQL and stored procedures - Familiarity with databases and query authoring - Experience in developing and documenting data engineering capabilities and standards - Excellent problem-solving skills and ability to analyze root causes of data issues Additional Company Details: N/A,