Unity Catalog and Databricks Engineer

Job Description

JD for Unity Catalog and Databricks Engineer Role C2H Experience-6 to 9yrs overall, Also experience in Pyspark, Databricks Location-PAN INDIA(except Hyderabad and Chennai as preferred location) NP-Immediate/15 days Hybrid-2 or 3 days WFO Unity Catalog Adoption Data Engineer 3-6 Years, PySpark, Databricks, Unity Catalog JD Design, develop, and maintain efficient and scalable data pipelines using PySpark, Databricks. Utilize Databricks to orchestrate and automate data workflows. Implement and manage data storage solutions using Unity Catalog for effective data governance. Collaborate with data scientists, analysts, and business stakeholders to ensure smooth data flow and integration. Write optimized SQL queries for data extraction, transformation, and analysis. Develop and implement data models and data structures to meet business requirements. Perform data quality checks and ensure that all data is accurate and accessible. Troubleshoot and resolve issues related to data processing, data integration, and performance. Optimize performance and scalability of data systems and workflows. Document technical solutions, processes, and best practices for future reference and collaboration.