29 Unity Catalog Jobs - Page 2

About the Company : Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and 1900+ employees, we provide the intimacy of a boutique consultancy with the capabilities of a large IT services firm. Role: Azure Databricks Engineer Experience: 5 +yrs Skillsets: Azure + Databricks + Unity Catalog + Python+SQL Work Location: Hyderabad/ Pune/Gurgaon/Bangalore Job Description Job Summary: We are seeking a highly skilled Azure Databricks Engineer to join our growing team. In this role, you will be responsible for managing and integrating Databricks services with Azure to build and maintain robust data pipelines. You will play a key role in ensuring our data infrastructure is efficient, scalable, and secure. Responsibilities: Manage Databricks clusters, including provisioning, configuration, and optimization. Manage Databricks users in workspace and services used by them such as notebooks, sql, workflows, mlflow etc. Integrate Azure services like Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Analytics with Databricks for a comprehensive data processing solution. Write high-performance Spark code for data manipulation and analysis. Monitor and troubleshoot Databricks jobs and pipelines for performance and stability. Monitor usage of Databricks workspaces and generate reports. Collaborate with data analysts, data scientists, and software engineers to design and implement data solutions. Stay up-to-date on the latest advancements in Azure and Databricks technologies. Qualifications: Proven experience working with Microsoft Azure and Azure Databricks. Good understanding of data warehousing and data lake concepts. Experience with Apache Spark for large-scale data processing. Proficiency in programming languages like Python (PySpark). Experience with SQL and relational databases. Excellent problem-solving and analytical skills. Strong communication and collaboration skills. Ability to work independently and as part of a team. Benefits: Competitive salary and benefits package. Opportunity to work on challenging and impactful projects. Collaborative and supportive work environment. Continuous learning and development opportunities.

About the Company : Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and 1900+ employees, we provide the intimacy of a boutique consultancy with the capabilities of a large IT services firm. Role: Azure Databricks Engineer Experience: 5 +yrs Skillsets: Azure + Databricks + Unity Catalog + Python+SQL Work Location: Hyderabad/ Pune/Gurgaon/Bangalore Job Description Job Summary: We are seeking a highly skilled Azure Databricks Engineer to join our growing team. In this role, you will be responsible for managing and integrating Databricks services with Azure to build and maintain robust data pipelines. You will play a key role in ensuring our data infrastructure is efficient, scalable, and secure. Responsibilities: Manage Databricks clusters, including provisioning, configuration, and optimization. Manage Databricks users in workspace and services used by them such as notebooks, sql, workflows, mlflow etc. Integrate Azure services like Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Analytics with Databricks for a comprehensive data processing solution. Write high-performance Spark code for data manipulation and analysis. Monitor and troubleshoot Databricks jobs and pipelines for performance and stability. Monitor usage of Databricks workspaces and generate reports. Collaborate with data analysts, data scientists, and software engineers to design and implement data solutions. Stay up-to-date on the latest advancements in Azure and Databricks technologies. Qualifications: Proven experience working with Microsoft Azure and Azure Databricks. Good understanding of data warehousing and data lake concepts. Experience with Apache Spark for large-scale data processing. Proficiency in programming languages like Python (PySpark). Experience with SQL and relational databases. Excellent problem-solving and analytical skills. Strong communication and collaboration skills. Ability to work independently and as part of a team. Benefits: Competitive salary and benefits package. Opportunity to work on challenging and impactful projects. Collaborative and supportive work environment. Continuous learning and development opportunities.

Expertise in Databricks Admin– Unity Catalog, Cluster Management, System Tables, Troubleshooting. Cloud & DevOps – AWS (S3, Lambda, EMR), Docker, Kubernetes. B Strong fundamentals in Data Warehousing (DW/DH), Spark/Python. Certifications –preferred.

Work Mode: Hybrid (3 days WFO) Locations: Bangalore, Noida, Pune, Mumbai, Hyderabad (Candidates must be in Accion cities to collect assets and attend in-person meetings as required). Key Requirements: Technical Skills: Databricks Expertise: 5+ years of hands-on experience in data engineering/ETL using Databricks on AWS/Azure cloud infrastructure. Proficiency in Delta Lake, Unity Catalog, Delta Sharing, Delta Live Tables (DLT), MLflow, and Databricks SQL. Experience with Databricks CI/CD tools (e.g., BitBucket, GitHub Actions, Databricks CLI). Data Warehousing & Engineering: Strong understanding of data warehousing concepts (Dimensional, SCD2, Data Vault, OBT, etc.). Proven ability to implement highly performant data ingestion pipelines from multiple sources. Experience integrating end-to-end Databricks pipelines to ensure data quality and consistency. Programming: Strong proficiency in Python and SQL. Basic working knowledge of API or stream-based data extraction processes (e.g., Salesforce API, Bulk API). Cloud Technologies: Preferred experience with AWS services (e.g., S3, Athena, Glue, Lambda). Power BI: 3+ years of experience in Power BI and data warehousing for root cause analysis and business improvement opportunities. Additional Skills: Working knowledge of Data Management principles (quality, governance, security, privacy, lifecycle management, cataloging). Nice to have: Databricks certifications and AWS Solution Architect certification. Nice to have: Experience with building data pipelines from business applications like Salesforce, Marketo, NetSuite, Workday, etc. Responsibilities: Develop, implement, and maintain highly efficient ETL pipelines on Databricks. Perform root cause analysis and identify opportunities for data-driven business improvements. Ensure quality, consistency, and governance of all data pipelines and repositories. Work in an Agile/DevOps environment to deliver iterative solutions. Collaborate with cross-functional teams to meet business requirements. Stay updated on the latest Databricks and AWS features, tools, and best practices. Work Schedule: Regular: 11:00 AM to 8:00 PM. Flexibility is required for project-based overlap. Interested candidates should share their resumes with the following details: Current CTC Expected CTC Preferred Location: Bangalore, Noida, Pune, Mumbai, Hyderabad Notice Period Contact Information: