2404 Azure Databricks Jobs - Page 36

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

Overall 6.5 - 10 yrs of IT experience preferably in cloud Min 5 years in Azure Databricks on development projects Should be 100% hands on in Pyspark coding Should have strong SQL expertise in writing advanced/complex SQL queries DWH experience is a must for this role Experience in programming using Python is an advantage Experience in data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirements Should be able to understand system architecture which involves Data Lakes, Data Warehouses and Data Marts Experience to own end-to-end development, including coding, testing, debugging and deployment Excellent communication is required for ...

UK-based company needed Responsibilities: * Design data solutions using Azure Data Architecture principles. * Collaborate with cross-functional teams on data integration projects. * Ensure data quality through warehousing best practices. Office cab/shuttle Food allowance Provident fund Annual bonus Health insurance

Department : Platform Engineering Summary : We are seeking a highly skilled Data Engineer with expertise in ontology development and knowledge graph implementation. This role will be pivotal in shaping our data infrastructure and ensuring the accurate representation and integration of complex data sets. You will leverage industry best practices, including the Basic Formal Ontology (BFO) and Common Core Ontologies (CCO), to design, develop, and maintain ontologies, semantic and syntactic data models, and knowledge graphs on the Databricks Data Intelligence Platform that drive data-driven decision-making and innovation within the company. Responsibilities : Ontology Development : - Design and ...

Primary Roles And Responsibilities : - Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack - Ability to provide solutions that are forward-thinking in data engineering and analytics space - Collaborate with DW/BI leads to understand new ETL pipeline development requirements. - Triage issues to find gaps in existing pipelines and fix the issues - Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs - Help joiner team members to resolve issues and technical challenges. - Drive technical discussion with client architect and team members - Orchestrate the data pipelines in scheduler via Airflow Skills And Qual...

Key Responsibilities: Design, build, and maintain scalable data pipelines on Azure cloud. Develop and optimize ETL workflows using Azure Data Factory (ADF). Implement advanced data processing and transformation logic using Databricks and PySpark. Write efficient, scalable, and reusable Python scripts for data ingestion and processing. Manage and optimize complex SQL queries and stored procedures. Integrate data from multiple sources (e.g., APIs, flat files, databases) into centralized repositories. Ensure data quality, security, governance, and compliance best practices. Collaborate with data scientists, analysts, and other stakeholders to support data-driven initiatives. Monitor data workfl...

Roles and Responsibilities: The Data Engineer will work on data engineering projects for various Businesses, focusing on delivery of complex data management solutions by leveraging industry best practices. They work with the project team to build the most efficient data pipelines and data management solutions that make data easily available for consuming applications and analytical solutions. A Data engineer is expected to possess strong technical skills. Key Characteristics Technology champion who constantly pursues skill enhancement and has inherent curiosity to understand work from multiple dimensions. Interest and passion in Big Data technologies and appreciates the value that can be bro...

Skills Required: Azure Data Factory Azure Data Lake Store Azure Databricks PySpark Sql DP 203 certification preferred Roles and Responsibilities: The Data Engineer will work on data engineering projects for various Businesses, focusing on delivery of complex data management solutions by leveraging industry best practices. They work with the project team to build the most efficient data pipelines and data management solutions that make data easily available for consuming applications and analytical solutions. A Data engineer is expected to possess strong technical skills. Key Characteristics Technology champion who constantly pursues skill enhancement and has inherent curiosity to understand ...

We are seeking a skilled Lead Data Engineer with extensive experience in Snowflake, ADF, SQL, and other relevant data technologies to join our team. As a key member of our data engineering team, you will play an instrumental role in designing, developing, and managing data pipelines, working closely with cross-functional teams to drive the success of our data initiatives. Key Responsibilities: Design, implement, and maintain data solutions using Snowflake, ADF, and SQL Server to ensure data integrity, scalability, and high performance. Lead and contribute to the development of data pipelines, ETL processes, and data integration solutions, ensuring the smooth extraction, transformation, and l...

We are seeking a skilled Lead Data Engineer with extensive experience in Snowflake, ADF, SQL, and other relevant data technologies to join our team. As a key member of our data engineering team, you will play an instrumental role in designing, developing, and managing data pipelines, working closely with cross-functional teams to drive the success of our data initiatives. Key Responsibilities: Design, implement, and maintain data solutions using Snowflake, ADF, and SQL Server to ensure data integrity, scalability, and high performance. Lead and contribute to the development of data pipelines, ETL processes, and data integration solutions, ensuring the smooth extraction, transformation, and l...

Summary : We are seeking a highly skilled Data Engineer with expertise in ontology development and knowledge graph implementation. This role will be pivotal in shaping our data infrastructure and ensuring the accurate representation and integration of complex data sets. You will leverage industry best practices, including the Basic Formal Ontology (BFO) and Common Core Ontologies (CCO), to design, develop, and maintain ontologies, semantic and syntactic data models, and knowledge graphs on the Databricks Data Intelligence Platform that drive data-driven decision-making and innovation within the company. Responsibilities : Ontology Development : - Design and implement ontologies based on BFO ...

Primary Roles And Responsibilities : - Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack. - Ability to provide solutions that are forward-thinking in data engineering and analytics space. - Collaborate with DW/BI leads to understand new ETL pipeline development requirements. - Triage issues to find gaps in existing pipelines and fix the issues. - Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs. - Help joiner team members to resolve issues and technical challenges. - Drive technical discussion with client architect and team members. - Orchestrate the data pipelines in scheduler via Airflow. Skills An...

Job Summary: Supports, develops and maintains a data and analytics platform. Effectively and efficiently process, store and make data available to analysts and other consumers. Works with the Business and IT teams to understand the requirements to best leverage the technologies to enable agile data delivery at scale. Key Responsibilities: Implements and automates deployment of our distributed system for ingesting and transforming data from various types of sources (relational, event-based, unstructured). Implements methods to continuously monitor and troubleshoot data quality and data integrity issues. Implements data governance processes and methods for managing metadata, access, retention ...

About the team: AIML is usedto create chatbots, virtual assistants, and other forms of artificial intelligence software. AIML is also used in research and development of natural language processing systems. What you can look forward to as a AI/ML expert Lead Development : Own endtoend design, implementation, deployment and maintenance of both traditional ML and Generative AI solutions (e.g., finetuning LLMs, RAG pipelines) Project Execution & Delivery : Translate business requirements into datadriven and GenAIdriven use cases; scope features, estimates, and timelines Technical Leadership & Mentorship : Mentor, review and coach junior/midlevel engineers on best practices in ML, MLOps and GenA...

- Proven expertise in .Net Full Stack development including ASP .NET, C#, and SQL Server, Azure Databricks. - Strong knowledge of analytics and reporting frameworks. - Experience in enterprise application architecture and system integration.

Inviting applications for the role of Lead Consultant-Data Engineer, Azure+Python! Responsibilities Hands on experience with Azure, pyspark, and Python with Kafka Monitor and optimize the performance of cloud resources to ensure efficient utilization and cost-effectiveness. Implement and maintain security measures to protect data and systems within the Azure environment, including IAM policies, security groups, and encryption mechanisms. Develop application programs using Big Data technologies like Apache Hadoop, Apache Spark, etc Build data pipelines by building ETL processes (Extract-Transform-Load) Implement backup, disaster recovery, and business continuity strategies for cloud-based app...

Job Objective: We are looking for Azure Data and Analytics Solutions Architect focusing on Data engineering to join our growing team of Data and Analytics specialized Consulting organization. This plays a key role in Digital journey of our clients spread globally with focus on Data & AI at the core of it. This role is in our setup to drive the exploratory sessions to find the opportunities, arrive at the Data and Analytics solutions that could involve technical, process and people. Once the solutions are found, this role will orchestrate, architect and technically drive the solutions and do the hands on when and where needed. This role also will mentor, train and enable the consultants at va...

Design & implement scalable data integration pipelines using Azure Data Factory, Azure Databricks, & ADLS, Develop & deploy AI/ML models using Machine Learning, Azure Cognitive Services & other Azure AI services. Ensure high-quality data processing Required Candidate profile Backend Development: 7–10 years of experience with Java and Spring Boot, focused on building scalable microservices, API Integration, Strong understanding of Azure AI and data services - ADLS, Azure,

Data Engineer Full Time - Gurgaon/Noida/Hyderabad Role and Responsibilities Develops and operationalizes data pipelines to make data available for consumption (BI, Advanced analytics, Services). Works in tandem with data architects and data/BI engineers to design data pipelines and recommends ongoing optimization of data storage, data ingestion, data quality and orchestration. Designs, develops, and implements ETL/ELT processes using Azure services such as Azure Data Bricks, Azure SQL Synapse, ADLS etc. to improve and speed up delivery of our data products and services. Implement solutions by developing scalable data processing platforms to drive high-value insights to the organization. Iden...

Job Title: Senior Data Engineer / Data Platform Lead Azure (10+ Years Exp) Location: [Hyd/Coim/Pune Experience: 10 to 15 Years Skills: Azure, Technical architect, Data Engineer, DB, DS, Integration, Team Handling, US Stakeholders exp, project manager exp. Job Description: We are looking for a Senior Data Engineer / Data Platform Lead with over 10 years of experience in managing and delivering end-to-end data platform solutions, including ETL pipelines, data modeling, and dashboard/reporting layers. The ideal candidate will have 5+ years of hands-on experience in Microsoft Azure Data Services and a strong background in modern data architecture and platform transformation. Key Responsibilities...

Job Summary: We are seeking an experienced Senior Data Engineer to join our data engineering team. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines to support enterprise data solutions. The role focuses on data ingestion into Azure Data Lake (ADLS Gen2), data transformations in Databricks, and end-to-end pipeline automation to enable scalable and high-quality data workflows across the organization. Key Responsibilities: Data Ingestion & Pipeline Development Design and develop scalable, secure, and efficient data pipelines using Azure Data Factory, PySpark, or Databricks notebooks. Ingest structured and unstructured data from multiple sour...

Position : Senior Data Engineer Databricks Expert We are seeking a Senior Data Engineer with in-depth knowledge of Databricks and Unity Catalog to serve as the subject matter expert for all things Databricks within our organization. This role requires deep expertise in Databricks, including CI/CD setup for data bricks, data lineage through Unity Catalog, and strong proficiency in ETL , SQL , and modern data engineering practices. You will be the go-to person for designing, implementing, and optimizing data solutions with Databricks. Key Responsibilities: Serve as the point of contact and subject matter expert for all Databricks-related activities, including architecture, development, and ope...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications

Job Description: Azure Databricks Engineer Position: Azure Databricks Engineer Location: [Specify Location / Remote / Hybrid] Experience Required: 4 10 years (depending on role level) Role Overview We are seeking an experienced Azure Databricks Engineer to design, develop, and optimize data pipelines and analytics solutions on Azure. The ideal candidate will have strong expertise in building scalable big data solutions using Databricks, Spark, and Azure cloud services, with a focus on delivering reliable, secure, and high-performing data platforms. Key Responsibilities Design, build, and optimize scalable ETL/ELT pipelines on Azure Databricks . Work with structured, semi-structured, and unst...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Data Services Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. You will be responsible for ensuring the smooth functioning of applications and providing solutions to work-related problems. A typical day in this role involves collaborating with team members, analyzing business requirem...