2404 Azure Databricks Jobs - Page 32

Responsibilities: * Design, develop & maintain Azure Databricks solutions using ADF, SQL & PySpark. * Collaborate with cross-functional teams on data engineering projects.

Neudesic is looking for Data Architect with a deep and broad technical skill in data management products/platforms as well as solid architecture and design skills. Qualifications: Experience : Azure,AWS,GCP Platform Architecture , Framework /Accelerator design , ETL Solutions , Analytics solutions , Data Modeling , ML Modeling Platform : Databricks , Synapse , EMR,Hadoop, Google DataProc, Language : PySpark, SQL, Python ,Scala Integration- Azure Data factory , SSIS(optional) , EventHub/Kafka, Python API(Flask), Azure Functions, Airflow, AWS Glue, Talend, Event Bridge/SQS/SNS, AWS Lambda, GCP Cloud Data Fusion Databases : Azure SQL , SQL Server ,MongoDB ,.Cosmos DB, Oracle , PostgreSQL etc. D...

Hello Folks, We are hiring for "Azure Data Engineer" for one of the Service Based Company. Job Description: Job type:- Permanent / Full Time 1) Skills - Pyspark + ADB, ADF - Good to have Exp - 6-9 yrs Loc - Chennai/Mumbai (Hybrid) NP - Sept Serving Only IP - L1 - L2 - Virtual 2) Skills - Pyspark + ADB + ADF + SQL, Azure Synapse - Good to have Exp - 6-14 yrs Loc - MPCBN - Hybrid (Coim/Ahm - 2nd priority) NP - Sept Serving Only IP - L1 - L2 - Virtual 3) Skills - Pyspark + Azure Synapse - SQL G5 - 6-12 yrs Loc - MPCB - Hybrid NP - Mid Sept Serving Only IP - L1 - L2 - Virtual 6+ years of experience in ETL with minimum of 3+ years of experience in PySpark/Spark SQL Strong SQL skills with experien...

Role & responsibilities As a Data Engineering Trainer , your key responsibilities will include delivering high-quality technical training and mentoring students to become job-ready data engineers. You are expected to lead with industry knowledge, hands-on expertise, and strong mentoring skills. Deliver Technical Sessions: Teach Python, SQL, PySpark/Spark, AWS services, Azure, and ApacheAirflow strictly following the published syllabus. Create Learning Assets: Build concise slide decks, handson labs, assignments, and realworld miniprojects. Mentor & Support Learners: Hold doubtclearing hours, code reviews, and careerprep mock interviews. Assess Progress: Design quizzes, grade submissions and ...

Thanks & Regards Sulabh Tailang HR-Talent Acquisition Manager |Celebal Technologies |91-9448844746 Sulabh.tailang@celebaltech.com|LinkedIn-sulabhtailang |Twitter-Ersulabh Website-www.celebaltech.com Job Role Data Engineer Job Location Jaipur Job Type Permanent Experience Required- (2-4) Years As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data pipelines and infrastructure. You will work closely with our data scientists, analysts, and other stakeholders to ensure data is accurate, timely, and accessible. Your contributions will directly impact our data-driven decision-making and support our growth. Key Responsibilities: Data Pipeline Developmen...

The Development Lead will oversee the design, development, and delivery of advanced data solutions using Azure Databricks, SQL, and data visualization tools like Power BI. The role involves leading a team of developers, managing data pipelines, and creating insightful dashboards and reports to drive data-driven decision-making across the organization. The individual will ensure best practices are followed in data architecture, development, and reporting while maintaining alignment with business objectives. Key Responsibilities: Data Integration & ETL Processes: Design, build, and optimize ETL pipelines to manage the flow of data from various sources into data lakes, data warehouses, and repo...

Classic pipeline Powershell Yaml Biceps Arm Templateterraform/ Biceps CI/CD Experience with data lake and analytics technologies in Azure (e.g., Azure Data Lake Storage, Azure Data Factory, Azure Databricks)- most important Data background with Azure & Powershell. Location: Chennai, Hyderabad, Kolkata, Pune, Ahmedabad, Remote. Keywords Classic pipeline,PowerShell,YAML,Biceps,ARM Template,CI/CD,Azure Data Lake Storage,Azure Data Factory,Azure Databricks,Azure DevOps*Mandatory Key Skills Classic pipeline,PowerShell,YAML,Biceps,ARM Template,CI/CD,Azure Data Lake Storage,Azure Data Factory,Azure Databricks,Azure DevOps*

Locations: Bengaluru, Kolkata, Pune, Chennai, Hyderabad (Hybrid work mode ) Max budget 55Lpa Architecture & Design: Design scalable and secure data architectures using Azure Databricks, Spark, Delta Lake, and MLflow. Lead the migration from legacy systems to Databricks Lakehouse. Develop modular, reusable, and production-grade ETL/ELT pipelines. Implementation & Optimization: Optimize data ingestion, transformation, and consumption processes. Tune Databricks jobs for performance and cost-efficiency. Implement proactive monitoring and maintenance strategies. Collaboration & Leadership: Work with data engineers, developers, and business stakeholders to align architecture with business goals. M...

Locations: Bengaluru, Kolkata, Pune, Chennai, Hyderabad (Hybrid work mode ) Max budget 55Lpa Architecture & Design: Design scalable and secure data architectures using Azure Databricks, Spark, Delta Lake, and MLflow. Lead the migration from legacy systems to Databricks Lakehouse. Develop modular, reusable, and production-grade ETL/ELT pipelines. Implementation & Optimization: Optimize data ingestion, transformation, and consumption processes. Tune Databricks jobs for performance and cost-efficiency. Implement proactive monitoring and maintenance strategies. Collaboration & Leadership: Work with data engineers, developers, and business stakeholders to align architecture with business goals. M...

The Azure Data Bricks Engineer plays a critical role in establishing and maintaining an efficient data ecosystem within an organization. This position is integral to the development of data solutions leveraging the capabilities of Microsoft Azure Data Bricks. The engineer will work closely with data scientists and analytics teams to facilitate the transformation of raw data into actionable insights. With increasing reliance on big data technologies and cloud-based solutions, having an expert on board is vital for driving data-driven decision-making processes. The Azure Data Bricks Engineer will also be responsible for optimizing data workflows, ensuring data quality, and deploying scalable d...

Department : Platform Engineering Summary : We are seeking a highly skilled Data Engineer with expertise in ontology development and knowledge graph implementation. This role will be pivotal in shaping our data infrastructure and ensuring the accurate representation and integration of complex data sets. You will leverage industry best practices, including the Basic Formal Ontology (BFO) and Common Core Ontologies (CCO), to design, develop, and maintain ontologies, semantic and syntactic data models, and knowledge graphs on the Databricks Data Intelligence Platform that drive data-driven decision-making and innovation within the company. Responsibilities : Ontology Development : - Design and ...

Department : Platform Engineering Summary : We are seeking a highly skilled Data Engineer with expertise in ontology development and knowledge graph implementation. This role will be pivotal in shaping our data infrastructure and ensuring the accurate representation and integration of complex data sets. You will leverage industry best practices, including the Basic Formal Ontology (BFO) and Common Core Ontologies (CCO), to design, develop, and maintain ontologies, semantic and syntactic data models, and knowledge graphs on the Databricks Data Intelligence Platform that drive data-driven decision-making and innovation within the company. Responsibilities : Ontology Development : - Design and ...

Department : Platform Engineering Summary : We are seeking a highly skilled Data Engineer with expertise in ontology development and knowledge graph implementation. This role will be pivotal in shaping our data infrastructure and ensuring the accurate representation and integration of complex data sets. You will leverage industry best practices, including the Basic Formal Ontology (BFO) and Common Core Ontologies (CCO), to design, develop, and maintain ontologies, semantic and syntactic data models, and knowledge graphs on the Databricks Data Intelligence Platform that drive data-driven decision-making and innovation within the company. Responsibilities : Ontology Development : - Design and ...

About the team: AIML is usedto create chatbots, virtual assistants, and other forms of artificial intelligence software. AIML is also used in research and development of natural language processing systems. What you can look forward to as a AI/ML exper t Lead Development : Own endtoend design, implementation, deployment and maintenance of both traditional ML and Generative AI solutions (e.g., finetuning LLMs, RAG pipelines) Project Execution & Delivery : Translate business requirements into datadriven and GenAIdriven use cases; scope features, estimates, and timelines Technical Leadership & Mentorship : Mentor, review and coach junior/midlevel engineers on best practices in ML, MLOps and Gen...

Project description The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week. Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart. Current overriding priorities are new brands onboarding, re-architecture, database migrations, migration of microservices to a unified cloud-native solution without any disruption to business. Responsibilities We are looking for Data Engineer who will be responsible for designing a solution for a big retail company. The main focus is to supp...

We are looking for a skilled Azure Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data solutions on Microsoft Azure. You will work closely with data analysts, scientists, and business stakeholders to ensure efficient data processing, storage, and access. Key Responsibilities: Design and develop robust and scalable data pipelines using Azure Data Factory , Databricks , and Azure Synapse Analytics Develop and optimize ETL/ELT processes Implement data lake and data warehouse solutions using Azure Data Lake Storage , SQL Server , and Synapse Work with structured and unstructured data from various sources (e.g., APIs, databases, files) Ensure data quality, in...

Classic pipeline Powershell Yaml Biceps Arm Templateterraform/ Biceps CI/CD Experience with data lake and analytics technologies in Azure (e.g., Azure Data Lake Storage, Azure Data Factory, Azure Databricks)- most important Data background with Azure & Powershell.

Databricks lead with 10 to 12 years and Sr. Engineer with 5+ Years of experience with above mentioned skill sets. Databricks + PySpark is a must; Skills needed are intermediate to expert,GCP is good to have Strong development and problem-solving skills. Experienced in development of Data platforms / Datalakes using ETL or ELT approach, preferably Databricks Delta lakehouse. Development of real-time data workflows and pipelines using (Py)Spark Structured Steaming solutions. Must have programming skills: Python, PySpark, SQL A fair understanding of commonly used data offerings on Azure (ADF, Synapse etc). Knowledge of DevOps processes and hands-on experience in implementing pipelines using CI/...

About the job : Role : Microsoft Fabric Data Engineer Experience : 6+ years as Azure Data Engineer including at least 1 E2E Implementation in Microsoft Fabric. Responsibilities : - Lead the design and implementation of Microsoft Fabric-centric data platforms and data warehouses. - Develop and optimize ETL/ELT processes within the Microsoft Azure ecosystem, effectively utilizing relevant Fabric solutions. - Ensure data integrity, quality, and governance throughout Microsoft Fabric environment. - Collaborate with stakeholders to translate business needs into actionable data solutions. - Troubleshoot and optimize existing Fabric implementations for enhanced performance. Skills : - Solid foundat...

The Azure Data Bricks Engineer plays a critical role in establishing and maintaining an efficient data ecosystem within an organization. This position is integral to the development of data solutions leveraging the capabilities of Microsoft Azure Data Bricks. The engineer will work closely with data scientists and analytics teams to facilitate the transformation of raw data into actionable insights. With increasing reliance on big data technologies and cloud-based solutions, having an expert on board is vital for driving data-driven decision-making processes. The Azure Data Bricks Engineer will also be responsible for optimizing data workflows, ensuring data quality, and deploying scalable d...

Build and deploy machine learning models and AI solutions using Azure AI services. Work with Python, PySpark, and Azure Databricks/Synapse for data analysis and modeling. Use Microsoft Data Fabric to connect and manage enterprise data. Proficiency in Python (Pandas, NumPy, Scikit-learn, TensorFlow/PyTorch). Experience with Spark (PySpark/Scala) and Azure data services (Data Lake, Synapse, Databricks, Azure ML). Azure-certified skills Microsoft Certified: Azure Data Scientist Associate (DP-100), demonstrating expertise in designing, training, deploying, and managing ML solutions on Azure Comprehensive ML lifecycle experience: data exploration, preprocessing, experimentation, model training, d...

Azure Databricks / ADF with Python Pyspark for CMM5 company Only Immediate 5-8 Yrs - Max ctc -19 LPA includes 10 % Variable Locations: Pune/Mumbai/Chennai/Bangalore/Hyd/Kolkata. Note: Send Date of Birth , passport size photo and Pan no . Share your update cv to madhavi.naik@alikethoughts.com

Role - Lead Data Engineer Experience - 8-10 Years Must have Skills: 3+ years of hands on experience in Azure Data Engineering development project 2+ years of experience in Databricks development 2+ years of experience in PySpark. 2+ years of experience in SQL Proficient in SQL 2+ years of experience in leading at least a 5+ member team in data engineering delivery Must be fluent in communication Good to have skills: Azure Synapse Tableau Power BI Additional information : This position requires work from office in Gurgaon 5 days a week.

Role & responsibilities Azure Databricks Developer Hexaware Technologies Exciting opportunity in Coimbatore for an experienced Azure Databricks Developer. Join Hexawares cloud and data engineering team to build scalable, production-ready data solutions. Location Coimbatore Experience & Notice Period 4 to 9 years Immediate availability preferred (Maximum 30 days) About the Role Be a hands-on contributor on Azure Databricks projects with full involvement in PySpark development. You will design, build, optimize and operationalize data pipelines and solutions across Data Lakes, Data Warehouses, and Data Marts. Key Responsibilities Develop, test and maintain ETL/ELT pipelines using Azure Databric...

6-month extendable Hybrid role in Indore, Noida, Bangalore, Hyderabad, Gurgaon, or Pune. Requires to go 4 days a month in office 8+ yrs in ETL & pipeline expert skilled in Azure, Spark, SQL, Python/Scala, Synapse, Snowflake, and data architecture.