2404 Azure Databricks Jobs - Page 35

Azure ADF, Databricks with Pyspark/ Python Data Engineer with Pyspark, Databricks skillset 4+ years of experience Data Engineering with min 3+ years hands on experience in Pyspark for data transformations Sound Knowledge on - Azure Data Bricks, Azure Data Lake. Sound knowledge in Data Bricks & Logic Apps Delta Lake, Azure SQL and Azure blob storage, Azure logic apps, Azure Functions and Azure Synapse, Azure Purview. Extensive knowledge on big data concepts like Hive, and spark framework. Should be able to write complex SQL queries. Sound understanding of DWH concepts. Strong hands-on experience on Python or Scala. Hands on experience on Azure Data Factory. Should be able to coordinate indepe...

Azure ADF, Databricks with Pyspark/ Python Data Engineer with Pyspark, Databricks skillset 4+ years of experience Data Engineering with min 3+ years hands on experience in Pyspark for data transformations Sound Knowledge on - Azure Data Bricks, Azure Data Lake. Sound knowledge in Data Bricks & Logic Apps Delta Lake, Azure SQL and Azure blob storage, Azure logic apps, Azure Functions and Azure Synapse, Azure Purview. Extensive knowledge on big data concepts like Hive, and spark framework. Should be able to write complex SQL queries. Sound understanding of DWH concepts. Strong hands-on experience on Python or Scala. Hands on experience on Azure Data Factory. Should be able to coordinate indepe...

Azure ADF, Databricks with Pyspark/ Python Data Engineer with Pyspark, Databricks skillset 4+ years of experience Data Engineering with min 3+ years hands on experience in Pyspark for data transformations Sound Knowledge on - Azure Data Bricks, Azure Data Lake. Sound knowledge in Data Bricks & Logic Apps Delta Lake, Azure SQL and Azure blob storage, Azure logic apps, Azure Functions and Azure Synapse, Azure Purview. Extensive knowledge on big data concepts like Hive, and spark framework. Should be able to write complex SQL queries. Sound understanding of DWH concepts. Strong hands-on experience on Python or Scala. Hands on experience on Azure Data Factory. Should be able to coordinate indepe...

About the job : Role : Microsoft Fabric Data Engineer Experience : 6+ years as Azure Data Engineer including at least 1 E2E Implementation in Microsoft Fabric. Responsibilities : - Lead the design and implementation of Microsoft Fabric-centric data platforms and data warehouses. - Develop and optimize ETL/ELT processes within the Microsoft Azure ecosystem, effectively utilizing relevant Fabric solutions. - Ensure data integrity, quality, and governance throughout Microsoft Fabric environment. - Collaborate with stakeholders to translate business needs into actionable data solutions. - Troubleshoot and optimize existing Fabric implementations for enhanced performance. Skills : - Solid foundat...

• Lead the data engineering team by driving the design, build, test, and launch of new data pipelines and models on the production data platform

Key Responsibilities: Team Leadership: Lead and mentor a team of Azure Data Engineers, providing technical guidance and support. Foster a collaborative and innovative team environment. Conduct regular performance reviews and set development goals for team members. Organize training sessions to enhance team skills and technical capabilities. Azure Data Platform: Design, implement, and optimize scalable data solutions using Azure data services such as Azure Databricks, Azure Data Factory, Azure SQL Database, and Azure Synapse Analytics. Ensure data engineering best practices and data governance are followed. Stay up-to-date with Azure data technologies and recommend improvements to enhance dat...

Key Responsibilities: Team Leadership: Lead and mentor a team of Azure Data Engineers, providing technical guidance and support. Foster a collaborative and innovative team environment. Conduct regular performance reviews and set development goals for team members. Organize training sessions to enhance team skills and technical capabilities. Azure Data Platform: Design, implement, and optimize scalable data solutions using Azure data services such as Azure Databricks, Azure Data Factory, Azure SQL Database, and Azure Synapse Analytics. Ensure data engineering best practices and data governance are followed. Stay up-to-date with Azure data technologies and recommend improvements to enhance dat...

The Azure Data Bricks Engineer plays a critical role in establishing and maintaining an efficient data ecosystem within an organization. This position is integral to the development of data solutions leveraging the capabilities of Microsoft Azure Data Bricks. The engineer will work closely with data scientists and analytics teams to facilitate the transformation of raw data into actionable insights. With increasing reliance on big data technologies and cloud-based solutions, having an expert on board is vital for driving data-driven decision-making processes. The Azure Data Bricks Engineer will also be responsible for optimizing data workflows, ensuring data quality, and deploying scalable d...

Classic pipeline Powershell Yaml Biceps Arm Templateterraform/ Biceps CI/CD Experience with data lake and analytics technologies in Azure (e.g., Azure Data Lake Storage, Azure Data Factory, Azure Databricks)- most important Data background with Azure & Powershell. Location: Chennai, Hyderabad, Kolkata, Pune, Ahmedabad, Remote

Role & responsibilities Job Description: As a Data Engineer, you will work with multiple teams to deliver solutions on the Azure Cloud using core cloud data warehouse tools (Azure Data Factory, Azure Databricks, Azure SQL DW and other Big Data related technologies). In addition to building the next generation of application data platforms (not infrastructure) and/or improving recent implementations. Note: This is a data engineer from the application side. Must be able to analyze data and develop strategies for populating data lakes. This is not an infrastructure position. This person may be called upon to do complex coding using U-SQL, Scala or Python and T-SQL. Responsibilities: Work as par...

Must Have: Tech Skill: Handson project experience in DataBricks , pyspark , SQL on any Cloud ( Azure or AWS) - 4+ Years Programming Skills: Strong experience with Python Expertise in Data Storage Technologies: In-depth knowledge of Data Warehouse, Database technologies, and Big Data Eco-system technologies Experience with AWS / Azure Data Lakes : Proven experience working with data lakes on cloud to store and process both structured and unstructured data sets. Development experience: Design and Develop Data Pipelines: Create pipelines to ingest, process, and transform data, deliver Cloud-based Serverless solutions to the customers. Implement ETL/ELT Processes: Develop Extract, Transform, Loa...

Must Have: Tech Skill: Handson project experience in DataBricks , pyspark , SQL on any Cloud ( Azure or AWS) - 4+ Years Programming Skills: Strong experience with Python Expertise in Data Storage Technologies: In-depth knowledge of Data Warehouse, Database technologies, and Big Data Eco-system technologies Experience with AWS / Azure Data Lakes : Proven experience working with data lakes on cloud to store and process both structured and unstructured data sets. Development experience: Design and Develop Data Pipelines: Create pipelines to ingest, process, and transform data, deliver Cloud-based Serverless solutions to the customers. Implement ETL/ELT Processes: Develop Extract, Transform, Loa...

Primary Roles And Responsibilities : - Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack. - Ability to provide solutions that are forward-thinking in data engineering and analytics space. - Collaborate with DW/BI leads to understand new ETL pipeline development requirements. - Triage issues to find gaps in existing pipelines and fix the issues. - Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs. - Help joiner team members to resolve issues and technical challenges. - Drive technical discussion with client architect and team members. - Orchestrate the data pipelines in scheduler via Airflow. Skills An...

Experience : 6+ years as Azure Data Engineer including at least 1 E2E Implementation in Microsoft Fabric. Responsibilities : - Lead the design and implementation of Microsoft Fabric-centric data platforms and data warehouses. - Develop and optimize ETL/ELT processes within the Microsoft Azure ecosystem, effectively utilizing relevant Fabric solutions. - Ensure data integrity, quality, and governance throughout Microsoft Fabric environment. - Collaborate with stakeholders to translate business needs into actionable data solutions. - Troubleshoot and optimize existing Fabric implementations for enhanced performance. Skills : - Solid foundational knowledge in data warehousing, ETL/ELT processes...

The Azure Data Bricks Engineer plays a critical role in establishing and maintaining an efficient data ecosystem within an organization. This position is integral to the development of data solutions leveraging the capabilities of Microsoft Azure Data Bricks. The engineer will work closely with data scientists and analytics teams to facilitate the transformation of raw data into actionable insights. With increasing reliance on big data technologies and cloud-based solutions, having an expert on board is vital for driving data-driven decision-making processes. The Azure Data Bricks Engineer will also be responsible for optimizing data workflows, ensuring data quality, and deploying scalable d...

KPI Partners is seeking a skilled and experienced Lead - Azure Data Engineer to join our dynamic team. The ideal candidate will play a crucial role in designing and implementing data solutions that drive business intelligence and analytics capabilities within our organization. Key Responsibilities: - Lead the design, development, and deployment of data pipelines on Microsoft Azure to support various analytical needs. - Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical specifications. - Optimize and enhance existing data architectures to improve data quality, accessibility, and performance. - Ensure best pra...

The Azure Data Bricks Engineer plays a critical role in establishing and maintaining an efficient data ecosystem within an organization. This position is integral to the development of data solutions leveraging the capabilities of Microsoft Azure Data Bricks. The engineer will work closely with data scientists and analytics teams to facilitate the transformation of raw data into actionable insights. With increasing reliance on big data technologies and cloud-based solutions, having an expert on board is vital for driving data-driven decision-making processes. The Azure Data Bricks Engineer will also be responsible for optimizing data workflows, ensuring data quality, and deploying scalable d...

About the job : Role : Microsoft Fabric Data Engineer Experience : 6+ years as Azure Data Engineer including at least 1 E2E Implementation in Microsoft Fabric. Responsibilities : - Lead the design and implementation of Microsoft Fabric-centric data platforms and data warehouses. - Develop and optimize ETL/ELT processes within the Microsoft Azure ecosystem, effectively utilizing relevant Fabric solutions. - Ensure data integrity, quality, and governance throughout Microsoft Fabric environment. - Collaborate with stakeholders to translate business needs into actionable data solutions. - Troubleshoot and optimize existing Fabric implementations for enhanced performance. Skills : - Solid foundat...

We are hiring for Data Engineer Greetings from R Systems International!!! As discussed regarding the job opportunity for Data Engineer. Please go through the below details (about the company, Client, and Job description). About- R Systems International Limited (https://www.rsystems.com/about-us/factsheet/) R Systems is a Blackstone portfolio Company founded in 1993, Headquartered at El Dorado Hills, California, United States (USA) and offshore delivery centers located at Noida, Pune and Chennai. R Systems International Limited is listed publically at NSE and BSE with current share price at around RS 500+. It is a leading digital product engineering company that designs and builds next-gen pr...

Experience Required: 5 to 6Years Mandate Mode of work: Remote (India) Skills Required: Azure Data Factory, Databricks, Pyspark, Python/Scala , SQL Notice Period : Immediate Joiners/ Permanent(Can join Immediately by 8th September 2025 ) 5 to 6 years of experience with Big Data technologies Experience with Microsoft Azure cloud platform. Expertise in Azure Databricks, Azure Data Factory, SQL, Pyspark, ADLS, Delta Lake Experience in SQL and experience with SQL-based database systems. Hands-on experience with Azure data services, such as Azure SQL Database, Azure Data Lake, and Azure Blob Storage . Experience with data integration and ETL (Extract, Transform, Load) processes . Experience with p...

About the job : Role : Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience : 8-15 years Primary Roles And Responsibilities : - Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack - Ability to provide solutions that are forward-thinking in data engineering and analytics space - Collaborate with DW/BI leads to understand new ETL pipeline development requirements. - Triage issues to find gaps in existing pipelines and fix the issues - Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs - Help joiner team members to resolve issues and technical challenges. - Drive technical discu...

About The Role AZURE Devops JD Position OverviewWe are looking for an experienced DevOps Candidate who specializes in Azure DevOps CI/CD Pipeline and possesses knowledge of Azure data services such as Azure Data Factory (ADF), Azure Data Lake (ADL), and Azure Databricks (ADB). The ideal candidate will have a proven track record of designing, implementing, and managing CI/CD pipelines for different technologies like java .NET applications. In this role, you will play a key role in optimizing our development and deployment processes, ensuring scalability, reliability, and performance of our Azure-based platforms. Key Responsibilities Design, implement, and manage CI/CD pipelines using Azure De...

As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big ...

As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big ...

Dear Candidate, I Hope you are doing well ! We have Immediate openings for Azure Databricks Engineer at Pan India location for Permanent job Opportunity with Known MNC Company, If you are interested and immediate Joiner please share your details to monika.dorthy@upgrad.com Total Experience:- Relevant exp in Azure Databricks Relevant exp in Python ctc:- ectc:- Notice period:- Willing to join in 10 -15 days only How many years of experience do you have in Azure Databricks Engineer? How many years of experience do you have in Python?