3651 Azure Databricks Jobs - Page 42

Hi We are looking for Data Engineers - Immediate - 15 Days Notice. Multiple openings on AWS Or Azure Data Engineers If your interested please drop your CV to - " pallavi.vurimella@ascendion.com"

As an Associate Manager - AIOps & MLOps Operations at our company, your role will involve supporting and enhancing the automation, scalability, and reliability of AI/ML operations across the enterprise. You will be responsible for deploying AI/ML models, ensuring continuous monitoring, and implementing self-healing automation to improve system performance, minimize downtime, and enhance decision-making with real-time AI-driven insights. **Key Responsibilities:** - Support and maintain AIOps and MLOps programs in alignment with business objectives, data governance standards, and enterprise data strategy. - Implement real-time data observability, monitoring, and automation frameworks to enhanc...

As a Visualization Platform Architect at PepsiCo, you will play a crucial role in leading and overseeing the data visualization platforms and operations. Your main responsibilities will include driving a strong vision for visualization platforms to positively impact the business, managing governance frameworks for best practices, and enabling analytics and data exploration efforts across the company. You will also work closely with process owners, product owners, and business users in a hybrid environment with in-house and cloud data sources. **Key Responsibilities:** - Actively contribute to cost optimization of visualization platforms and services. - Manage and scale Azure-based visualizat...

As a Senior Azure Developer at our company, you will be a key player in designing, developing, and implementing robust and scalable data solutions on the Microsoft Azure platform. Your responsibilities will include: - Designing and implementing highly performant data ingestion pipelines from various sources using Azure Databricks, Azure Data Factory, and other Azure services. - Translating complex business requirements into technical specifications and robust data solutions. - Contributing to the architectural design of data platforms and solutions on Azure. You will also be involved in: - Developing, testing, and deploying data transformation and processing jobs primarily using PySpark and ...

As a Data Engineer working with multiple teams, you will be responsible for delivering solutions on the Azure Cloud using core cloud data warehouse tools such as Azure Data Factory, Azure Databricks, Azure SQL DW, and other Big Data related technologies. Your role involves building the next generation of application data platforms and/or enhancing recent implementations. It is crucial to note that this position focuses on data engineering from the application side, requiring the ability to analyze data and devise strategies for populating data lakes. Complex coding tasks using U-SQL, Scala or Python, and T-SQL may also be required. **Responsibilities:** - Work collaboratively to develop Clou...

Hiring: Azure Data Engineers (Contract Role) Location: Bangalore / Kochi / Gurugram (Hybrid) Contract Duration: 6 to 12 Months (Based on Project Requirements) Open Positions: 2 Job Title: Developer / Sr. Azure Data Engineer Interview Rounds: 23 (Based on Managers Evaluation) Primary Skillset (Mandatory): Azure Databricks Azure Data Factory (ADF) PySpark Advanced SQL Role: Sr. Azure Data Engineer Key Responsibilities: Design, develop, and optimize scalable data pipelines using ADF and PySpark Build and maintain robust ETL/ELT workflows across structured and semi-structured data sources Write efficient, production-grade SQL queries for data transformation, validation, and reporting Collaborate...

Job role & responsibilities:- Understanding operational needs by collaborating with specialized teams Supporting key business operations. This involves architecture designing, building and deploying data systems, pipelines etc Build and support scalable and cost efficiency solution using multiple data services. Support on analysing data pipelines utilizing Azure data stack capabilities Close coordination with Command Centre which performs BAU monitoring and L1 Support Deep dive of failed pipelines to formulate root cause analysis, L2/L3 support Coordinate with Development team on analysis of incidents Technical skills, Qualification and experience required:- 5-7 years of experience in Azure ...

REQUIRED SKILLS: Bachelor's degree in Computer Science, Engineering, or a related field. Advanced degree preferred. Proven 6-8 years experience in designing, implementing solutions on the Azure ecosystem including expertise in Azure services such as Azure Data Factory, Azure Databricks, Azure Machine Learning, Azure Data Lake Storage, and Azure SQL Database, Azure Synapse, PowerBI etc... Experience with big data technologies such as Apache Spark, Hadoop, or similar frameworks. Solid understanding of cloud computing concepts and experience with cloud infrastructure management and provisioning. Solid understanding of network security concepts and technologies (such as firewalls, VPNs, intrusio...

Role: Data Architect Experience: 8-15 years Location: Bangalore, Chennai, Gurgaon, Pune, and Kolkata Work Mode: Hybrid Mandatory Skills: Python, Pyspark, SQL, ETL, Pipelines, Azure Databricks, Azure Data Factory, & Architect Designing. Primary Roles and Responsibilities: Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analytics space Collaborate with DW/BI leads to understand new ETL pipeline development requirements. Triage issues to find gaps in existing pipelines and fix the issues Work with business to understand the need in reporting layer and develop data model to fulfill rep...

Role: Data Architect Experience: 8-15 years Location: Bangalore, Chennai, Gurgaon, Pune, and Kolkata Work Mode: Hybrid Mandatory Skills: Python, Pyspark, SQL, ETL, Pipelines, Azure Databricks, Azure Data Factory, & Architect Designing. Primary Roles and Responsibilities: Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analytics space Collaborate with DW/BI leads to understand new ETL pipeline development requirements. Triage issues to find gaps in existing pipelines and fix the issues Work with business to understand the need in reporting layer and develop data model to fulfill rep...

Role: Data Architect Experience: 8-15 years Location: Bangalore, Chennai, Gurgaon, Pune, and Kolkata Work Mode: Hybrid Mandatory Skills: Python, Pyspark, SQL, ETL, Pipelines, Azure Databricks, Azure Data Factory, & Architect Designing. Primary Roles and Responsibilities: Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analytics space Collaborate with DW/BI leads to understand new ETL pipeline development requirements. Triage issues to find gaps in existing pipelines and fix the issues Work with business to understand the need in reporting layer and develop data model to fulfill rep...

Responsibilities: Design, develop, and maintain scalable data solutions using Azure Data Factory, Databricks, PySpark, Python, and SQL . Optimize pipelines, ensure data quality, and enable insights with Microsoft Fabric.

Minimum 6+ years of experience in the fundamental technology work of architecting / designing / building / managing / Optimizing the core frameworks for our cloud-based system platforms and end-to-end solutions. Responsible for optimization of cloud infrastructure, including Databricks , ADLS, Blob, VMs etc., Conduct Proof-of-Concept activities in support of advanced use cases. Must have architectural focus for ensuring availability, reliability and scalability are necessary Responsible for documenting the technical solutions Administer and manage Azure Databricks workspaces, clusters, and jobs with a focus on maximizing efficiency and performance. Implement and manage Unity Catalog to provi...

Design and build robust data pipelines and ETL processes for efficient data integration. Collaborate with data scientists and analysts to optimize data workflows. Implement and maintain database architecture to support scalable solutions. Monitor and troubleshoot data systems to ensure reliability and performance. Stay updated on the latest advancements in big data technologies. Proficiency in programming languages like Python, SQL, and tools like Hadoop or Spark is essential. Data Engineer Role 2 : Power bI -Intermediate Pyspark /Python ADF ADB Azure fundamentals NP:0-30 days Exp : 6 years + Loc : Pune (Kharadi) Required Skills PowerBI, Python, Azure ADF, Azure Databricks

Design, develop, and implement scalable and reliable data solutions on the Microsoft Azure platform. Collaborate with cross-functional teams to gather and analyze data requirements. Design and implement data ingestion pipelines to collect data from various sources, ensuring data integrity and reliability. Perform data integration and transformation activities, ensuring data quality and consistency. Implement data storage and retrieval mechanisms, utilizing Azure services such as Azure SQL Database, Azure Data Lake, and Azure Blob Storage. Monitor data pipelines and troubleshoot issues to ensure smooth data flow and availability. Implement data quality measures and data governance practices t...

Role & responsibilities 10+ years of IT experience 5+ years of experience in developing data engineering solutions on Azure Good understanding of cloud services related to Data on Azure Hands-on experience in building data ingestion, data quality, real-time and batch processes with SQLs, Azure Data Factory, PySpark Experience on the platforms like Synapse, Databricks, Snowflake Experience in working on projects related to migration to cloud, data lake/lake house development Very Good communication skills Data Engineering related certification on Azure

Role & responsibilities 10+ years of IT experience 5+ years of experience in developing data engineering solutions on Azure Good understanding of cloud services related to Data on Azure Hands-on experience in building data ingestion, data quality, real-time and batch processes with SQLs, Azure Data Factory, PySpark Experience on the platforms like Synapse, Databricks, Snowflake Experience in working on projects related to migration to cloud, data lake/lake house development Very Good communication skills Data Engineering related certification on Azure

Must have 10+ years of IT experience 5+ years of experience in developing data engineering solutions on Azure Good understanding of cloud services related to Data on Azure Hands-on experience in building data ingestion, data quality, real-time and batch processes with SQLs, Azure Data Factory, PySpark Experience on the platforms like Synapse, Databricks, Snowflake Experience in working on projects related to migration to cloud, data lake/lake house development Very Good communication skills Data Engineering related certification on Azure Good to have Understanding of other cloud services of AWS, GCP Experience in data modeling for data warehouses PoC execution experience in Microsoft Fabric ...

Role & responsibilities 10+ years of IT experience 5+ years of experience in developing data engineering solutions on Azure Good understanding of cloud services related to Data on Azure Hands-on experience in building data ingestion, data quality, real-time and batch processes with SQLs, Azure Data Factory, PySpark Experience on the platforms like Synapse, Databricks, Snowflake Experience in working on projects related to migration to cloud, data lake/lake house development Very Good communication skills Data Engineering related certification on Azure

Must have 10+ years of IT experience 5+ years of experience in developing data engineering solutions on Azure Good understanding of cloud services related to Data on Azure Hands-on experience in building data ingestion, data quality, real-time and batch processes with SQLs, Azure Data Factory, PySpark Experience on the platforms like Synapse, Databricks, Snowflake Experience in working on projects related to migration to cloud, data lake/lake house development Very Good communication skills Data Engineering related certification on Azure Good to have Understanding of other cloud services of AWS, GCP Experience in data modeling for data warehouses PoC execution experience in Microsoft Fabric ...

We are hiring a Python Fullstack Developer with 8–15 yrs of experience in Python, Azure, and JavaScript. The role involves building scalable cloud apps, APIs, and data workflows with a strong focus on Azure services and integration. Required Candidate profile Experienced Python Fullstack Developer skilled in Python, Azure, and JavaScript with strong expertise in APIs, SQL, and microservices. Hands-on Databricks and cloud-native development is a plus.

We're Hiring: Data Architect Azure Databricks + Power BI Location: Pan India (Hybrid) Experience: 15 23 Years Notice period : Immediate to 30 days serving About the Role We are looking for a seasoned Data Architect with deep expertise in Azure, Databricks, and Power BI to lead the design and implementation of scalable, secure, and innovative data solutions. This is a high-impact, leadership-level opportunity for professionals with a strong understanding of cloud-native data architecture, governance, and visualization best practices. Key Responsibilities Architect and design end-to-end data solutions on Azure for data warehousing and big data use cases. Lead cloud data platform strategy, arch...

We're Hiring: Data Architect Azure Databricks + Power BI Location: Pan India (Hybrid) Experience: 15 23 Years Notice period : Immediate to 30 days serving About the Role We are looking for a seasoned Data Architect with deep expertise in Azure, Databricks, and Power BI to lead the design and implementation of scalable, secure, and innovative data solutions. This is a high-impact, leadership-level opportunity for professionals with a strong understanding of cloud-native data architecture, governance, and visualization best practices. Key Responsibilities Architect and design end-to-end data solutions on Azure for data warehousing and big data use cases. Lead cloud data platform strategy, arch...

We're Hiring: Data Architect Azure Databricks + Power BI Location: Pan India (Hybrid) Experience: 15 23 Years Notice period : Immediate to 30 days serving About the Role We are looking for a seasoned Data Architect with deep expertise in Azure, Databricks, and Power BI to lead the design and implementation of scalable, secure, and innovative data solutions. This is a high-impact, leadership-level opportunity for professionals with a strong understanding of cloud-native data architecture, governance, and visualization best practices. Key Responsibilities Architect and design end-to-end data solutions on Azure for data warehousing and big data use cases. Lead cloud data platform strategy, arch...

We are looking for a skilled Lead Data Engineer with 10-15 years of experience to lead our team in designing, implementing, and optimizing scalable data solutions using Azure data services. The ideal candidate will have a strong background in data engineering best practices, data modeling, and ETL processes. Roles and Responsibility Lead and mentor a team of Azure Data Engineers, providing technical guidance and support. Design, implement, and optimize scalable data solutions using Azure data services such as Azure Databricks, Azure Data Factory, Azure SQL Database, and Azure Synapse Analytics. Ensure data engineering best practices and data governance are followed. Collaborate with cross-fu...