2403 Azure Databricks Jobs - Page 8

Capgemini Invent Capgemini Invent is the digital innovation, consulting and transformation brand of the Capgemini Group, a global business line that combines market leading expertise in strategy, technology, data science and creative design, to help CxOs envision and build whats next for their businesses. Your Role Proficiency in MS Fabric,Azure Data Factory, Azure Synapse Analytics, Azure Databricks Extensive knowledge of MS Fabriccomponents: Lakehouses, OneLake, Data Pipelines, Real-Time Analytics, Power BI Integration, Semantic Model. Integrate Fabric capabilities for seamless data flow, governance, and collaborationacross teams. Strong understanding of Delta Lake, Parquet, and distribute...

Your Role As a senior software engineer with Capgemini, you will have 6 + years of experience in Azure Fabric technology with strong project track record In this role you will play a key role in Strong customer orientation, decision making, problem solving, communication and presentation skills Very good judgement skills and ability to shape compelling solutions and solve unstructured problems with assumptions Very good collaboration skills and ability to interact with multi-cultural and multi-functional teams spread across geographies Strong executive presence and entrepreneurial spirit Superb leadership and team building skills with ability to build consensus and achieve goals through coll...

Your Role IT experience with a minimum of 5+ years of experience in creating data warehouses, data lakes, ETL/ELT, data pipelines on cloud. Has data pipeline implementation experience with any of these cloud providers - AWS, Azure, GCP. preferably - Life Sciences Domain Experience with cloud storage, cloud database, cloud Data ware housing and Data Lake solutions like Snowflake, Big query, AWS Redshift, ADLS, S3. Experience with cloud storage, cloud database, cloud Data ware housing and Data Lake solutions like Snowflake, Big query, AWS Redshift, ADLS, S3. Experience in using cloud data integration services for structured, semi structured and unstructured data such as Azure Databricks, Azure...

We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar frameworks. - Design, implement, and manage data warehouse solutions, schema evolution, and data versioning. - Collaborate with cross-functional teams to deliver high-quality data solutions. Req...

We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar frameworks. - Design, implement, and manage data warehouse solutions, schema evolution, and data versioning. - Collaborate with cross-functional teams to deliver high-quality data solutions. Req...

8+ years of experience in ETL with minimum of 3+ years of experience in PySpark/Spark SQL Strong SQL skills with experience in Azure SQL & Synapse Strong Skill in developing Synapse Notebooks , Azure Data Bricks Experience in ETL (SAS/Informatica/ADF Data flows) Experience implementing Synapse Pipelines/Dataflows Use the interactive Synapse/Databricks notebook environment using SQL, Examine external data sets, Query existing data sets using SQL ETL transformations and Loads using Synapse Notebooks/ Azure Databricks to apply built-in functions to manipulate data, Perform an ETL job on a streaming data source, Parameterize a code base and manage task dependencies, Submit and monitor jobs using...

7 to 10 + years of IT experience in Data and Analytics 5+ years of experience in Azure Data Lake, Azure Data Factory, Azure Data Bricks ,Azure Synapse Analytics, Azure Storage Explorer Hands-on experience on Azure functions & Azure synapse is must Should have project experience in Azure Data Lake / Blob (Storage purpose) Sound knowledge in Data Bricks & Logic Apps Proficient in creating Data Factory pipelines for on-cloud ETL processing; copy activity, custom Azure development etc. Strong working knowledge of SQL and the ability to write, debug and optimize queries. Knowledge of cloud stack (Azure) for cloud-based components of the process. Experience in some of the cloud-based capabilities:...

Location: Pan India Experience:8+ years Role & responsibilities: Azure Data engineer Strong background in data engineering, experience with Azure data services, and the ability to transform raw data into valuable business insights. Proficiency in Azure data services such as Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, and Azure Databricks. Strong knowledge of programming languages like SQL, Python, or Scala. Experience with big data processing frameworks (e.g., Apache Spark). Familiarity with relational and NoSQL databases (e.g., SQL Server, Cosmos DB). Knowledge of data modelling, schema design, and ETL/ELT processes.

Role & responsibilities AIML Engineer: CREQ227058 Must have aiml,azure databricks &mlflow Preferred candidate profile AI/ML Tools and packages using Databrick Models. Exposure to Healthcare data projects and MLOps tools Responsible for migrating existing machine learning models and pipelines to a new platform or environment, ensuring continuity and performance Analyse the current ML architecture, data sources, and dependencies to plan and execute a seamless migration strategy Refactor and optimize code, retrain models if necessary, and validate outputs to ensure consistency with original use case Familiar with MLOps (Docker, MLFlow, deployment of ML endpoint and App Service)

Experience Level: Consultant: 5+ Years Relevant Experience Associate Manager: 6+ Years Relevant Experience Manager: 7+ Years Relevant Experience Notice Period: Immediate to 30 Days (Preferred) Job Summary: We are seeking a skilled Azure Data Engineer to join our growing data team. The ideal candidate will have hands-on experience with Azure Data Factory, Databricks, PySpark, and SQL, and will contribute to designing and implementing scalable, secure, and high-performance data solutions on Microsoft Azure. Key Responsibilities: Design, develop, and manage data pipelines using Azure Data Factory (ADF) and Databricks. Implement and optimize data transformation using PySpark within Azure Databri...

Job Position : Azure Data Engineer Skills: ADF, PySpark, SQL, Azure-Synapse, Data Bricks Location: Bengaluru Responsibilities 5 years of experience in leading the design and development of data and analytics projects in a global company. Experience in working for projects across-functional teams, building sustainable processes and coordinating release schedules. MS SQL experience with data modeling • Experience in working with Microsoft Azure and strong knowledge about ADLS, Blob Storage, Data Factory, SQL Server and Warehouses. Experience in Cloud based EDW platforms (Snowflake, Synapse, Redshift, Big Query etc) • Build and launch new data models that provide intuitive analytics for the ana...

Job Title: Senior Data Engineer Azure Databricks Experience: 7+ Years Location: Navi Mumbai (On-site) Job Overview: We are looking for a highly skilled Senior Data Engineer with expertise in Azure Databricks, big data technologies, and cloud-based data architectures. The ideal candidate will have hands-on experience building scalable data pipelines and platforms for high-volume batch and real-time processing, preferably in the manufacturing or energy sector. Key Responsibilities: • Design and implement robust data pipelines using Azure Databricks, Spark, and other Azure data services. • Collaborate with architects, data scientists, and business teams to understand requirements and translate ...

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, ...

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, ...

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, ...

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, ...

Key Roles & Responsibilities Design, build, and maintain data pipelines on Azure using Data Factory, Synapse, and Databricks. Develop and optimize ETL/ELT processes for structured and unstructured data. Implement and manage data models, data lakes, and data warehouses. Hands-on experience in Snowflake and Databricks. Build dashboards and reports using Power BI / Azure Analytics services. Should have hands-on knowledge to manage Row Level Security in Power BI. Ensure data quality, governance, and security compliance. Collaborate with data scientists, analysts, and business teams to enable data-driven insights. Required Skills 3+ years of experience in data engineering and analytics. Strong kn...

About Client Hiring for One of the Most Prestigious Multinational Corporations Job Title : Azure Data Engineer Qualification : Any Graduate or Above Experience : 4 to 8 Yrs Location : Chennai , Bangalore Key Responsibilities: Design and build scalable and robust data pipelines using Azure Databricks, PySpark, and Spark SQL. Integrate data from various structured and unstructured data sources using Azure Data Factory, ADLS, Azure Synapse,etc. Develop and maintain ETL/ELT processes for ingestion, transformation, and storage of data. Collaborate with data scientists, analysts, and other engineers to deliver data products and solutions. Monitor, troubleshoot, and optimize existing pipelines for ...

Job Summary We are seeking a skilled Azure Data Engineer with 4 years of overall experience , including at least 2 years of hands-on experience with Azure Databricks (Must) . The ideal candidate will have strong expertise in building and maintaining scalable data pipelines and working across cloud-based data platforms. Key Responsibilities Design, develop, and optimize large-scale data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse. Implement data lake solutions and work with structured and unstructured datasets in Azure Data Lake Storage (ADLS). Collaborate with data scientists, analysts, and engineering teams to design and deliver end-to-end data solutions. Develop...

Job Summary We are seeking a skilled Azure Data Engineer with 4 years of overall experience , including at least 2 years of hands-on experience with Azure Databricks (Must) . The ideal candidate will have strong expertise in building and maintaining scalable data pipelines and working across cloud-based data platforms. Key Responsibilities Design, develop, and optimize large-scale data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse. Implement data lake solutions and work with structured and unstructured datasets in Azure Data Lake Storage (ADLS). Collaborate with data scientists, analysts, and engineering teams to design and deliver end-to-end data solutions. Develop...

About Client Hiring for One of the Most Prestigious Multinational Corporations Job Title : Azure Databricks Qualification : Any Graduate or Above Experience : 4 to 8 Yrs Location : Chennai , Bangalore Key Responsibilities: Design and build scalable and robust data pipelines using Azure Databricks, PySpark, and Spark SQL. Integrate data from various structured and unstructured data sources using Azure Data Factory, ADLS, Azure Synapse,etc. Develop and maintain ETL/ELT processes for ingestion, transformation, and storage of data. Collaborate with data scientists, analysts, and other engineers to deliver data products and solutions. Monitor, troubleshoot, and optimize existing pipelines for per...

About Client Hiring for One of the Most Prestigious Multinational Corporations Job Title : Azure Databricks Qualification : Any Graduate or Above Experience : 4 to 8 Yrs Location : Chennai , Bangalore Key Responsibilities: Design and build scalable and robust data pipelines using Azure Databricks, PySpark, and Spark SQL. Integrate data from various structured and unstructured data sources using Azure Data Factory, ADLS, Azure Synapse,etc. Develop and maintain ETL/ELT processes for ingestion, transformation, and storage of data. Collaborate with data scientists, analysts, and other engineers to deliver data products and solutions. Monitor, troubleshoot, and optimize existing pipelines for per...

We are looking for an Azure DevOps / Infrastructure Engineer to design, build, and maintain data ops processes and support warehouse infrastructure on Microsoft Azure. You will be responsible for implementing DevOps best practices, automating deployments, and supporting a modern data ecosystem that leverages Azure Data Factory, Azure Databricks, Azure Functions and other elements from MS tech stack. Key Responsibilities Develop and maintain release pipelines in for data engineering and ML workflows. (Azure DevOps) Automate infrastructure deployment supporting data warehouse processes. (Terraform) Manage repository structures, branching strategies, and release management. (Azure DevOps, GIT) ...

This is a contract position, requires working in US CST time zone as an extended member of the US team. Client is URUS/VAS. We are seeking a detail-oriented and results-driven Project Manager to lead projects within our Data Platform organization, with a strong focus on Databricks implementations . The ideal candidate will have experience managing end-to-end delivery of cloud-based data platforms and collaborating cross-functionally across data engineering, analytics, DevOps, and business stakeholders. Key Responsibilities: • Lead and manage full lifecycle projects related to data platform initiatives, especially Databricks-based solutions across AWS or Azure. • Develop and maintain project ...

As an Azure Data Engineer, you will play a crucial role in optimizing and redesigning data pipelines to support the modernization of the data platform. Your responsibilities will include: - Designing and building scalable and reliable data pipelines using the latest tech stack. - Facilitating real-life actionable use cases by leveraging data with a user- and product-oriented mindset. - Assisting teams without data engineers in building decentralized data solutions and product integrations. - Conceptualizing, designing, and implementing improvements to ETL processes and data through independent communication with data-savvy stakeholders. - Designing, building, and operating a Data Lake or Dat...