2403 Azure Databricks Jobs

Locations: Pune, Maharashtra, India Minimum Experience: 6 Maximum Experience: 12 ctc 6-8 -22 lac 8+ -30 lac max Skill Set: Databricks Engineer, Azure Databricks, SQL, Skill to Evaluate: Databricks Engineer, Azure Databricks, SQL,Pyspark, Data warehousing, ADF Experience: 5 to 12 Years Location: Pune, Maharashtra, India Job Description: Job Title: Senior Data Engineer Key Responsibilities: - Design, build, and maintain scalable data pipelines and ETL processes. - Collaborate with data scientists and analysts to understand data needs and provide support for their analytics requirements. - Develop and implement data models, database designs, and data management solutions. - Ensure data quality,...

**Job Description:** As a Python Azure Data Factory (ADF) professional, your role involves working with technologies such as Azure Databricks, PySpark, Delta Lake, ETL/ELT, data pipelines, and data lakehouse architecture. **Key Responsibilities:** - **Technical Delivery:** - Develop robust ETL/ELT workflows using Informatica to ingest, transform, and load data into our data warehouse, Azure Synapse Analytics. - Conduct exploratory data analysis (EDA) to validate pipeline outputs and ensure data accuracy. - Ensure data quality by implementing proactive checks and monitoring mechanisms. - Write and optimize complex SQL queries to support analytical and reporting team requirements. - Collaborat...

We are looking for a seasoned Senior Data Engineer with strong expertise in ETL/ELT , data modeling , and cloud-based data platforms . The ideal candidate will design and maintain scalable data pipelines, ensure data quality and compliance, and support analytics through robust engineering practices. Key Responsibilities: Design and implement ETL/ELT pipelines using tools like IICS, Informatica, StreamSets, DBT, ADF, Python, Databricks, SSIS Work with Snowflake for cloud data warehousing Operate within Azure cloud environments Model data for data warehouses, lakes, and hubs Apply data standardization, conformance, and transformation techniques Ensure compliance with SOX and SOC-2 standards Im...

Inviting applications for the role of Principal Consultant, Azure Data Engineer Responsibilities Strong knowledge in building Pipelines in Azure Data Factory or Azure Synapse Analytics. Knowledge in Azure Data Bricks and Azure Synapse Analytics for ingesting data through different sources Good at writing SQL Queries on SQL Database and SQL DWH. Knowledge in design, development, testing, implementation of Azure Data Stack technologies. Expert level knowledge of Azure Data Lake , SQL DB & Data warehouse. Should be able to do perform querying in SQL Database and SQL DWH. Knowledge of Azure Data Lake is required. Should be strong in either Python or Scala Programming Languages. Experience in var...

Proven experience as a Data Solutions Architect or in a similar role. Strong expertise in Azure cloud services (Data Factory, Synapse, Databricks, Cosmos DB, etc.). Data modeling, data integration data governance, security, and frameworks. Health insurance Annual bonus

Were Hiring Azure Data Engineer (Manager / Senior Associate) Location: Bangalore (Hybrid) & Hyderabad Notice Period: Immediate Joiners / up to 30 days Experience Level: 4 to 12 Years Must-Have Skills: Azure Databricks (Advanced) Data Factory PySpark Python Key Requirements: Minimum 4 years of relevant experience Strong expertise in: SQLDB (writing complex stored procedures) Synapse Azure Analysis Services Mandatory Certifications: DP-203 (Azure Data Engineer Associate) Databricks Certified Data Engineer Professional (Architect / Managerial level) Strong troubleshooting and debugging skills Hands-on experience with GIT / Azure DevOps, build & release pipelines Proven ability to write complex ...

Dear Candidate, Greetings from Buzzworks! We are hiring Azure Databricks Engineer for one of our Tier 1 MNC across locations. Role: Azure Databricks Engineer Exp: 5+ yrs Location: Chennai, Bangalore, Coimbatore Note: We are looking for resources who are available on immediate notice and available for to take up Virtual Interview on 22nd Sep. JD: Key Responsibilities: Develop and optimize data pipelines using Azure Databricks , Delta Lake , and Python Design and implement ETL/ELT processes for large-scale data processing Work with Azure Data Lake , Azure Data Factory , and Spark Perform data cleansing, transformation, and validation Collaborate with data scientists and business teams to deliv...

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. At YASH, were a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future. We are looking forward to hireMicrosoft Fabric Professionals in the following areas : Experience 4-6 Years Job Description Experience in Azure Fabric, Azure Data factory, Azure Databricks, Azure Synaps...

Role & responsibilities Must-Have Skills: Azure Databricks (Advanced) Data Factory PySpark Python Preferred candidate profile Minimum 4 years of relevant experience Strong expertise in: SQLDB (writing complex stored procedures) Synapse Azure Analysis Services Mandatory Certifications: DP-203 (Azure Data Engineer Associate) Databricks Certified Data Engineer Professional (Architect / Managerial level) Strong troubleshooting and debugging skills Hands-on experience with GIT / Azure DevOps, build & release pipelines Proven ability to write complex PySpark queries for data analysis Open Roles: Senior Associate / Manager

Dear Candidate, This is with reference for Opportunity for Azure Fabric professional PFB the JD Experience in data architecture, data engineering, and cloud platform modernization. Azure data implementations involving on-prem to cloud migration and end-to-end solution delivery. Expertise in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, ADLS Gen2, Azure SQL DB, and Blob Storage. Batch processing solutions that use Data Factory and Azure Databricks Proficiency in Python, SQL, or Scala for scalable transformation and data engineering. Strong command of Apache Spark (Pyspark or Spark SQL) and Delta Lake for big data pipelines. Must - Architectural experience with Microsoft Fabri...

We are looking forward to hireMicrosoft Fabric Professionals in the following areas : Job Description Experience in Azure Fabric, Azure Data factory, Azure Databricks, Azure Synapse, Azure Storage Services, Azure SQL, ETL, Azure Cosmos DB, Event HUB, Azure Data Catalog, Azure Functions, Azure Purview Create Pipelines, datasets, dataflows, Integration runtimes and monitoring Pipelines and trigger runs Extract Transformation and Load Data from source system and processing the data in Azure Databricks Prepare DB Design Documents for the user story based on the client requirement Work with the development team to create database structure, queries and used triggers Extensive experience in Micros...

We are looking forward to hireMicrosoft Fabric Professionals in the following areas : Job Description Experience in Azure Fabric, Azure Data factory, Azure Databricks, Azure Synapse, Azure SQL, ETL Create Pipelines, datasets, dataflows, Integration runtimes and monitoring Pipelines and trigger runs Extract Transformation and Load Data from source system and processing the data in Azure Databricks Create SQL scripts to perform complex queries Create Synapse pipelines to migrate data from Gen2 to Azure SQL Data Migration pipeline to Azure cloud (Azure SQL). Database migration from on-prem SQL server to Azure Dev Environment by using Azure DMS and Data Migration Assistant Experience in using az...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform, Microsoft Azure Databricks, PySpark Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements. Your typical day will involve creating innovative solutions to address various business needs and collaborating with team members to ensure succe...

Key Responsibilities: • Design, develop, and maintain ETL pipelines using Azure Databricks notebooks and workflows. • Perform big data processing and analytics using Spark on the Databricks platform. • Write optimized and efficient code using PySpark, SparkSQL, and Python. • Implement and enhance data transformation and integration pipelines. • Manage secrets and credentials securely using Key Vault and Databricks secret scopes • Write and debug complex SQL queries (preferably PL/SQL and Spark SQL) for data retrieval and analysis. • Troubleshoot and resolve issues related to Python, PySpark, and SQL. • Collaborate with cross-functional teams to understand data requirements and deliver soluti...

Role: Azure Data Engineer Experience: 6+ years Location: Greater Noida, Gurugram & Bangalore Notice Period: Immediate to 45 days Skills Required: Azure Databricks, Python, Pyspark, SQL, ADF. Please share your CV's on anurag.1.b@coforge.com

Dear Candidate Greetings from TATA Consultancy Services Job Openings at TCS Skill - Data Engineer ( Azure DataBricks, Pyspark) Exp range 4 yrs – 6 yrs Location- Kolkata, Pune, Mumbai, Bangalore, Bhubaneshwar Notice period – 30-60 Pls find the Job Description below. 5+ yrs. Development experience with Spark (PySpark), Python and SQL. Extensive knowledge building data pipelines Hands on experience with Databricks Strong experience with Git. Strong experience developing on Linux OS. Experience with scheduling and orchestration (e.g. airflow, prefect, dagster, control-m).. Required skills: Azure DataBricks, Pyspark If you are Interested in the above opportunity kindly share your updated resume t...

Roles and Responsibilities Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure storage solutions such as Azure Blob Storage. Collaborate with cross-functional teams to understand business requirements and design scalable data architectures that meet those needs. Develop complex SQL queries to optimize database performance and troubleshoot issues in Azure Databricks. Implement machine learning models using Azure Synapse Analytics for real-time analytics processing. Ensure high availability of critical systems by implementing monitoring tools like Azure Monitoring. Desired Candidate Profile...

Role Overview: We are seeking a Data Engineer to support the design, development, and implementation of our Data Observability & Monitoring solution. The engineer will build data pipelines to capture metrics from Azure Monitor, Databricks, Purview, and other APIs, and integrate them into Delta Lake for reporting via Power BI/React dashboards. Responsibilities: Develop and maintain scalable data pipelines using Databricks (PySpark, Delta Lake). Integrate data from multiple APIs (Azure Monitor, Azure Cost Management, Log Analytics, Purview). Implement ETL/ELT processes for structured/unstructured data. Ensure data quality, reliability, and observability throughout the pipeline. Optimize pipeli...

Develop and deploy machine learning models on Azure cloud platform using Python programming language and Azure ML services. Design and implement scalable and efficient data pipelines for model training and inference. Collaborate with data scientists and business stakeholders to understand requirements and translate them into technical solutions. Implement best practices for ML development, including version control, testing, and documentation. Develop and maintain APIs on Azure cloud platform for model deployment and integration with applications. Monitor and optimize model performance, ensuring scalability, reliability, and security. Participate in code reviews, troubleshooting, and optimiz...

Your Role Design, develop, and deploy .NET applications on Microsoft Azure. Build AI-driven applications using Azure AI services (e.g., Azure Machine Learning, Cognitive Services, OpenAI). Develop and test AI/ML models and integrate them into business applications. Prepare and optimize datasets for training and inference. Implement full-stack solutions using .NET (C#) for backend and React/Angular for frontend. Manage Azure resources to ensure scalability, security, and performance. Collaborate with data scientists, engineers, and stakeholders to identify AI opportunities. Monitor and troubleshoot application performance and AI model accuracy. Maintain technical documentation and participate...

Job Role - Data Platform Engineer Location - Navi Mumbai / Bangalore / Noida & Gurugram Key Skills : Experienced technology engineer with a minimum of 3+ years of data tools implementation and data platform handling experience with deep technology expertise Understanding of Lakehouse and delta lake architecture Having knowledge of ETL/ELT and data warehouse concepts Experience to SNOW to raise change as part of change management process Should handle technology obsolescence, baseline, platform related audit etc Raising TCO for cloud infra Responsible of new integration to the data platform Closure of platform vulnerabilities and responsible of the security as per Banks standard Understanding...

We are looking forward to hireAzure Databricks Professionals in the following areas : Job description: Role: Interoperability Architect (FHIR / HL7 V2/V3) Role Overview: Client is seeking a Interoperability Architect (contractor) to lead the design and solutioning of a next-generation Interoperability Reference Architecture The architect will play a pivotal role in ensuring compliance with evolving CMS interoperability mandates such as 9115-F and 0057-P , while laying the foundation for FHIR-based data exchange across payer and provider ecosystems. Key Responsibilities: Lead the solution architecture for a comprehensive Interoperability Gold Architecture , supporting payer interoperability, ...

We are looking forward to hireAzure Data Factory (ADF) Professionals in the following areas : Design and build complex data pipelines and dataflows using Azure Data Factory. Integrate ADF with Azure SQL Database, and Databricks. Develop custom ETL processes using Python, and SQL. Document architecture, data flows, and transformation logic. Conduct impact assessments and provide high-level design based on business requirements. Monitor and optimize performance of data pipelines. Ensure security and compliance in data orchestration processes. Collaborate with cross-functional teams to ensure alignment with business goals. Mentor junior developers and contribute to architectural improvements. R...

We are looking forward to hireMicrosoft Azure Professionals in the following areas : Experience 6-8 Years Job Description 1.Experience in Azure, Azure Data factory, Azure Databricks, PySpark , Azure Storage Services, Azure SQL, ETL, Azure Cosmos DB, Event HUB, Azure Data Catalog, Azure Functions, Azure Purview 2. Create Pipelines, datasets, dataflows, Integration runtimes and monitoring Pipelines and trigger runs 3. Extract Transformation and Load Data from source system and processing the data in Azure Databricks 4. Prepare DB Design Documents for the user story based on the client requirement 5. Work with the development team to create database structure, queries and used triggers 6. Exten...

Job Description- Lead Data Engineer Why would you like to join us? TransOrg Analytics specializes in Data Science, Data Engineering and Generative AI, providing advanced analytics solutions to industry leaders and Fortune 500 companies across India, US, APAC and the Middle East. We leverage data science to streamline, optimize, and accelerate our clients' businesses. Visit at www.transorg.com to know more about us. Position Summary: Build a centralized data system/warehouse for unifying data, improving data integration, and enhancing reporting and business intelligence capabilities. Education & Experience Requirements Bachelors degree in data science, computer science, or IT-related fields w...