3649 Azure Databricks Jobs - Page 5

Experienced Azure Data Engineer Tech Lead ( Tech Lead ) with 7 to 10 years of expertise Design, develop, and maintain robust data pipelines using Azure Databricks, Azure Data Factory,Pyspark / Python, Azure Data Lake Gen2, and Azure SQL Database. Integrate and manage data from various source systems, ensuring data quality and consistency. Mandatory Skills :Azure Databrick + Pyspark + Azure Data Facory + SQL +CICD + Strong Coding skills.

Technical Skills:(Primary) Overall, 6 8 yrs experience, with relevant experience on Azure Databricks for 4+ yrs Primary Technologies:Azure Databricks, spark, python Database Technologies:SQL, MS SQL Server, Relational Databases Experience in conducting Code Reviews for offshore team members Strong experience on ETL concepts Areas on Primary Skills Good understanding of databricks as a platform to write and execute notebooks. Should be able to create Databricks workflows and schedule them with dependencies Understands delta table as a concept and versioning to update/delete/merge the existing dataset and for DML operations Good knowledge of Spark framework, its internals and its distributed p...

Description: We are seeking a highly skilled and experienced Azure Platform Engineer to lead the design, implement and maintain azure data platform. The ideal candidate will have a deep understanding of Azure data services such as Azure Databricks, ADF, ADLS Gen2, Azure SQL, Azure Synapse, Azure VMs, Azure App Services, Azure Functions. Youll collaborate with cross-functional teams to ensure the scalability, reliability, and performance of our analytics and data solutions. Must have solid experience in terraform based provisioning, Building automations and reports using Pyspark, Powershell and Python Roles Responsibilities:Experience on Schema, delta/parquet tables on UC, Spark configuration...

Databriks + Pyspark About The Role ::1 Skill:Databriks + Pyspark Exp 5 to 8 yr Location Any PSL , Bangalore, Delhi, Pune , Chennai Dont look for Hyderabad Location Azure Data bricks,PySpark,Oracle PL SQL,ETL,SQL,Data Integration Data Engineer - Data AnalystSummaryStrategically manages and maintains corporate global clinical data for all major business units, while ensuring data quality and integrity. Provides system support, testing, and training for applications accessing clinical data.Proven 2-5 years work experience as a Data Analyst in Clinical data Identifies, investigates, and resolves data quality issues, communicating with business units and IT and performing root cause analysis as n...

RoleAdvanced Data Engineer , LocationHyderabad Hire TypeFulltime Tech Stack: Proficiency in Python, SQL, Databricks, Snowflake Data Modeling, ETL process, Apache Spark and PySpark, data integration and workflow orchestration, real time data processing experience/frameworks, Cloud experience (Azure preferred) About The Role Minimum 5 years of experience in Data Engineering role that involves Analyzing, organizing raw data, and building data systems & pipelines in Cloud Platform [Azure] Experienced in migrating data from on-prem to cloud-based solution architectures [Azure] Extensive experience with Python, Spark and SQL Experience in developing ETL processes. Proficient with Azure Data Lake, ...

Description Responsibilities Perform testing in Databricks environment which includes Participating in developing Test frameworks. Participating in testing scripts development, code reviews Partner with the product owner, data engineers, data architects and analysts to create scalable and robust solutions. Prepare the status report of testing activities and share updates with the team during Scrum meeting. Experience using appropriate test management tool like Azure DevOps Competencies / Required Skills: ETL Testing experience of 7+ years Report Testing experience of 2+ years, preferably PowerBI Hands on experience of 3+ years working in Databricks/ADLS environment. Good at Python/Pyspark sc...

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities Requirements: Experience in Databricks, SQL, PySpark, Spark, Python, and Azure Data Factory (ADF). Experience in designing, developing, and maintaining data pipelines and data streams. Experience in moving/transforming data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark. Experience in working with stakeholders to understand their data needs and provide solutions. Experience in collaborating with other teams to ensure data quality and consistency. Experience in developing and maintaining data models and data dictionaries. Experience in developing and maintaining ETL proces...

Shift: 24x7 Shift Job Requirement: Primary Skills Azure Data Factory, Azure Synapse Analytics, Azure Databricks: Extensive experience in building and managing scalable data pipelines for data integration, transformation, and analysis.Azure Data Lake Storage, Azure SQL Database: Proven ability to manage and optimize data storage solutions, ensuring data accessibility and reliability. Azure Machine Learning: Expertise in developing, training, and deploying machine learning models using Azure's machine learning tools and services. Data Warehousing & Data Modeling: Strong experience with designing and maintaining data warehouses, with deep understanding of ETL processes and data models. Programm...

Responsibilities: Job Accountabilities - Hands on Experience in Azure Data Architecture design and Implementation - Data Lake and Data Warehouse Understanding - Pursuit Knowledge - End to end BI Landscape knowledge - Lead Role experience - Good Communication Skill - Understanding of Data Security and Data Compliance - Agile Understanding - Certification (Good to have) - Domain Knowledge of Different Industry Sector Mandatory skill sets: Azure DE, ADB, ADF, ADL, Technology Architecture Preferred skill sets:Azure DE, ADB, ADF, ADL, Technology Architecture Years of experience required: 9 to 11 years

Responsibilities: Job Accountabilities - Hands on Experience in Azure Data Components like ADF / Databricks / Azure SQL - Good Programming Logic Sense in SQL - Good PySpark knowledge for Azure Data Bricks - Data Lake and Data Warehouse Concept Understanding - Unit and Integration testing understanding - Good communication skill to express thoghts and interact with business users - Understanding of Data Security and Data Compliance - Agile Model Understanding - Project Documentation Understanding - Certification (Good to have) - Domain Knowledge Mandatory skill sets:Azure DE, ADB, ADF, ADL Preferred skill sets:Azure DE, ADB, ADF, ADL

Job Location : Mumbai, Pune, Gurugram, Chennai Role: Python Fullstack Developer YOE: 8+ Yrs mandatory Mandatary - Python any framework like django flash and fastapi ,SQL, Azure cloud technology Good to have JavaScript with react framework, Knowledge of Azure services (Functions, App Service, Containers, etc.), Experience with data pipelines, data warehousing, and ETL processes Job Description: Requirements Develop highly scalable applications in Core Python. Experience working with any of the python web frameworks (Django, Flask, Fast API) Experience working on SQL with ability to run various data analytics tasks and queries. Expoure to Java script technologies (preferably React) Exposure to...

Role Proficiency: Act creatively to develop applications and select appropriate technical options optimizing application development maintenance and performance by employing design patterns and reusing proven solutions account for others' developmental activities Outcomes: Interpret the application/feature/component design to develop the same in accordance with specifications. Code debug test document and communicate product/component/feature development stages. Validate results with user representatives; integrates and commissions the overall solution Select appropriate technical options for development such as reusing improving or reconfiguration of existing components or creating own solu...

Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be skilled in ETL tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL. Works independently and has a deep understanding of data warehousing solutions including Snowflake BigQuery Lakehouse and Delta Lake. Capable of calculating costs and understanding performance issues related to data solutions. Outcomes: Act creatively to develop pipelines and applications by selecting appropriate technical options optimizing application development mainten...

Position Summary The Solutions Architect for the Data & Analytics (D&A) portfolio will lead the design, development, and governance of scalable, high-performance data solutions that empower business insights and decision-making. This role will serve as the bridge between business stakeholders, data engineers, platform teams, and enterprise architects to ensure that data-driven systems align with Prologis' technology strategy and D&A roadmap. The architect will also play a strategic role in leveraging emerging technologies such as Generative AI (GenAI) to accelerate modernization and data value realization across the enterprise. Key Responsibilities 1. Solution Architecture & Design Develop e...

TCS is conducting Weekday Virtual drive for the role of Azure Data Engineer. Years of experience: 5 to 10 yrs Location: Hyderabad Notice Period: 0 to 60 days Date of Interview: 6th Nov 2025 Time of Interview: 10 AM to 2 PM Roles & Responsibilities: Relevant experience in Pyspark and Azure Databricks. Developing, managing and optimizing robust and reliable data pipelines using azure native capabilities. Implement ADF workflows that perform data ingestion, data integration/ETL, statistical model executions etc. Creating architecture for data solutions with high performance characteristics Bringing data and analytics products to production Implement CI/CD pipelines for data solutions Build dash...

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...

As an ideal candidate for this role, you should have a Bachelors or higher degree in Computer Science or a related discipline; or equivalent with a minimum of 4+ years of work experience. Additionally, you should possess at least 1+ years of consulting or client service delivery experience on Azure Microsoft Fabric. It is essential to have 1+ years of experience in developing data ingestion, data processing, and analytical pipelines for big data, relational databases such as SQL server, and data warehouse solutions like Synapse/Azure Databricks. Your hands-on experience should include implementing data ingestion, ETL, and data processing using Azure services such as ADLS, Azure Data Factory,...

As a Profisee MDM Architect/Administrator at Cushman & Wakefield, your primary role will be to lead the implementation and governance of scalable, secure, and high-performing master data management solutions across the enterprise. Reporting directly to the Director of Data Engineering & Analytics, your responsibilities will include modernizing the data platform, guiding the adoption of emerging technologies, and ensuring alignment with organizational goals and compliance standards. **Key Responsibilities:** - Lead the architecture, implementation, and administration of Profisee MDM within a modern, cloud-native, and on-prem data ecosystem. - Design and maintain MDM data models, domains, hier...

As a Data Analytics Manager within the Spares and Warranty team at Microsoft's Cloud Supply Chain organization, your primary responsibility will be to optimize customer experience and business operations through data-driven decision making and self-serve analytics. You will lead a team of high-impact data engineers, data analysts, business analysts, and strategic customers to solve complex problems and communicate innovative solutions to stakeholders. Collaborating cross-functionally with engineering teams, product teams, and program management, you will deploy business solutions effectively. **Key Responsibilities:** - Lead the analytics function for spares supply chain, driving insights th...

As an Audit and Assurance professional at PwC, your role involves providing independent and objective assessments of financial statements, internal controls, and other assurable information to enhance credibility and reliability for various stakeholders. You will evaluate compliance with regulations, assess governance and risk management processes, and related controls to ensure the integrity of information. In the realm of data, analytics, and technology solutions, you will assist clients in developing solutions that foster trust, drive improvement, and enable risk detection, monitoring, and prediction. Your tasks will encompass utilizing advanced analytics, data wrangling technology, and a...

As an experienced Data Engineer in our team, your focus will be on enhancing and supporting existing Data & Analytics solutions by leveraging Azure Data Engineering technologies. You will be responsible for designing, developing, and supporting data pipelines and solutions using Azure data engineering services. Your role will involve implementing data flow and ETL techniques using Azure Data Factory, Databricks, and Synapse, as well as cleansing, transforming, and enriching datasets using Databricks notebooks and PySpark. Additionally, you will orchestrate and automate workflows across services and systems, collaborating with business and technical teams to deliver robust and scalable data s...

As an Azure Data Engineer, your role involves architecting, configuring, and optimizing Databricks Pipelines for large-scale data processing within an Azure Data Lakehouse environment. Your key responsibilities include: - Architect, configure, and optimize Databricks Pipelines for large-scale data processing within an Azure Data Lakehouse environment - Set up and manage Azure infrastructure components including Databricks Workspaces, AKS/ACI, Storage Accounts, and Networking - Design and implement monitoring and observability frameworks using Azure Monitor, Log Analytics, Prometheus, and Grafana - Collaborate with platform and data engineering teams to enable microservices-based architecture...

As an ML Engineer at GlobalLogic, you will play a crucial role in developing and deploying machine learning models in a professional setting. Your responsibilities will include: - Strong understanding of machine learning algorithms and techniques, including supervised, unsupervised, and reinforcement learning. - Building and deploying models using Python with Azure Data Factory (ADF), Azure Databricks, PySpark, Delta Lake, ETL/ELT, data pipelines, and data lakehouse architecture. - Proficiency in Python and relevant machine learning libraries such as scikit-learn, TensorFlow, and PyTorch. - Experience with cloud computing platforms like AWS, Azure, and GCP, as well as containerization techno...

Role & responsibilities Years of Experience: 6 to 10yrs Location: Bangalore & Hyderabad Notice Period: 0 to 60 days Date of Interview : 5th, 6th, 7th, 8th Nov, 2025 Kindly apply if there is a skill match with 6+yrs of experience. Job Description: Overall 6+ years of work experience in Data Warehouse(DWH) Development Experience in AzureDatabricks, Pyspark, Python , SQL Hands on exp in Azure data factory, data bricks Design, implement, and manage data solutions on Azure Develop and maintain data pipelines using Databricks Ensure efficient data storage and retrieval using Azure Storage and Data Lake Automate infrastructure and application deployments with Ansible Write clean, maintainable code ...

Azure Data Engineer / Technical Lead Location : Pan India, On site Department : CBG Data & Analytics Who you are : We're looking for a seasoned and hands on Azure Data Engineer for our cloud data platform. You'll be the driving force behind our Azure-based data ecosystem, taking full ownership of its architecture, design, and implementation. This role requires a leader who can define a clear vision for our data infrastructure, establish robust coding and deployment best practices, and ensure our solutions are scalable, secure, and cost-effective. If you're passionate about building state-of-the-art data solutions on Azure, this is the role for you. Key Responsibilities Architect & Design: Le...