3649 Azure Databricks Jobs - Page 3

Job Summary: We are seeking a talented Data Engineer with strong expertise in Databricks, specifically in Unity Catalog, PySpark, and SQL, to join our data team. Youll play a key role in building secure, scalable data pipelines and implementing robust data governance strategies using Unity Catalog. Key Responsibilities: Design and implement ETL/ELT pipelines using Databricks and PySpark. Work with Unity Catalog to manage data governance, access controls, lineage, and auditing across data assets. Develop high-performance SQL queries and optimize Spark jobs. Collaborate with data scientists, analysts, and business stakeholders to understand data needs. Ensure data quality and compliance across...

Role: Senior Data Engineer (Azure Cloud) Experience Level: 3 + Years Work location: Mumbai, Bangalore & Trivandrum Notice Perid: Only 0-30 days NP Role & Responsibilities: Support the planning and implementation of data flow design, provide sizing and configuration assistance. Assisting the Solution Architects on programs for transformations and modernizations of data solutions using Azure cloud data technologies. Write production quality code to deploy ML workflows in a distributed environment. Design and Build Azure Data Pipelines and Data StreamsDesign and build a hybrid data solution using a combination of on-premise and in-cloud services. Diagnose and troubleshoot complex distributed sy...

Key Skills: Team Management, Data Engineering, Azure Databricks, Big Data Roles and Responsibilities: Lead and mentor a team of engineers to deliver reliable, scalable, and high-quality data solutions. Define the vision and strategy for data platform scalability, availability, and performance. Collaborate with cross-functional teams to ensure alignment of data initiatives with business goals. Establish and enforce best practices for data governance, security, and compliance. Drive innovation and continuous improvement by evaluating and adopting emerging technologies. Monitor and analyze platform metrics to identify and implement enhancements. Ensure seamless integration of new data sources a...

Job Role - Azure Data Engineer (Developer + Support) Location - Airoli, Navi Mumbai Note - The candidate will work mainly on Support (70%) and Development (30%). Job Purpose - To work as Data Engineering / Data Platform Support for Data lake house project. Establish an understanding of the business, develop a deep understanding of business needs, and build and shape delivery plans. Prepare and deliver presentations and facilitate decisions among senior stakeholders. Represent the role in line with the Banks culture, ensuring full transparency, auditability and value for money objectives are met/upheld. Understand data requirements projects of various internal department and regulators i.e. R...

Data engineering with a focus on data migration ,Azure Data Factory Exp in Python/PySpark for data manipulation and automation. Experience with Azure DevOps for CI/CD Skills ADB, ADF, Deltalake/Datalake and Pyspark, Data Modelling Unity Catalog

Greetings from Aspire Systems!! We would like to give an opportunity again for your super talent. Aspire Systems is a global technology services firm serving as a trusted technology partner for our customers. We work with some of the world's most innovative enterprises and independent software vendors, helping them leverage technology and outsourcing in our specific areas of expertise. Our services include Product Engineering, Enterprise Solutions, Independent Testing Services and IT Infrastructure Support services. (https://www.aspiresys.com/) Our core philosophy of "Attention. Always." communicates our belief in lavishing care and attention on our customers and employees we appreciate your...

Skill: Azure Data Engineer Experience : 4-8 years Note: Looking for Immediate Joiners Only (0-15 days) Job Location: Hyderabad - Full Time Work Mode: In Office Interview Date and Time: 7th Nov'25 (Friday) & 10:00 AM IST to 4:00 PM IST Interview Mode: Face to Face Interview (In-Person) Job Description: Experience in Azure cloud platforms like Advanced Python Programming, Databricks, Azure SQL , Data factory (ADF), Data Lake, Data storage, SSIS. Create and deploy scalable ETL/ELT pipelines with Azure Databricks by utilizing PySpark and SQL. Create Delta Lake tables with ACID transactions and schema evolution to support real-time and batch processing. Experience in Unity Catalog for centralized...

Job Title : Senior-Level Data Engineer Healthcare Domain Location: Remote Option Experience: 5+ Years Employment Type: Full-Time About the Role We are looking for a Senior Data Engineer with extensive experience in healthcare data ecosystems and Databricks-based pipelines . The ideal candidate brings deep technical expertise in building large-scale data platforms, optimizing performance, and ensuring compliance with healthcare data standards (e.g., HIPAA, EDI, HCC). This role requires the ability to lead data initiatives, mentor junior engineers, and work cross-functionally with product, analytics, and compliance teams. Key Responsibilities Architect, develop, and manage large-scale, secure,...

Responsibilities: Align Sigmoid with key Client initiatives Interface daily with customers across leading Fortune 500 companies to understand strategic requirements Connect with VP and Director level clients on a regular basis. Travel to client locations Ability to understand business requirements and tie them to technology solutions Facilitate in Technical Aspects Design, develop and evolve highly scalable and fault-tolerant distributed components using Big data technologies. Excellent experience in Application development and support, integration development and data management. Provide technical leadership and manage it day to day basis Guiding developers in day to day design and coding t...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Azure Data Factory, Spark notebooks, SQL, and Python. This includes data ingestion, data transformation, and data loading processes.Azure Data Analytics Service (Azure Data Factory – ADF, Data Lake, Azure Synapse, Azure SQL, and Databricks)

Job Opening: Azure Data Factory / Active Directory Engineer Location: Noida, Uttar Pradesh Experience: 6 to 12 Years Budget: Up to 9 LPA Interview Type: Face-to-Face (1 Round Only) Interview Date: 10th November 2025 Venue: FCWP+P84, Sector 144, Noida, Uttar Pradesh 201306 Job Description We are looking for a skilled Azure Data Factory / Active Directory Engineer with strong expertise in Microsoft ecosystem administration, Azure integration, and enterprise infrastructure management. Key Responsibilities & Skills: Proficient in Active Directory domain trust creation and troubleshooting. Creation and management of directory infrastructure , including FSMO roles , trusts , Kerberos , KDCs , and ...

Job Location: Hyderabad, Indore and Ahmedabad (India) What You Will Do: Following are high level responsibilities that you will play but not limited to: Lead the design, development, and implementation of modern data pipelines, data models, and ETL/ELT processes. Architect and optimize data lake and warehouse solutions using Microsoft Fabric, Databricks, or Snowflake. Enable business analytics and self-service reporting through Power BI and other visualization tools. Collaborate with data scientists, analysts, and business users to deliver reliable and high-performance data solutions. Implement and enforce best practices for data governance, data quality, and security. Mentor and guide junio...

Job Title: Azure Data Engineer Experience: 5-8 years Location: Bangalore, Hyderabad, or Pune Job Description: We're looking for an experienced Azure Data Engineer to design, develop, and optimize data pipelines and architectures on Azure. The ideal candidate will have expertise in Azure Data Factory, Databricks, and Synapse Analytics, with a strong background in data engineering and analytics. Key Responsibilities: Design, develop, and optimize data pipelines using Azure Data Factory and Databricks. Develop workflows in Azure Databricks, enhancing large-scale data transformations. Implement monitoring, error-handling, and data validation processes. Collaborate with stakeholders to gather req...

Key Responsibilities Design, develop, and maintain end-to-end data pipelines using Azure Data Factory (ADF) , Databricks , Synapse Analytics , and related Azure services. Implement ETL/ELT processes to integrate data from multiple structured and unstructured data sources. Build and optimize data lake and data warehouse solutions in Azure Data Lake Storage (ADLS) and Azure Synapse . Collaborate with data scientists, analysts, and business stakeholders to deliver scalable data solutions. Develop CI/CD pipelines for data workflows using Azure DevOps or equivalent tools. Implement data governance, quality, and security best practices following enterprise standards. Monitor, troubleshoot, and opt...

Responsibilities: Design Azure data solutions using ADF, ADLS, Synapse & DW. Optimize performance through Azure Analytics & Analysis Services. Collaborate with cross-functional teams on project delivery.

Key Skills: Adb, Azure Databricks, Azure, Python, Spark Roles and Responsibilities: Develop and maintain data processing systems using Azure Databricks and other Big Data technologies. Lead the design and implementation of scalable data solutions, ensuring high performance and reliability. Collaborate with cross-functional teams to integrate data from various sources, including RDBMS and NoSQL databases. Utilize Apache Spark for data processing and performance tuning of Spark jobs. Implement stream-processing systems using technologies such as Apache Storm or Spark-Streaming. Manage messaging systems like Kafka or RabbitMQ for efficient data flow. Conduct performance tuning and optimization ...

Who are we looking for? Innovators with 6 to 18 years of experience and expertise in: Azure Databricks Pyspark Python Azure Data factory Synapse Must Have: • 10+ Years of IT experience in Datawarehouse and ETL • Hands-on data experience on Cloud Technologies on Azure, ADF, Synapse, Pyspark/Python • Ability to understand Design, Source to target mapping (STTM) and create specifications documents • Flexibility to operate from client office locations • Able to mentor and guide junior resources, as needed Nice to Have: • Any relevant certifications • Banking experience on RISK & Regulatory OR Commercial OR Credit Cards/Retail" Important points: Relevant experience should be 5 yrs minimum into Da...

Job Details Roles & Responsibilities Roles and Responsibilities: Minimum 8 years of solid experience with: Understanding of Azure environment/infrastructure Azure/devops configuration Azure Data Factory Azure Functions Azure Logic Apps Power Apps(Good to Have) SQL .NET Power Automate (Microsoft Flow) Gateway Configurations Manual Code Deployment in Azure Familiarity with monitoring Azure environments and resolving issues Job Description Critical Skills to Possess: Minimum 8 years of solid experience with: Understanding of Azure environment/infrastructure Azure/devops configuration Azure Data Factory Azure Functions Azure Logic Apps Power Apps(Good to Have) SQL .NET Power Automate (Microsoft ...

Greetings from LTIMindtree! Hope you are doing well. We are hiring for below positions and conducting only F2F Drive in Chennai/Kolkata locations on 08th-Nov-2025(Saturday). Kindly ignore this email if previously interviewed with LTIMindtree and got selected for further rounds or any rejections happened since 3 months. If interested to apply, please fill the below mandatory apply link and share your updated resume at putta.madhavi@ltimindtree.com without fail. Applications are considered if below form is filled via link (mandatory) https://forms.office.com/r/Q504BMgnxU Open Positions for Chennai/Kolkata based-(5-12 Years): Azure Data Engineer AWS Data Engineer GCP Data Engineer Power BI Snow...

Job Summary: We are seeking a skilled and detail-oriented Big Data Engineer with over 5 years of IT experience, including at least 3 years specializing in Big Data application development using the Hadoop ecosystem and Cloud platforms (AWS/Azure) . The ideal candidate will have strong expertise in PySpark , ETL pipeline development , data integration , and workflow orchestration to build scalable and efficient data solutions. Key Responsibilities: Design, develop, and optimize Big Data pipelines using PySpark , Hive , Sqoop , and Spark SQL . Implement ETL processes for ingesting, transforming, and loading large-scale structured and unstructured data from diverse sources (JSON, Parquet, Avro,...

Skill: Azure Data Engineer Experience : 4-8 years Note: Looking for Immediate Joiners Only (0-15 days) Job Location: Hyderabad - Full Time Work Mode: In Office Job Description: Experience in Azure cloud platforms like Advanced Python Programming, Databricks, Azure SQL , Data factory (ADF), Data Lake, Data storage, SSIS. Create and deploy scalable ETL/ELT pipelines with Azure Databricks by utilizing PySpark and SQL. Create Delta Lake tables with ACID transactions and schema evolution to support real-time and batch processing. Experience in Unity Catalog for centralized data governance, access control, and data lineage tracking. Mandatory Qualifications: 4-8 years of experience as a Data Engin...

Role & responsibilities : minimum 4 yrs. of relevant hands-on experience in any of the two or more Azure Services like: DataLake, ADB, ADF, ADLS, Functions, Azure Synapse, Azure Cosmos DB, Azure DB for PostgreSQL, AKS, Azure DevOps etc Experience into Pyspark; Mastery of DataFrame APIs and Spark SQL - Performance tuning: broadcast joins, caching strategies, shuffle reduction - Handling skewed data and optimizing wide transformations - Writing scalable, testable PySpark code with modular design Good knowledge into Data BRicks; Cluster sizing, autoscaling, and spot instance optimization - Job orchestration using Workflows with retries, alerts, and dependencies - Delta Lake: - OPTIMIZE with Z-O...

About the team: AIML is usedto create chatbots, virtual assistants, and other forms of artificial intelligence software. AIML is also used in research and development of natural language processing systems. What you can look forward to as a AI/ML expert Lead Development : Own endtoend design, implementation, deployment and maintenance of both traditional ML and Generative AI solutions (e.g., finetuning LLMs, RAG pipelines) Project Execution & Delivery : Translate business requirements into datadriven and GenAIdriven use cases; scope features, estimates, and timelines Technical Leadership & Mentorship : Mentor, review and coach junior/midlevel engineers on best practices in ML, MLOps and GenA...

Data Architect (8+ years in data architecture) Job Summary: We are seeking a skilled Data Architect to lead the design and delivery of innovative, scalable data solutions that power our business. With deep expertise in Databricks and cloud platforms like Azure and AWS, you will architect high-performance data systems and drive impactful analytics. If you thrive on solving complex data challenges, this is your chance to shine. Key Responsibilities: Design scalable data lakes, warehouses, and real-time streaming architectures. Build and optimize data pipelines and Delta Lake solutions using Databricks (Spark, Workflows, SQL Analytics). Develop cloud-native data platforms on Azure (Synapse, Dat...