3706 Adf Jobs - Page 8

Role & responsibilities Job description: in Python, SQL, ADF, Databricks ( PySpark, DLT, Unity Catalog, Performance Tuning, Cost Optimization ) along with leadership(self driven, responsible, accountable, Ownership and soft skill (communication, good mindset and behavioural attitude Databricks Associate or professional Certification. Preferred candidate profile

Job Title Senior Test Engineer As an ETL And Power BI Tester specializing in Azure Data Factory(ADF), Python, and Pytest will be responsible for ensuring the accuracy, integrity, and performance of ETL Pipelines deployed into Azure cloud environments. Role will involve developing and automating comprehensive test cases to validate the data flows, transformations, and system behaviours using python scripting and Pytest framework, integrated into CI/CD pipelines for Automated quality assurance. Roles and Responsibilities: 1. Design and develop and execute manual and automated test cases for Azure Data Factory ETL pipelines using python and pytest. 2. Validate the data transformations, data map...

Job Description: Python, SQL, ADF, Databricks ( PySpark, DLT, Unity Catalog, Performance Tuning, Cost Optimization ) along with leadership(self Databricks Associate or professional Certification.

Job Description: Functioning as an Application Support for the new Cloud platform at one of the corporate investment bank. Support the applications hosted on Azure/Databricks and facilitate onboarding of application to the Cloud platform. Provide incident, problem, and event management according to the ITIL framework. Drive the team to fulfil targets regarding problem management, incident management and meet agreed SLA's. Drive incident, request, work driver and alert reduction efforts across an application cluster. Face-off to and develop effective working relationships with internal Data Operations, Development, and Infrastructure teams. Challenge the status quo and work to improve the sup...

Company Profile: We’re Hiring at CGI for our GCC - Right Here in Hyderabad! Join us at the intersection of technology, finance, and innovation. You will be working to support the PNC Financial Services Group, one of the top-tier financial institutions in the U.S. You’ll help shape digital solutions for a global enterprise—from the ground up. This is more than a job. It’s your opportunity to: Work on cutting-edge technologies Collaborate with global teams Build a career with purpose and impact Ready to build the future of banking? Let’s talk. Job Title: Lead Analyst - Lead Bigdata Developer with Python, PySpark & SQL Position Title: Lead Analyst - Lead Bigdata Developer with Python, PySpark &...

Position: Azure Data Engineer – Microsoft Fabric Experience: 6+ years Location: Remote Job Summary: We are looking for an experienced Azure Data Engineer with strong expertise in Microsoft Fabric and the Azure data ecosystem. The ideal candidate will design, build, and optimize scalable data solutions, enabling advanced analytics and business insights across the enterprise. Key Responsibilities: Design and develop data pipelines and ETL workflows using Azure Data Factory, Synapse, and Fabric. Implement and manage data lakehouse architectures on Microsoft Fabric. Integrate diverse data sources (structured and unstructured) into Azure storage and analytics solutions. Ensure data quality, gover...

5 - 7 Years 1 Opening Trivandrum Role description Role Proficiency: Act creatively to develop applications and select appropriate technical options optimizing application development maintenance and performance by employing design patterns and reusing proven solutions account for others' developmental activities Outcomes: Interpret the application/feature/component design to develop the same in accordance with specifications. Code debug test document and communicate product/component/feature development stages. Validate results with user representatives; integrates and commissions the overall solution Select appropriate technical options for development such as reusing improving or reconfigu...

Job Description: Job description Skills Azure Data Factory ADF Developer Engineer Nice to Have Skills Python or Java SQL ETL Hadoop Azure certification Technical Professional requirements Experience in Azure stack Azure Data Lake Azure Data Factory Good understanding of other Azure services like Azure Data Lake Analytics U SQL Azure SQL DW and Azure Synapse Sql Experience in Building and Designing cloud applications using Microsoft Azure cloud technologies Strong understanding on Azure Data Services including ADF ADLS Blob Data Bricks Polybase with a background of Hive Python Spark Strong working knowledge of SQL Server SQL Azure Database No SQL Data Modeling Azure AD ADFS Identity Access Ma...

Data engineer What We’re Building – And Why You Should Care GDA is Maersk’s bold leap into the future of data and AI. It’s not just a platform-it’s a transformation of how the world’s largest integrated logistics company turns its operational data into strategic intelligence. Think: real-time insights on vessel ETA and carbon emissions, metadata-driven supply chain automation, and retrieval-augmented copilots that advise planners and operators. Our data engineers don’t just build pipelines-they shape the very foundation that powers AI-native logistics. As a data engineer in the GDA-FBM team, you’ll help modernize and operationalize Maersk’s global data estate. You’ll craft reusable, observab...

Role & responsibilities You should have worked on Dimensional modelling for 5yrs You should have worked on Data Architect AND Data Modelling AND Schema Overall 8+ years experience is required. You should have worked on Schema Modelling

Software Engineer The Software Engineering team delivers next-generation application enhancements and new products for a changing world. Working at the cutting edge, we design and develop software for platforms, peripherals, applications and diagnostics — all with the most advanced technologies, tools, software engineering methodologies and the collaboration of internal and external partners. Join us to do the best work of your career and make a profound social impact as a Software Engineer on our Software Engineering Team in Bangalore . As a Software Engineer 1, you will be responsible for developing sophisticated Data solutions and systems based on the customer’s business goals, needs and ...

Key Responsibilities Design, develop, and maintain scalable data pipelines using PySpark and Azure Data Factory. Work closely with business stakeholders, analysts, and data scientists to understand data requirements and deliver reliable solutions. Optimize ETL workflows for performance, scalability, and reliability. Implement best practices for data ingestion, transformation, and integration across multiple sources. Ensure data quality, governance, and security across the data lifecycle. Troubleshoot and resolve issues related to data pipelines, storage, and performance. Required Skills & Qualifications 7+ years of total experience, with 3+ years relevant in PySpark, Azure Data Factory, and ...

Required Skills & Experience 5–7 years of experience in data engineering, with at least 2–3 years of Databricks hands-on experience. Strong expertise in Apache Spark (PySpark/Scala/SQL) and distributed data processing. Solid experience with Delta Lake, Lakehouse architecture, and data modeling. Hands-on experience with at least one cloud platform: Azure Data Lake, AWS S3, or GCP BigQuery/Storage. Strong proficiency in SQL for data manipulation and performance tuning. Experience with ETL frameworks, workflow orchestration tools (Airflow, ADF, DBX Workflows). Good understanding of CI/CD, Git-based workflows, and DevOps practices. Exposure to MLOps and MLflow is a strong plus. Knowledge of data...

Job Title: Senior Azure Data Engineer Experience: 9–12 Years Location: Noida Job Description We are looking for a Senior Azure Data Engineer with extensive experience in building and optimizing large-scale data pipelines and architectures using the Microsoft Azure ecosystem . The ideal candidate should have deep hands-on expertise in Azure Data Factory (ADF) , Azure Databricks , and Unity Catalog , along with a strong understanding of data governance, security, and performance optimization . The role involves designing scalable, reliable, and secure data platforms that enable data-driven decision-making across the enterprise. Key Responsibilities Design and implement end-to-end data pipeline...

End-to-End Data Engineering We’re looking for a hands-on Cloud Data Engineer who’s an expert in Python, PySpark, and SQL — with proven experience building end-to-end data pipelines on Azure using Data Factory, Synapse, and Databricks . This role blends strong technical skills with sharp business understanding — ideal for someone who loves solving problems, designing scalable data solutions, and working closely with business teams. Key Responsibilities: End-to-End Data Engineering Build and optimize data pipelines and ETL processes using ADF, Synapse, and Databricks . Develop high-performance data transformations using Python, PySpark, and Advanced SQL . Design and implement Lakehouse / Medal...

Description Key Responsibilities : Data Architecture & Design: Lead the design and implementation of highly scalable and fault-tolerant data pipelines using modern platforms such as Azure Synapse, Snowflake, or Databricks workflows. Pipeline Development: Develop, construct, test, and maintain robust data architectures, ensuring optimal data flow and ingestion from diverse sources. Cloud Data Platform Expertise: Leverage expertise in the Azure Data Platform components, including Azure Data Factory (ADF) for orchestration, Azure Data Lake (ADLS) for storage, and Azure SQL Database for operational data storage. Coding & Scripting: Apply strong proficiency in Python or Scala to develop complex d...

Senior JAVA Full Stack Engineer NEOGOV , an HRIS Product company based in Los Angeles is the market and technology leader in human resources software for the public sector. Our HR suite empowers public sector HR to streamline processes in a centralized platform. We are looking for seasoned Senior Java Full Stack Engineers for FULL-TIME and REMOTE opportunities for our India Team. What you’ll be doing: Work with the development teams to produce rich enterprise class SaaS applications. Develop and maintain applications utilizing JAVA development tools. Work directly with the product management team to help determine and solve customer needs for our products. Ensure efficiency improvement utili...

Role Description Role Proficiency: Act creatively to develop applications and select appropriate technical options optimizing application development maintenance and performance by employing design patterns and reusing proven solutions account for others' developmental activities Outcomes Interpret the application/feature/component design to develop the same in accordance with specifications. Code debug test document and communicate product/component/feature development stages. Validate results with user representatives; integrates and commissions the overall solution Select appropriate technical options for development such as reusing improving or reconfiguration of existing components or c...

Role : Application Support / Lead (Cloud Azure/ Databricks) Location : Chennai Must have : Azure and Databricks Job Description: Functioning as an Application Support for the new Cloud platform at one of the corporate investment bank. Support the applications hosted on Azure/Databricks and facilitate onboarding of application to the Cloud platform. Provide incident, problem, and event management according to the ITIL framework. Drive the team to fulfil targets regarding problem management, incident management and meet agreed SLA's. Drive incident, request, work driver and alert reduction efforts across an application cluster. Face-off to and develop effective working relationships with inter...

Job Title: Azure Data Engineer Experience: 7 – 10 years Location : Noida Budget: Up to ₹25 LPA Employment Type: Full-Time Role Overview: We are seeking an experienced Azure Data Engineer responsible for designing, implementing, and optimizing cloud-based data pipelines and architectures using Azure Data Factory (ADF), Synapse Analytics, and ADLS. The candidate will collaborate closely with analytics and data science teams to build end-to-end business intelligence (BI) solutions, mentor junior developers, and ensure data quality, performance, and compliance across large-scale environments. Key Responsibilities: Collaborate with business analytics and data science teams to gather requirements ...

Senior Data Engineer What We’re Building – And Why You Should Care GDA is Maersk’s bold leap into the future of data and AI. It’s not just a platform-it’s a transformation of how the world’s largest integrated logistics company turns its operational data into strategic intelligence. Think: real-time insights on vessel ETA and carbon emissions, metadata-driven supply chain automation, and retrieval-augmented copilots that advise planners and operators. Our data engineers don’t just build pipelines-they shape the very foundation that powers AI-native logistics. As a data engineer in the GDA-FBM team, you’ll help modernize and operationalize Maersk’s global data estate. You’ll craft reusable, o...

Job Title: ETL QA Tester (Automation) Experience: 4–8 Years Location: Hyderabad Type: Full-time Job Summary: Looking for an experienced ETL QA Tester with strong knowledge of ETL testing, SQL, data validation, and automation. The role involves validating end-to-end data flows, ensuring data accuracy, and building automation for ETL processes. Key Responsibilities: Perform ETL and data warehouse testing (source → staging → target). Develop and execute test cases, data validation, and automation scripts. Write complex SQL queries for data comparison and verification. Work with ETL tools (Informatica, Talend, SSIS, ADF, etc.) and cloud platforms (Snowflake, Databricks, Azure). Collaborate with ...

Position: Azure Data Engineer – Microsoft Fabric Experience: 6+ years Location: Remote Job Summary: We are looking for an experienced Azure Data Engineer with strong expertise in Microsoft Fabric and the Azure data ecosystem. The ideal candidate will design, build, and optimize scalable data solutions, enabling advanced analytics and business insights across the enterprise. Key Responsibilities: Design and develop data pipelines and ETL workflows using Azure Data Factory, Synapse, and Fabric. Implement and manage data lakehouse architectures on Microsoft Fabric. Integrate diverse data sources (structured and unstructured) into Azure storage and analytics solutions. Ensure data quality, gover...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the mo...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the mo...