642 Datafactory Jobs

SR DE-II Highly skilledDataEngineerwith minimum 5+ years of relevant experience in SQL, PySpark, ETL,DataLakes and Azure Tech Stack. Responsibilities 3+ years of experience in buildingdataPipelines with Python/PySpark. 4+ years of experience in Azure ETL stack ( eg. Blog Storage,DataLake,DataFactory, Synapse). 4+ years of experience with SQL. Proficient understanding of code versioning tools such as Git and PM tool like Jira. Qualifications Excellent verbal and written communication skills. UG: B.Sc in Any Specialization, BCA in Any Specialization, B.Tech/B.E. in Any Specialization. A good internet connection is a must. Azure certifications will be a bonus Interview Process: (Only Walk in) O...

Databricks Engineer (Databricks Engineer, Python, data factory, Pyspark, Azure Data Engineer, SQL, Spark,data lake, Microsoft Azure, Azure Developer)

Some careers shine brighter than others If youre looking for a career that will help you stand out, join HSBC and fulfil your potential Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further HSBC is one of the largest banking and financial services organizations in the world, with operations in 64 countries and territories We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions We are currently seeking an experienced professional to join our team in the ...

The salary grade offered in the end depends on the level of expertise of the candidate for this role You will contribute to exiting innovative business projects where value is realized using data An increasing community of data professionals is working on those projects and the Data Engineer will be part of that community We offer flexibility in the location of choice to work from as we are a truly global organization As Data Engineer you will have a level of autonomy in organizing your own work and as you will be working with different technologies, we provide opportunities to deepen and expand your knowledge by training, coaching and the variety of subjects to work on What will you do In y...

Role : Azure Data Engineer Experience : 5 to 10 Years Location : Hyderabad Notice Period : Immediate Budget : Up to 24 LPA Required Skills: Core Azure Services: Azure Data Factory (ADF) pipeline orchestration, triggers, linked services, integration runtime. Azure Databricks PySpark, Delta Lake, notebooks, job orchestration. Azure Synapse Analytics dedicated and serverless SQL pools, data modeling, query optimization. Azure Data Lake Storage (ADLS Gen2) hierarchical namespace, lifecycle management. Azure Functions / Logic Apps – event-driven data workflows. Azure Event Hubs / Kafka / Stream Analytics – real-time data ingestion. Programming & Tools: Strong in Python or Scala for data transform...

What you will do In this vital role you will as a Senior Associate IS Business Systems Analyst with strong data science and analytics expertise to join the Digital Workplace Experience (DWX) Automation & Analytics product team. In this role, you will develop, maintain, and optimize machine learning models, forecasting tools, and operational dashboards that support strategic and day-to-day decisions for global digital workplace services. This role is ideal for candidates with hands-on experience building predictive models and working with large operational datasets to uncover insights and deliver automation solutions. You will work alongside product owners, engineers, and service leads to del...

We are seeking experienced candidate for Azure data engineer, 5- 9 Years overall experience in develop, manage data pipelines using ADF and Azure data bricks. Requirements: 5-9 years experienced in Azure data engineer. Should have the ability to develop and manage data pipelines using ADF and Azure data bricks. Expert knowledge in data warehousing, data modeling and ETL. Good to have datastage exposure. Expertise in on-prem to azure cloud migration. Expertise in SQL and Pyspark. Experience in production support of ADF jobs. Excellent communication and team leading capabilities. Bachelors or Masters degree in Computer Science, Information Technology, Engineering, or a related field. Location:...

Overview: The Azure Data Engineer / Data Architect will be responsible for designing, developing, and managing scalable data solutions on Microsoft Azure. You will ensure that data is accessible, optimized for performance, and compliant with organizational and security standards. You will have hands-on expertise with Azure services, strong ETL development skills, and the ability to architect modern data platforms that support business intelligence, analytics, and advanced data science initiatives. You will operate in a Scrum/Agile environment, collaborating closely with cross-functional teams to deliver value iteratively. Core Responsibilities: •Design, build, and maintain scalable and relia...

Design, develop, deploy solutions using Microsoft Azure services Strong knowledge of Azure services (App Services, Functions, Data Factory etc) Expert in Azure SQL Database & integration with BI tools Understanding of Power Platform & its integration Required Candidate profile Microsoft Azure certifications preferred Exp with CICD pipelines & DevOps practices Ensure scalability, performance & security Work extensively with Azure SQL Database for application & BI solutions

Data Engineer with hands-on experience in Microsoft Fabric, including Data Factory, Dataflows Gen2, OneLake and security. Skilled in Python and SQL, building pipelines to ingest, transform and model data for analytics and AI use cases.

Role & responsibilities Required Skillset : Technical Lead - 7+yrs ( Databricks, GCP) Strong Hands-on experience : Databricks PySpark SQL Terraform CI-CD GCP Services - Cloud build, BigQuery, Firestore etc Airbyte (Intermediate level) Datadog (Intermediate level

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Job Title: Snowflake Lead / Lead Snowflake Data Engineer Summary We are seeking an experienced Snowflake Lead to design, build, and optimize our cloud-based data platform. The ideal candidate will have deep expertise in Snowflake architecture, data modeling, ELT/ETL pipelines, and cloud engineering best practices. This role involves technical leadership, solution design, code reviews, and collaboration with cross-functional teams to deliver scalable and high-performance data solutions. Key Responsibilities Technical Leadership Lead the end-to-end architecture, design, and implementation of Snowflake-based data solutions. Define best practices for Snowflake development, ELT patterns, security...

Responsibilities for Data Engineer Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements using Python and SQL / AWS / Snowflakes. • Identify, design, and implement internal process improvements through: automating manual processes using Python, optimizing data delivery, re-designing infrastructure for greater scalability, etc. • Build the infrastructure required for optimal extraction, transformation, and loading ofdata from a wide variety of data sources using SQL / AWS / Snowflakes technologies. • Build analytics tools that utilize the data pipeline to provide actionable insights into customer a...

Proven expertise with Lakehouse Architecture with Delta Tables – Delta tables, Schema Evolution.Strong expertise in fundamental areas like Spark ecosystems, Data frame API & Spark SQL Python,SQL,Workflows,Unity Catalog, Lakeflow,Lakehouse Federation

Role - Azure Data Factory /Microsoft Fabric Location - Hyderabad Exp - 4 to 6 Yrs JD Design and implement end-to-end data solutions using Azure Synapse and Microsoft Fabric. Develop and optimize data pipelines, dataflows, and ELT/ETL processes using Data Factory, Synapse Pipelines, and Fabric Data Factory. Build and maintain Lakehouse and Data Warehouse architectures in Fabric and ADLS. Implement Synapse components including Dedicated SQL Pools, Serverless SQL Pools, Spark Pools, and Pipelines. Manage data ingestion from various sources (API, SQL, SaaS apps, On-Prem) into Data Lake and Fabric Lakehouse. Create and optimize Notebooks (PySpark/SQL) and warehouse queries for performance and cos...

Design and implement Azure-based data solutions using Databricks, Data Factory, Synapse Analytics, and Data Lake services. Develop data pipelines, APIs, and orchestration frameworks for seamless data ingestion, transformation, and delivery. Establish and maintain data governance, metadata, and lineage frameworks using Databricks Unity Catalog and Azure Purview. Build and maintain ETL/ELT frameworks, data APIs, and real-time workflows connecting diverse HR and enterprise systems. Leverage AI and ML capabilities within Databricks to build intelligent data agents for automation, monitoring, and analytics enrichment. Apply best practices for performance optimization, scalability, and cost effici...

Job Title: Data Engineer - Azure Stack We are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and cloud-based solutions to support our business intelligence and analytics initiatives. You will work in a hybrid cloud environment to manage data services, ensuring high scalability, security, and performance for data-driven decision-making. Key Responsibilities: Data Engineering: Design and implement scalable data pipelines, ETL workflows, and processing frameworks within Azure Stack and hybrid cloud environments. Cloud Archite...

Roles and Responsibilities Design, develop, and maintain large-scale data pipelines using Azure Databricks, Delta Live Table, and Data Factory. Troubleshoot issues related to data quality, performance tuning, and scalability in a distributed computing environment. Desired Candidate Profile 4-6 years of experience in designing and developing large-scale data pipelines using Azure Databricks, Delta Live Table, or similar technologies. Strong understanding of PySpark programming language for working with big data sets. Proficiency in writing efficient SQL queries for extracting insights from relational databases (e.g., Oracle). Experience with building ETL processes using Azure Data Factory (AD...

Role: Azure Iaas Engineer Experience: 7+years Location: Bangalore(WFO) Shift - 6am est to 3pm Est Notice Period: Immediate Joiner and Serving Notice are only preferred Role & responsibilities Primary: Azure IaaS administration Secondary: Data factory, Linux

Ready to build the future with AI? At Genpact, we dont just keep up with technology—we set the pace. AI and digital innovation are redefining industries, and we’re leading the charge. Genpact’s AI Gigafactory, our industry first accelerator, is an example of how we’re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies’ most complex challenges. If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what’s possible, this is your moment. Genpact (NYSE: ...

Join phData, a dynamic and innovative leader in the modern data stack. We partner with major cloud data platforms like Snowflake, AWS, Azure, GCP, Fivetran, Pinecone, Glean and dbt to deliver cutting-edge services and solutions. We're committed to helping global enterprises overcome their toughest data challenges. phData is a remote-first global company with employees based in the United States, Latin America and India. We celebrate the culture of each of our team members and foster a community of technological curiosity, ownership and trust. Even though we're growing extremely fast, we maintain a casual, exciting work environment. We hire top performers and allow you the autonomy to deliver...

Responsibilities: * Design, develop, and maintain Azure Databricks solutions using DataFactory, DataBricks, PySpark, and SQL.

Required Experience: - 5 to 8 years of experience in Databricks - Level of experience in Databricks: E4 (Expert highest level) - Strong hands-on coding experience in Python with PySpark framework (Level 4 proficiency) - Experience working across multiple functional domains such as Finance, HR, Geology, HSE, etc. Technical Skills: - Expert-level in Databricks - Strong Python coding skills - Adequate Power BI knowledge Soft Skills: - Curiosity toward new technologies and willingness to update knowledge frequently - Curiosity and interest in understanding complex HR business cases - Transparency in communication (e.g., openly sharing blockers with the team) - Strong critical thinking and proble...

Role & responsibilities We are seeking an experienced Data Engineer to design, build, and optimize data pipelines and solutions on modern big data platforms. The ideal candidate will have strong expertise in PySpark , Databricks , and distributed data processing frameworks, with a passion for delivering scalable and efficient data solutions. Key Responsibilities Design, develop, and maintain ETL pipelines using PySpark and Databricks . Work with large-scale datasets to ensure data quality, integrity, and availability. Optimize data workflows for performance and cost efficiency in cloud environments (Azure/AWS/GCP). Collaborate with data scientists, analysts, and business teams to deliver rel...