243 Data Factory Jobs - Page 3

Key Responsibilities:• Design, develop, and maintain ETL/ELT pipelines for large-scale structured and unstructured data.• Build and optimize data models, data lakes, and warehouses using modern cloud platforms (AWS/Azure/GCP).• Collaborate with data scientists to operationalize ML models and automate model training and deployment (MLOps).• Implement data quality, validation, and monitoring frameworks to ensure reliable pipelines.• Develop feature stores and real-time data streaming solutions for AI/ML use cases.• Work with business and product teams to understand data requirements and translate them into scalable engineering solutions.• Use AI/ML techniques to enhance data enrichment, predic...

As an Azure Data Platform Lead at Codvo, you will play a crucial role in leading the design, implementation, and optimization of enterprise-scale Azure data platform solutions. Your responsibilities will include: - Designing and implementing scalable data platform architectures using Azure services such as Synapse, Data Factory, Fabric, and SQL Database - Establishing data lakehouse and data warehouse solutions with medallion architecture patterns - Defining data governance frameworks, security protocols, and compliance standards - Leading platform evaluations, vendor selections, and technology roadmap planning Additionally, you will be responsible for: - Architecting data ingestion pipeline...

About Position: We are seeking a highly skilled and experienced Platform Engineer to join our Team. The ideal candidate will bring deep expertise in cloud-based data engineering, healthcare data modeling, and consulting, with a strong background in Azure, Databricks, Azure Data Factory (ADF), SQL, and Platform engineering. Role: Platform Engineer Location: All Persistent Locations Experience: 8 to 10 Years Job Type: Full Time Employment What You'll Do: Design, implement, and manage Cloud Data Platform infrastructure for Azure Data Factory (ADF), Self-hosted Integration Runtime (SHIR), Logic Apps, Azure Data Lake Storage Gen2 (ADLS Gen2), and Blob Storage. Configure and optimize Snowflake dat...

About Position: We're seeking an experienced Snowflake Data Engineer to join our team. As a Azure Data Engineer, you will be responsible for designing, building, and maintaining large-scale data warehouses and data pipelines using Snowflake, SQL, and other related technologies. Role: Sr. Azure Data Engineer Location: All Persistent Locations Experience: 8 to 10 Years Job Type: Full Time Employment What You'll Do: Design and implement data warehouses and data pipelines using Snowflake. Develop and maintain SQL scripts, stored procedures, and data models. Optimize data warehouse performance, scalability, and security. Collaborate with data analysts and data scientists to support data-driven de...

Position:- Cloud Data Architect (Azure & AWS) Technology- Cloud Data Architect, Azure, AWS AWS Glue, S3, Redshift, and EMR, Data Factory, Data Lake, Synapse, and Databricks Experience 10+ years Work Location - Navi Mumbai Job Description Deep expertise in Azure and AWS data ecosystems to lead end-to- end solutioning covering data ingestion, transformation, governance, security, and analytics platform design Solution Architecture & Delivery Design, architect, and implement modern cloud-native data platforms on Azure and AWS tailored to client needs Build data lakehouse solutions using Azure Synapse, Databricks, AWS Redshift, Glue, EMR, and Delta Lake Lead the development of ETL/ELT pipelines ...

Role Overview: You will be responsible for designing and building data pipelines, Lakehouse architectures (BronzeSilverGold), and semantic models in Microsoft Fabric. Your role will involve developing data ingestion and transformation workflows using Data Factory, Dataflows Gen2, SQL, and PySpark. Additionally, you will integrate Fabric with Power BI for analytics and reporting, ensuring data quality, governance, and performance optimization. It will be crucial for you to implement DevOps (CI/CD, Git) practices for Fabric assets and stay updated with Microsoft Fabric roadmap (Cortex AI, Copilot, Real-Time Intelligence). Key Responsibilities: - Design and build data pipelines, Lakehouse archi...

Position:- Cloud Data Architect (Azure & AWS) Technology- Cloud Data Architect, Azure, AWS AWS Glue, S3, Redshift, and EMR, Data Factory, Data Lake, Synapse, and Databricks Experience 10+ years Work Location - Navi Mumbai Job Description Deep expertise in Azure and AWS data ecosystems to lead end-to- end solutioning covering data ingestion, transformation, governance, security, and analytics platform design Solution Architecture & Delivery Design, architect, and implement modern cloud-native data platforms on Azure and AWS tailored to client needs Build data lakehouse solutions using Azure Synapse, Databricks, AWS Redshift, Glue, EMR, and Delta Lake Lead the development of ETL/ELT pipelines ...

As a Data Engineer at our company, you will play a crucial role in designing, building, and maintaining end-to-end data platforms to support product-performance analytics. Your responsibilities will include: - Engineering robust ETL/ELT pipelines and data models for processing structured and unstructured product and customer data. - Managing data lake migrations and ensuring One-Lake availability for various stakeholders. - Implementing CI/CD for data deployments, ensuring pipeline observability, and maintaining data quality. - Creating dashboards and visual insights for Product, Marketing, and Engineering teams. - Collaborating with cross-functional teams, mentoring junior engineers, and es...

Job Summary: We are seeking a highly skilled and experienced Senior Developer with a strong background in DAX and SSAS cube development. The ideal candidate should also have a deep understanding of how a Synapse data pipelines works and developed. The person should also have advanced SQL database expertise. In this role you will work closely with cross-functional teams to design develop and optimize data models and analytical solutions to meet business needs. Key Responsibilities: Design develop and maintain SSAS (SQL Server Analysis Services) cubes to support business intelligence and reporting needs. Write optimize and maintain DAX (Data Analysis Expressions) queries for various Power BI a...

Your role at this Analytics Services company would involve: Role Overview: You will be leading end-to-end architecture design for data and analytics solutions on Azure. Additionally, you will define and implement Azure-based modern data platforms, collaborate with project managers for solution delivery, and collaborate with Pre-sales teams for RFP responses and client presentations. Your responsibilities will also include creating and maintaining architectural documentation, guiding implementation teams on best practices, ensuring alignment with security and compliance standards, overseeing data integration pipelines, supporting application migration and modernization efforts, providing tech...

You are seeking a skilled Power BI Developer with strong expertise in data Analytics, data Science, SQL, database management, and Python to join the team. You will be responsible for designing and developing interactive dashboards, reports, conducting advanced analytics, and data models, while also contributing to data automation, transformation, data-driver decision making and integration tasks. - Design, develop, and maintain Power BI dashboards and reports with focus on storytelling, performance, and usability to deliver actionable insights. - Work with client/Program Managers to gather requirements and transform them into analytics solutions by collecting, transforming, and analyzing lar...

As a Cloud Engineer at Innover, your role will involve migrating millions of documents from Azure Blob Storage to TR Azure Blob Storage. You will be responsible for planning, testing, documenting, and executing the migration process efficiently. Key Responsibilities: - Migrate documents from Azure Blob Storage to TR Azure Blob Storage - Utilize Azure Storage (Blob/Table), Data Factory, and ETL jobs for seamless migration - Ensure data integrity, optimize performance, and troubleshoot any issues that arise - Document the migration process thoroughly and collaborate effectively with teams for successful execution Qualifications Required: - Proficiency in Azure Storage (Blob/Table) - Prior expe...

Role Summary: We are seeking an experienced L3 Support Engineer specializing in Azure Integration Services to provide advanced troubleshooting, monitoring, and operational support for complex integration environments. The ideal candidate will be hands-on with Azure services such as Logic Apps, Service Bus, API Management, Event Grid, Functions, and Data Factory, and will play a key role in maintaining system stability, performance, and reliability. Key Responsibilities Incident & Problem Management Act as the final escalation point (L3) for Azure Integration Services incidents and problems. Analyze, troubleshoot, and resolve issues across integration components (Logic Apps, Service Bus, API ...

Role & responsibilities Develop and implement data pipelines using Azure Data Factory and Databricks. Work with stakeholders to gather requirements and translate them into technical solutions. Migrate data from Oracle to Azure Data Lake. Optimize data processing workflows for performance and scalability. Ensure data quality and integrity throughout the data lifecycle. Collaborate with data architects and other team members to design and implement data solutions. Preferred candidate profile Strong experience with Azure Data Services, including Azure Data Factory, Synapse Analytics, and Databricks. Proficiency in data transformation and ETL processes. Hands-on experience with Oracle to Azure D...

Role & responsibilities Develop and implement data pipelines using Azure Data Factory and Databricks. Work with stakeholders to gather requirements and translate them into technical solutions. Migrate data from Oracle to Azure Data Lake. Optimize data processing workflows for performance and scalability. Ensure data quality and integrity throughout the data lifecycle. Collaborate with data architects and other team members to design and implement data solutions. Preferred candidate profile Strong experience with Azure Data Services, including Azure Data Factory, Synapse Analytics, and Databricks. Proficiency in data transformation and ETL processes. Hands-on experience with Oracle to Azure D...

You will be joining a leading UK-based Digital Agency that is expanding its presence in India as a Data Engineer. In this role, you will be responsible for designing and building scalable data solutions that power next-generation property technology. If you have strong C# and SQL skills, enjoy building ETL pipelines, and excel at transforming raw data into valuable business insights, this is an excellent opportunity for you. You will work with cutting-edge Microsoft tools, collaborate with global teams, and contribute to a fast-growing industry. **Key Responsibilities:** - Design, build, and maintain robust ETL/ELT pipelines to process large-scale property data. - Collaborate with UK-based d...

Proven experience as a MS Fabric Data Architect Comfortable developing and implementing a delivery plan with key milestones based on requirements Strong working knowledge of Microsoft Fabric core features, including setup, configuration, and use of: Azure Data Lake (OneLake) for Big Data storage. Azure Synapse Data Warehouse for database management. Azure Synapse Data Engineering and Data Factory for data integration. Microsoft Purview (preview for Fabric) for data governance. Azure Data Science for analytics and AI workloads. Event stream and Data Activator for real time data flows. Strong understanding of data modelling, including relational and NoSQL data models. Ability to interpret an o...

You will be responsible for designing and developing ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT. Your key responsibilities will include: - Building and maintaining data integration workflows from various sources to Snowflake. - Writing efficient SQL queries for data extraction and transformation. - Working with stakeholders to understand business requirements and translating them into technical solutions. - Monitoring, troubleshooting, and optimizing data pipelines for performance and reliability. - Maintaining and enforcing data quality, governance, and documentation standards. - Collaborating with data analysts, architects, and DevOps teams in a cloud-native environment...

As a Senior Data Engineer in the healthcare domain, your role involves architecting, developing, and managing large-scale, secure, and high-performance data pipelines on Databricks using Spark, Delta Lake, and cloud-native tools. You will be responsible for designing and implementing healthcare-specific data models to support analytics, AI/ML, and operational reporting. Your expertise will be crucial in ingesting and transforming complex data types such as 837/835 claims, EHR/EMR records, provider/member files, lab results, and clinical notes. Additionally, you will lead data governance, quality, and security initiatives ensuring compliance with HIPAA, HITECH, and organizational policies. Co...

Job Description: You will be a Data Engineer with expertise in Microsoft Fabric, focusing on technologies like OneLake, Data Warehouse, Dataflows, and Data Factory. Your primary responsibility will involve creating, enhancing, and managing scalable data pipelines, integrating various data sources, and enabling analytics and reporting within the Microsoft Fabric ecosystem. Key Responsibilities: - Design and execute comprehensive data solutions using Microsoft Fabric's unified analytics platform. - Develop and sustain data pipelines utilizing OneLake, Dataflows Gen2, and Data Factory pipelines. - Construct and oversee enterprise-level data warehouse models in Microsoft Fabric. - Enhance perfor...

You are being hired for the role of Azure Microsoft Fabric at Ashra Technologies with 7+ years of experience. The job location options include Pune, Mumbai, Chennai, and Bangalore. **Key Responsibilities:** - Hands-on experience with Microsoft Fabric, including Lakehouse, Data Factory, and Synapse. - Strong expertise in PySpark and Python for large-scale data processing and transformation. - Deep knowledge of Azure data services such as ADLS Gen2, Azure Databricks, Synapse, ADF, Azure SQL, etc. - Experience in designing, implementing, and optimizing end-to-end data pipelines on Azure. - Understanding of Azure infrastructure setup like networking, security, and access management is beneficial...

Job Description: • Good knowledge of Azure SQL, .Net, C, SSIS worked as developer • Strong proficiency in .NET (C#) development. • Hands-on experience with Azure SQL (Database design, Stored Procedures, T-SQL, performance tuning). • Practical experience in SSIS package design, deployment, and debugging. • Understanding of Azure ecosystem (Data Factory, Functions, Logic Apps is a plus). • Good knowledge of SDLC, Agile methodologies, and version control (Git/Azure DevOps). Strong problem-solving, analytical, and communication skills Essential Skills: Good knowledge of Azure SQL, .Net, C, SSIS Desirable Skills: Knowledge of Azure

As a Senior Data Engineer focusing on Azure Databricks, your role involves designing, building, and optimizing scalable data pipelines and solutions using Azure Databricks and related technologies. Your primary goal is to enable faster, data-driven decisions as part of the data transformation journey. You will be based in Nagpur, Pune, Chennai, or Bangalore. Key Responsibilities: - **Data Pipeline Development:** Design and implement robust batch and streaming data pipelines using Azure Databricks and Spark. - **Data Architecture Implementation:** Apply Medallion Architecture to structure data layers (raw, enriched, curated). - **Data Quality & Governance:** Ensure data accuracy, consistency,...

As a Data Engineer at IXLY Technologies, you will play a crucial role in building, optimizing, and maintaining scalable data pipelines and analytics solutions using modern data engineering tools and cloud technologies. You will work with Microsoft Fabric and Azure Synapse Analytics to design, develop, and maintain data pipelines and ETL processes. Your responsibilities will include implementing data models, data lakes, and data warehouses, optimizing data storage and processing performance, developing complex SQL queries, and collaborating with cross-functional teams to translate business requirements into technical solutions. Additionally, you will ensure data quality, governance, and secur...

Must have Selenium, Java with Data factory and Databricks. Excellent Communication Skill Max Budget : 20 LPA Max NP: 15 Days. Job Title: Off Shore Automation Engineer Minimum Qualifications and Job Requirements: 5+ years of experience in automating APIs and web services. 3+ years of experience in Selenium automation tool. 1+ years of expereince with Datafactory and Databricks Experience with BDD implementations using Cucumber.Excellent SQL skills and the ability to write complex queriesHighly skilled in at least one programming language. Java is preferred Highly skilled in 2 or more Automation Test tools. Experience in ReadyAPI is preferred. 2+ years of experience with Jenkins 2+ years of ex...