849 Data Ingestion Jobs

Summary of Responsibilities Primary Skills: 15+ years of experience in IT, data, and analytics with 10+ years focused on product engineering and building data & analytics platforms , reusable frameworks, and solution assets. Expertise in architecting and delivering data-centric frameworks for ingestion, quality, governance, validation, and warehousing. Strong experience in designing and deploying reusable data frameworks on platforms like Databricks and Snowflake , leveraging hyperscalers. Skilled in ideating and developing innovative solution frameworks , translating business needs into scalable technical platforms. Hands-on in enhancing platform assets with AI/Gen AI-driven automation and ...

Summary Mastercard Merchant Solutions provides seamless connectivity for customers of all types into our Payment Processing and Decisioning products. Assets formerly known as the Mastercard Payment Gateway Services (MPGS), Direct Services Access (DSA), Networks Exchange (NEX), PaybyAccount (PbA) and Private Label Card Programs are now consolidated under a single Gateway portfolio. This product management team is part of a global product function at the center of payments innovation delivering leading customer experiences through our connected gateway. As part of this remit the team is responsible for defining the strategy, and executing the delivery of, market-leading payment gateway product...

About The Role Skill required: Data Management - Microsoft Azure Databricks Designation: Data Eng, Mgmt & Governance Analyst Qualifications: BE/BTech Years of Experience: 3 to 5 years What would you do? Accenture is a global professional services company with leading capabilities in digital, cloud and security. Combining unmatched experience and specialized skills across more than 40 industries, we offer Strategy and Consulting, Technology and Operations services, and Accenture Song all powered by the worlds largest network of Advanced Technology and Intelligent Operations centers. Our 699,000 people deliver on the promise of technology and human ingenuity every day, serving clients in more ...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing...

About The Role Project Role : Technology Architect Project Role Description : Design and deliver technology architecture for a platform, product, or engagement. Define solutions to meet performance, capability, and scalability needs. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Cloud Data Architecture Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Technology Architect, you will engage in a dynamic environment where you will review and integrate all application requirements, ensuring that functional, security, integration, performance, quality, and operations needs are met. Your typical ...

About The Role Project Role : Data Architect Project Role Description : Define the data requirements and structure for the application. Model and design the application data structure, storage and integration. Must have skills : Reltio, Informatica MDM Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Architect, you will define the data requirements and structure for the application. Your typical day will involve modeling and designing the application data structure, storage, and integration, ensuring that the data architecture aligns with business needs and technical specifications. You will colla...

Analyze and understand customers use case and data sources and extract, transform and load data from multitude of customers nterprise sources and ingest into Adobe Experience Platform Design and build data ingestion pipelines into the platform using PySpark Ensure ingestion is designed and implemented in a performant manner to support the throughout and latency needed. Develop and test complex SQLs to extract\analyze and report the data ingested into the Adobe Experience platform. Ensure the SQLs are implemented in compliance with the best practice to they are performant. Migrate platform configurations, including the data ingestion pipelines and SQL, across various sandboxes. Debug any issu...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

Databricks Developer Must-have skills Cloud certified in one of these categories Azure Data Engineer Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation . Semantic Modelling/ Optimization of data model to work within Rahona Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. Experience in Sqoop / Hadoop Microsoft Excel (for metadata files with requirements for ingestion) Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud Strong Programming skills with at least one of Python, Scala or Java Location- Pune, Bangalore, Coimbatore, Chennai Mandatory Skills: DataBricks - Data Enginee...

About the role : We are looking for a Data Engineer with strong Databricks expertise to join our team. This role will be pivotal in building robust ingestion pipelines, creating curated data views, and normalizing legacy datasets from sources like SharePoint, Excel, and other business systems. The ideal candidate will bring hands-on technical skills along with a problem-solving mindset Key Responsibilities Design, build, and maintain data ingestion pipelines using Databricks, Spark, and related tools. Implement and optimize Delta Tables for scalable, performant, and reliable data storage. Normalize and transform legacy data sources (Excel, SharePoint, on-prem files) into structured formats f...

Overview Join the Prodapt team in building a unified, enterprise-scale solution for model, data, and service management across the AI/ML model development. Responsibilities Proficiency in Python and experience with pyspark and ML/AI model development (TensorFlow, scikit-learn, MLflow). Experience in building applications with Java, including the use of Spring for backend development. Hands-on experience with core GCP services, including GKE, Dataproc, BigQuery, and Google Cloud Storage (GCS). Strong understanding of data storage and management (Oracle Exadata, HDFS, Hive, GCS, key-value stores). Experience with CI/CD tools and automation for ML/data workflows. Knowledge of security best prac...

Skills- AWS Data Engineer Experience: 9 to 13 years Location: AIA-Pune We are seeking skilled and dynamic Cloud Data Engineers specializing in AWS, Databricks. The ideal candidate will have a strong background in data engineering, with a focus on data ingestion, transformation, and warehousing. They should also possess excellent knowledge of PySpark or Spark, and a proven ability to optimize performance in Spark job executions. Key Responsibilities: - Design, build, and maintain scalable data pipelines for a variety of cloud platforms including AWS. - Implement data ingestion and transformation processes to facilitate efficient data warehousing. - Utilize cloud services to enhance data proce...

About The Role Management Consulting - Travel Find endless opportunities to solve the most pressing client needs and challenges, especially during the backdrop of a global pandemic as we adapt to the new normal. Practice: Industry Consulting, Capability Network I Areas of Work: Travel | Level: Analyst /Consultant/Manager | Location: Pune, Gurgaon, Mumbai, Bangalore, Chennai, Hyderabad, Kolkata | Years of Exp: 8-15 years Explore an Exciting Career at Accenture Are you an outcome-oriented problem solver? Do you enjoy working on transformation strategies for global clients? Does working in an inclusive and collaborative environment spark your interest? Then, Accenture Strategy and Consulting is...

About The Role Management Consulting - Travel Find endless opportunities to solve the most pressing client needs and challenges, especially during the backdrop of a global pandemic as we adapt to the new normal. Practice: Industry Consulting, Capability Network I Areas of Work: Travel | Level: Analyst /Consultant/Manager | Location: Pune, Gurgaon, Mumbai, Bangalore, Chennai, Hyderabad, Kolkata | Years of Exp: 8-15 years Explore an Exciting Career at Accenture Are you an outcome-oriented problem solver? Do you enjoy working on transformation strategies for global clients? Does working in an inclusive and collaborative environment spark your interest? Then, Accenture Strategy and Consulting is...

About The Role Project Role : Application Support Engineer Project Role Description : Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems. Must have skills : Splunk Administration Good to have skills : Dynatrace Administration Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Support Engineer, you will act as software detectives, providing a dynamic service that identifies and resolves issues within various components of critical business systems. Your typical day will involve collaborating with different teams to troubleshoot ...

Key Responsibilities Architect and Develop Data Pipelines: Design and implement data pipelines that can handle the 4Vs of data (Volume, Variety, Velocity, Veracity) from diverse sources. Implement CDC: Utilize Change Data Capture (CDC) to efficiently and reliably synchronize data between source and target systems. Build a Medallion Architecture: Design and implement a data platform following the Medallion Architecture (Raw, Refined, Insights) to ensure data quality, manage transformations, and support analytical needs. Orchestrate and Manage Workflows: Develop and manage data orchestration processes to automate data ingestion, transformation, and delivery. Data Strategy & Business Value: Art...

We're Hiring: MDM Specialists (Stibo / Reltio / Informatica MDM / SAP MDG/Data Quality) Location: AIA Pune | Experience: 5–15 Years | Mode: Full-time Are you passionate about driving data excellence and enabling digital transformation through cutting-edge Master Data Management (MDM) solutions? Join our dynamic team and be part of large-scale, global MDM implementations across industries. We’re looking for experts in one or more of the following technologies: Stibo STEP MDM developer Strong experience in STEP Workbench, Data Modeling, Workflow Configuration, and Business Rules. Hands-on with PIM/MDM implementations, integrations, and syndication. Experience with REST APIs, Java/Groovy script...

Overview About this role We are looking for a high performing individual who is passionate about data to provide data pipeline support, operations and engineering across multiple data domains and data platforms. Initially you will proactively identify and resolve data pipeline issues to ensure high quality on time data for our clients. In addition, you will optimize pipeline performance and understand how our clients use their data. Key Responsibilities Monitor and manage data pipelines to ensure the timely and accurate flow of data Resolve quality checks alerts to ensure the accuracy, completeness, and consistency of data Monitor and optimize data pipeline performance to meet and exceed est...

We are hiring Azure Data Engineers with hands-on experience in data ingestion, transformation, and cloud integration using Microsoft Azure tools and frameworks With strong experience with Azure Databricks, Azure Data Factory (ADF), and PySpark .

Key Responsibilities Architect and Develop Data Pipelines: Design and implement data pipelines that can handle the 4Vs of data (Volume, Variety, Velocity, Veracity) from diverse sources. Implement CDC: Utilize Change Data Capture (CDC) to efficiently and reliably synchronize data between source and target systems. Build a Medallion Architecture: Design and implement a data platform following the Medallion Architecture (Raw, Refined, Insights) to ensure data quality, manage transformations, and support analytical needs. Orchestrate and Manage Workflows: Develop and manage data orchestration processes to automate data ingestion, transformation, and delivery. Data Strategy & Business Value: Art...

We are looking for a skilled App DevOps professional with 5-10 years of experience to join our team. The ideal candidate will have expertise in Data Ingestion, Release Management, Monitorization, Incident Review, Databricks, Azure Cloud, and Data Analysis. Roles and Responsibility Implement and manage data ingestion processes to acquire data from various sources and ensure its accuracy and completeness. Collaborate with development and operations teams to facilitate the release management process, ensuring successful and efficient deployment of application updates and enhancements. Monitor application performance and health, promptly identifying and addressing any anomalies or potential issu...

Role: AIML Data Scientist Location - Gurgaon Experience - 5 to 13 years Job Description: Be a hands-on problem solver with consultative approach, who can apply Machine Learning & Deep Learning algorithms to solve business challenges Use the knowledge of wide variety of AI/ML techniques and algorithms to find what combinations of these techniques can best solve the problem Improve Model accuracy to deliver greater business impact Estimate business impact due to deployment of model Work with the domain/customer teams to understand business context , data dictionaries and apply relevant Deep Learning solution for the given business challenge Working with tools and scripts for sufficiently pre-p...

Role: AIML Data Scientist Location - Indore Job Description: Be a hands-on problem solver with consultative approach, who can apply Machine Learning & Deep Learning algorithms to solve business challenges Use the knowledge of wide variety of AI/ML techniques and algorithms to find what combinations of these techniques can best solve the problem Improve Model accuracy to deliver greater business impact Estimate business impact due to deployment of model Work with the domain/customer teams to understand business context , data dictionaries and apply relevant Deep Learning solution for the given business challenge Working with tools and scripts for sufficiently pre-processing the data & feature...