855 Data Ingestion Jobs

Job Description: Complete data ingestion, data pipeline, data lineage , data quality , data wearhouse, data governance and data reconciliation. Essential Skills: Must have Data architect experience and knowledge. Data Architect with over 10 +years of hands-on experience in designing, developing, and managing large-scale data solutions. Proven expertise in building and optimizing ETL pipelines. Strong in data preprocessing, and enhancing data quality.Extracting events, processing large datasets (5 billion+ records) within (a Spark-Hadoop) cluster. Automated data processing tasks for DAAS (Data as a Service) project, streamlining workflow efficiency. Configured file and client setups, ensuring...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

Job Description At American Express, our culture is built on a 175-year history of innovation, shared and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. Function Description: Global Servicing (GS) Global Servicing (GS) is responsible for the company's customer service, credit, and fraud operations serving ...

Skills: Apache Spark, Data Engineering, Python, SQL, Machine Learning, Data Analysis, ETL,. Company Overview. CN Solutions partners with clients to provide top-notch solutions for their manpower needs. Specializing in Web Technologies, Databases, ERP, Data warehousing, and more. Offering staffing solutions, leadership hiring, RPO services, and more. Job Overview. Senior Databricks role with 7 to 10 years of experience in Hyderabad. Full-Time employment with. Qualifications And Skills. 7-10 years of experience in Data Engineering and Databricks. Proficiency in Python, SQL, and data analysis tools. Strong knowledge of Apache Spark and ETL processes. Experience in Machine Learning and working w...

Summary of Responsibilities Primary Skills: 15+ years of experience in IT, data, and analytics with 10+ years focused on product engineering and building data & analytics platforms , reusable frameworks, and solution assets. Expertise in architecting and delivering data-centric frameworks for ingestion, quality, governance, validation, and warehousing. Strong experience in designing and deploying reusable data frameworks on platforms like Databricks and Snowflake , leveraging hyperscalers. Skilled in ideating and developing innovative solution frameworks , translating business needs into scalable technical platforms. Hands-on in enhancing platform assets with AI/Gen AI-driven automation and ...

Job Description Project Manager with Splunk suite Implementation experience A Project Manager (PM) for Splunk suite implementation needs to oversee projects from initiation to completion, ensuring the Splunk solution meets business requirements by managing timelines, budgets, resources, and stakeholders. Key responsibilities include guiding the implementation team, facilitating communication between stakeholders and the technical team, managing risk, and driving the adoption of the Splunk solution through user training. A strong understanding of Splunk's architecture, dashboard development, data ingestion, and the use of Splunk Query Language (SPL) is also essential for effective project ove...

Adobe Campaign Role Purpose Provide advisory, consulting, and technical implementation services to customers on Adobe Experience Platform and Adobe Journey Optimizer Assess customer requirements, pain points, goals and make recommendations on solution architecture, design and roadmap Configure Adobe Experience Platform services like Identity Service, Data Storage Layer, Profile dataset, Real-time Customer Profile etc. Implement data ingestion from various sources like CRM, MPNs, Website data, Mobile apps using APIs, Experience Data Model (XDM), schemas and mappers Create customer, visitor and product audiences using segments and AI/ML powered segments Configure destinations to activate audie...

Summary Mastercard Merchant Solutions provides seamless connectivity for customers of all types into our Payment Processing and Decisioning products. Assets formerly known as the Mastercard Payment Gateway Services (MPGS), Direct Services Access (DSA), Networks Exchange (NEX), PaybyAccount (PbA) and Private Label Card Programs are now consolidated under a single Gateway portfolio. This product management team is part of a global product function at the center of payments innovation delivering leading customer experiences through our connected gateway. As part of this remit the team is responsible for defining the strategy, and executing the delivery of, market-leading payment gateway product...

About The Role Skill required: Data Management - Microsoft Azure Databricks Designation: Data Eng, Mgmt & Governance Analyst Qualifications: BE/BTech Years of Experience: 3 to 5 years What would you do? Accenture is a global professional services company with leading capabilities in digital, cloud and security. Combining unmatched experience and specialized skills across more than 40 industries, we offer Strategy and Consulting, Technology and Operations services, and Accenture Song all powered by the worlds largest network of Advanced Technology and Intelligent Operations centers. Our 699,000 people deliver on the promise of technology and human ingenuity every day, serving clients in more ...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing...

About The Role Project Role : Technology Architect Project Role Description : Design and deliver technology architecture for a platform, product, or engagement. Define solutions to meet performance, capability, and scalability needs. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Cloud Data Architecture Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Technology Architect, you will engage in a dynamic environment where you will review and integrate all application requirements, ensuring that functional, security, integration, performance, quality, and operations needs are met. Your typical ...

About The Role Project Role : Data Architect Project Role Description : Define the data requirements and structure for the application. Model and design the application data structure, storage and integration. Must have skills : Reltio, Informatica MDM Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Architect, you will define the data requirements and structure for the application. Your typical day will involve modeling and designing the application data structure, storage, and integration, ensuring that the data architecture aligns with business needs and technical specifications. You will colla...

Analyze and understand customers use case and data sources and extract, transform and load data from multitude of customers nterprise sources and ingest into Adobe Experience Platform Design and build data ingestion pipelines into the platform using PySpark Ensure ingestion is designed and implemented in a performant manner to support the throughout and latency needed. Develop and test complex SQLs to extract\analyze and report the data ingested into the Adobe Experience platform. Ensure the SQLs are implemented in compliance with the best practice to they are performant. Migrate platform configurations, including the data ingestion pipelines and SQL, across various sandboxes. Debug any issu...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

Databricks Developer Must-have skills Cloud certified in one of these categories Azure Data Engineer Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation . Semantic Modelling/ Optimization of data model to work within Rahona Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. Experience in Sqoop / Hadoop Microsoft Excel (for metadata files with requirements for ingestion) Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud Strong Programming skills with at least one of Python, Scala or Java Location- Pune, Bangalore, Coimbatore, Chennai Mandatory Skills: DataBricks - Data Enginee...

About the role : We are looking for a Data Engineer with strong Databricks expertise to join our team. This role will be pivotal in building robust ingestion pipelines, creating curated data views, and normalizing legacy datasets from sources like SharePoint, Excel, and other business systems. The ideal candidate will bring hands-on technical skills along with a problem-solving mindset Key Responsibilities Design, build, and maintain data ingestion pipelines using Databricks, Spark, and related tools. Implement and optimize Delta Tables for scalable, performant, and reliable data storage. Normalize and transform legacy data sources (Excel, SharePoint, on-prem files) into structured formats f...

Overview Join the Prodapt team in building a unified, enterprise-scale solution for model, data, and service management across the AI/ML model development. Responsibilities Proficiency in Python and experience with pyspark and ML/AI model development (TensorFlow, scikit-learn, MLflow). Experience in building applications with Java, including the use of Spring for backend development. Hands-on experience with core GCP services, including GKE, Dataproc, BigQuery, and Google Cloud Storage (GCS). Strong understanding of data storage and management (Oracle Exadata, HDFS, Hive, GCS, key-value stores). Experience with CI/CD tools and automation for ML/data workflows. Knowledge of security best prac...

Skills- AWS Data Engineer Experience: 9 to 13 years Location: AIA-Pune We are seeking skilled and dynamic Cloud Data Engineers specializing in AWS, Databricks. The ideal candidate will have a strong background in data engineering, with a focus on data ingestion, transformation, and warehousing. They should also possess excellent knowledge of PySpark or Spark, and a proven ability to optimize performance in Spark job executions. Key Responsibilities: - Design, build, and maintain scalable data pipelines for a variety of cloud platforms including AWS. - Implement data ingestion and transformation processes to facilitate efficient data warehousing. - Utilize cloud services to enhance data proce...

About The Role Management Consulting - Travel Find endless opportunities to solve the most pressing client needs and challenges, especially during the backdrop of a global pandemic as we adapt to the new normal. Practice: Industry Consulting, Capability Network I Areas of Work: Travel | Level: Analyst /Consultant/Manager | Location: Pune, Gurgaon, Mumbai, Bangalore, Chennai, Hyderabad, Kolkata | Years of Exp: 8-15 years Explore an Exciting Career at Accenture Are you an outcome-oriented problem solver? Do you enjoy working on transformation strategies for global clients? Does working in an inclusive and collaborative environment spark your interest? Then, Accenture Strategy and Consulting is...

About The Role Management Consulting - Travel Find endless opportunities to solve the most pressing client needs and challenges, especially during the backdrop of a global pandemic as we adapt to the new normal. Practice: Industry Consulting, Capability Network I Areas of Work: Travel | Level: Analyst /Consultant/Manager | Location: Pune, Gurgaon, Mumbai, Bangalore, Chennai, Hyderabad, Kolkata | Years of Exp: 8-15 years Explore an Exciting Career at Accenture Are you an outcome-oriented problem solver? Do you enjoy working on transformation strategies for global clients? Does working in an inclusive and collaborative environment spark your interest? Then, Accenture Strategy and Consulting is...

About The Role Project Role : Application Support Engineer Project Role Description : Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems. Must have skills : Splunk Administration Good to have skills : Dynatrace Administration Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Support Engineer, you will act as software detectives, providing a dynamic service that identifies and resolves issues within various components of critical business systems. Your typical day will involve collaborating with different teams to troubleshoot ...

Key Responsibilities Architect and Develop Data Pipelines: Design and implement data pipelines that can handle the 4Vs of data (Volume, Variety, Velocity, Veracity) from diverse sources. Implement CDC: Utilize Change Data Capture (CDC) to efficiently and reliably synchronize data between source and target systems. Build a Medallion Architecture: Design and implement a data platform following the Medallion Architecture (Raw, Refined, Insights) to ensure data quality, manage transformations, and support analytical needs. Orchestrate and Manage Workflows: Develop and manage data orchestration processes to automate data ingestion, transformation, and delivery. Data Strategy & Business Value: Art...

We're Hiring: MDM Specialists (Stibo / Reltio / Informatica MDM / SAP MDG/Data Quality) Location: AIA Pune | Experience: 5–15 Years | Mode: Full-time Are you passionate about driving data excellence and enabling digital transformation through cutting-edge Master Data Management (MDM) solutions? Join our dynamic team and be part of large-scale, global MDM implementations across industries. We’re looking for experts in one or more of the following technologies: Stibo STEP MDM developer Strong experience in STEP Workbench, Data Modeling, Workflow Configuration, and Business Rules. Hands-on with PIM/MDM implementations, integrations, and syndication. Experience with REST APIs, Java/Groovy script...