855 Data Ingestion Jobs - Page 2

Overview About this role We are looking for a high performing individual who is passionate about data to provide data pipeline support, operations and engineering across multiple data domains and data platforms. Initially you will proactively identify and resolve data pipeline issues to ensure high quality on time data for our clients. In addition, you will optimize pipeline performance and understand how our clients use their data. Key Responsibilities Monitor and manage data pipelines to ensure the timely and accurate flow of data Resolve quality checks alerts to ensure the accuracy, completeness, and consistency of data Monitor and optimize data pipeline performance to meet and exceed est...

We are hiring Azure Data Engineers with hands-on experience in data ingestion, transformation, and cloud integration using Microsoft Azure tools and frameworks With strong experience with Azure Databricks, Azure Data Factory (ADF), and PySpark .

Key Responsibilities Architect and Develop Data Pipelines: Design and implement data pipelines that can handle the 4Vs of data (Volume, Variety, Velocity, Veracity) from diverse sources. Implement CDC: Utilize Change Data Capture (CDC) to efficiently and reliably synchronize data between source and target systems. Build a Medallion Architecture: Design and implement a data platform following the Medallion Architecture (Raw, Refined, Insights) to ensure data quality, manage transformations, and support analytical needs. Orchestrate and Manage Workflows: Develop and manage data orchestration processes to automate data ingestion, transformation, and delivery. Data Strategy & Business Value: Art...

We are looking for a skilled App DevOps professional with 5-10 years of experience to join our team. The ideal candidate will have expertise in Data Ingestion, Release Management, Monitorization, Incident Review, Databricks, Azure Cloud, and Data Analysis. Roles and Responsibility Implement and manage data ingestion processes to acquire data from various sources and ensure its accuracy and completeness. Collaborate with development and operations teams to facilitate the release management process, ensuring successful and efficient deployment of application updates and enhancements. Monitor application performance and health, promptly identifying and addressing any anomalies or potential issu...

Role: AIML Data Scientist Location - Gurgaon Experience - 5 to 13 years Job Description: Be a hands-on problem solver with consultative approach, who can apply Machine Learning & Deep Learning algorithms to solve business challenges Use the knowledge of wide variety of AI/ML techniques and algorithms to find what combinations of these techniques can best solve the problem Improve Model accuracy to deliver greater business impact Estimate business impact due to deployment of model Work with the domain/customer teams to understand business context , data dictionaries and apply relevant Deep Learning solution for the given business challenge Working with tools and scripts for sufficiently pre-p...

Role: AIML Data Scientist Location - Indore Job Description: Be a hands-on problem solver with consultative approach, who can apply Machine Learning & Deep Learning algorithms to solve business challenges Use the knowledge of wide variety of AI/ML techniques and algorithms to find what combinations of these techniques can best solve the problem Improve Model accuracy to deliver greater business impact Estimate business impact due to deployment of model Work with the domain/customer teams to understand business context , data dictionaries and apply relevant Deep Learning solution for the given business challenge Working with tools and scripts for sufficiently pre-processing the data & feature...

Schaeffler is a dynamic global technology company and its success has been a result of its entrepreneurial spirit and long history of private ownership. Does that sound interesting to you As a partner to all of the major automobile manufacturers, as well as key players in the aerospace and industrial sectors, we offer you many development opportunities. Your Key Responsibilities Develop data pipelines and applies methods and tools to collect, store, process and analyze complex data sets, globally for assigned operations or functions. Design, govern, build and operate solutions for large-scale data architectures and applications across businesses and functions. Select, manage and work hands-o...

AI Developer Req number: R6260 Employment type: Full time Worksite flexibility: Remote Who we are CAI is a global technology services firm with over 8,500 associates worldwide and a yearly revenue of $1 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise. Job Summary As an AI Developer you will play a crucial role in development of AI systems th...

Role: Sr. Data Engineer - Snowflake Experience: 5-8 years Location: Hyderabad Job Overview: We are seeking a highly skilled and experienced Snowflake Data Engineer with a strong background in SQL, Python, and a minimum of 3 years of hands-on Snowflake development experience. The ideal candidate will be certified, with a proven track record in data warehousing, data modeling, performance optimization, and implementing scalable ETL/ELT pipelines using industry-standard tools. Experience in leading small delivery tracks or mentoring junior engineers is highly desirable. Primary Roles & Responsibilities: • Design, develop, and optimize scalable data pipelines and ETL/ELT processes in Snowflake. ...

As an Associate TPM Analyst at the company, your role involves working closely with the Lead Analyst to take on format/region responsibilities. Your key responsibilities will include: - Ensuring timely delivery of tasks while adhering to SLAs and OLAs - Ingesting promotional data in Pepsico internal systems and customer external portals for trade planning and demand planning - Managing contracts which are agreements between retailers and Pepsico, overseeing them end to end for upcoming promotions - Updating TPM events, Deal sheets, and New item maintenance based on promotion discussions with retailers and price changes - Communicating Risks and Opportunities to the Sales team, Control, and F...

Job Purpose and Impact The Professional, Data Engineering job designs, builds and maintains moderately complex data systems that enable data analysis and reporting With limited supervision, this job collaborates to ensure that large sets of data are efficiently processed and made accessible for decision making, Key Accountabilities DATA & ANALYTICAL SOLUTIONS: Develops moderately complex data products and solutions using advanced data engineering and cloud based technologies, ensuring they are designed and built to be scalable, sustainable and robust, DATA PIPELINES: Maintains and supports the development of streaming and batch data pipelines that facilitate the seamless ingestion of data fr...

Primary skills:Technology->Media->Settop Box, DVB,Technology->Media->Video Streaming,Technology->Open System->Linux Must have skills -: Expert level knowledge JavaScript, NodeJS, etc, Good Exposure to C, C++, etc, Expert level knowledge on frequently used data storage or SQL or NoSQL databases, Expert level knowledge in Software development, networking & system design, Knowledge of Linux Operating System internals, Experience in Linux embedded systems, Experience in architecture of complex performant Linux system software, Capability to translate business requirements into architectural framework and system designs, Should have worked on system designs and software development to deliver a h...

We're looking for a Data Engineer to join our Center of Competence in Data Analytics & Artificial Intelligence to develop our data platform and build solutions for healthcare usecases The right candidate will be a technology enthusiast who is passionate about solving real world challenges and is not afraid of digging deep into systems and data to develop solutions, Responsibilities Responsible for expanding and optimizing our data and data pipeline architecture, working together with the Data Architect and platform responsibles, Extract value from data using pre processing techniques (transformation, integration, normalization, feature extraction), Ingest data from (distributed) data sets, B...

As a Data Engineer at Codvo, you will play a crucial role in designing and maintaining scalable data pipelines on Google Cloud Platform (GCP). Your responsibilities will include: - Designing, implementing, and maintaining scalable data pipelines on GCP services such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage. - Ingesting and processing real-time data from connected vehicles and IoT devices. - Developing and maintaining ETL/ELT workflows using Python, SQL, and Apache Beam/Spark. - Ensuring data quality, lineage, and governance in the data lake. - Acting as a bridge between data engineering and analytics teams, performing data wrangling, feature engineering, and ML model prototyping. - ...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

#Notice Period: Immediate #Employment Type:Contract JOB Description: Salesforce CDP/Data Cloud JD 1. Overall IT experience of Minimum 7 years. 2. Experience in CDP/Data Cloud for a minimum of 6 months. 3. Should have knowledge of the SFDC Platform 4. Good Experience in SQL Queries, Data Model Concepts 5. Should have worked on a CDP/Data Cloud Implementation. 6. Show have working knowledge on at least the first 3 areas of CDP listed below. Data Ingestion Unification Segmentation Activation 1. Should have knowledge about both Batch and Real Time Integration Options. 2. Good to have knowledge on basic Data Model understanding of Financial Services Cloud. 3. Good to have experience in Salesforce...

Design and develop integration of Snowflake with a cloud platform and platform enhancements, integrations, and performance optimisation. Work on data ingestion using Python, cataloguing, and lineage tracking, Develop and architect ETL workflows. Required Candidate profile 5 years in developing and scaling data platforms centered around Snowflake, with Azure. Hands on Python Understanding of modern data architectures such as Data Mesh, Lakehouse, and ELT.

Role Summary & Role Description: State Street Corporate Finance IT team is leading a Cloud Transformation Program to modernize and redesign finance technology and process landscape globally, incl. North America, APAC and EMEA regions. The ideal candidate will have the necessary technology expertise Databricks with AWS Cloud , with very good communication and leadership skills to independently hands-on manage highly visible and complex projects from start to finish. Provide architectural leadership for technology solutions, data architectures, data lakes, cloud and infrastructure initiatives. End to end Cloud Data Lake architecture design & implementation including data ingestion, data modeli...

Job Title: FP&A Support Analyst Location: Mumbai / Bangalore Experience: 57 Years Job Summary We are looking for a detail-oriented and proactive FP&A Systems Support Analyst to join our Finance Systems team. The role will support Cognos reporting , FP&A operations, system access governance, outage coordination, and ServiceNow ticket management, ensuring smooth planning cycles, data integrity, and user satisfaction. Key Responsibilities Technical Support: Provide hands-on support for Cognos reporting and FP&A systems, including configuration, setup, troubleshooting, and issue analysis. User & Access Support: Handle user access requests, quarterly access reviews, and provide direct support to ...

Location: Bangalore (Preferred), Gurgaon, Chennai Experience: 7+ years Notice Period: Immediate to 15 days Role Level: B2 / C1 Choosing Capgemini means choosing a place where youll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine whats possible. Join us in helping leading organizations unlock the value of data and drive scalable, sustainable growth. Your Role As a Snowflake + Python Data Engineer, you will be instrumental in designing and implementing data solutions that support business intelligence, analytics, and data-driven decision-making. Youll work closely with cross-functional teams to build robust data pipelines, optimize da...

Job Title - OpenSearch API Candidate Specification 5.5 to 10 years of experience in New Relic and OpenSearch APINP Immediate to 30 Days Location - Bangalore, Chennai, Hyderabad Job Description Design, implement, and maintain New Relic solutions to meet the needs of our customers Collaborate with cross-functional teams to identify and prioritize business requirements Develop and maintain OpenSearch API integrations with New Relic Troubleshoot and resolve complex technical issues related to New Relic and OpenSearch API Stay up-to-date with the latest features and best practices in New Relic and OpenSearch API Strong understanding of New Relic and OpenSearch API architecture and functionality E...

Job Role: Data Engineer is required to be proactive in designing, building and maintaining data systems. The role also requires cross-functional collaborations and ensure highest standards of data quality and performance by extending his expertise in data engineering, data architecture, pipeline creation and big data technologies. Key Responsibilities: Understand the values and vision of the organization. Protect the Intellectual Property. Adhere to all the policies and procedures. Design, develop, and maintain scalable data pipelines for data ingestion, processing and storage. Build and optimize data architectures and data models for efficient data storage and retrieval. Develop ETL process...

Position: Snowflake Data Engineer Work Location: Hyderabad/ Bangalore(WFO) Experience : 3+ About the opportunity : We are seeking a highly skilled and experienced Snowflake Developer with a strong background in SQL, Python, and a minimum of 3 years of hands-on experience with Snowflake. The ideal candidate will be a Snowflake Certified with a proven track record in data warehousing, data modelling, and implementing ETL/ELT pipelines using industry-standard tools. Primary Roles & Responsibilities : • Design, develop, and optimize data pipelines and ETL/ELT processes in Snowflake. • Develop and optimize complex SQL queries for data extraction, transformation, and reporting. • Write robust Pyth...

Responsibilities: Business Requirement Translation: Translate complex business requirements into analytical SQL views efficiently utilizing DBT (Data Build Tool) . Data Ingestion Pipeline Support: Provide robust support for data ingestion pipelines, leveraging tools such as Apache Airflow and Azure Data Factory . DBT Macro Development: Develop sophisticated DBT macros to enable scalable and reusable code automation for data transformation processes. SQL & Data Warehousing: Apply strong proficiency in SQL and possess a deep understanding of relational data warehouse concepts to build and optimize data models. Required Skills: Mandatory Skills: Strong proficiency with DBT (Data Build Tool) or ...

Key Responsibilities: Splunk ITSI Implementation: Develop and configure IT Service Intelligence (ITSI) modules, including KPI creation, service trees, and notable event aggregation. SIEM Development: Design, implement, and optimize Splunk SIEM solutions for threat detection, security monitoring, and log analysis. Dashboard & Visualization: Create advanced dashboards, reports, and visualizations using Splunk SPL (Search Processing Language). Data Ingestion & Parsing: Develop data onboarding, parsing, and field extractions from various log sources, including cloud and on-prem infrastructure.KeywordsSIEM,Data Ingestion,data onboarding,Data Visualization,Dashboarding,Splunk*Mandatory Key SkillsS...