858 Data Ingestion Jobs - Page 15

You will be responsible for developing and optimizing ETL pipelines using PySpark and Databricks. Your role will involve working with large-scale datasets and building distributed computing solutions. You will design and implement data ingestion, transformation, and processing workflows, as well as write efficient and scalable Python code for data processing. Collaboration with data engineers, data scientists, and business teams to deliver insights is a key aspect of this role. Additionally, you will be expected to optimize performance and cost efficiency for big data solutions and implement best practices for CI/CD, testing, and automation in a cloud environment. Monitoring job performance,...

Data Architecture Design: Develop and maintain a comprehensive data architecture strategy that aligns with the business objectives and technology landscape. Data Modeling: Create and manage logical, physical, and conceptual data models to support various business applications and analytics. Database Design: Design and implement database solutions, including data warehouses, data lakes, and operational databases. Data Integration: Oversee the integration of data from disparate sources into unified, accessible systems using ETL/ELT processes. Data Governance: Implement and enforce data governance policies and procedures to ensure data quality, consistency, and security. Technology Evaluation: ...

Job Description: Employer: DWS Group Job Title: Director Principal Engineering Lead Location: Pune, India Bangalore, India About DWS: Today, markets face a whole new set of pressures but also a whole lot of opportunity too. Opportunity to innovate differently. Opportunity to invest responsibly. And opportunity to make change. Join us at DWS, and you can be part of an industry-leading firm with a global presence. You can lead ambitious opportunities and shape the future of investing. You can support our clients, local communities, and the environment. Read more about DWS and who we are Team division overview The Chief Operating Office (COO) , CTO DWS Tech Division is a key enabler for DWS and...

Data Services Analyst The Data Services ETL Developer will specialize in data transformations and integration projects utilizing Zetas proprietary tools, 3rd Party software, and coding. This role requires understanding of CRM methodologies related to marketing operations. The candidate will be responsible for implementing data processing across multiple technologies, supporting a high volume of tasks with the expectation of accurate and on-time delivery. Responsibilities: Manipulate client and internal marketing data across multiple platforms and technologies. Automate scripts to perform tasks to transfer and manipulate data feeds (internal and external). Build, deploy, and manage cloud-base...

We are seeking a highly skilled Technical Project Manager (TPM) to lead process optimization and automation efforts within our GIS team. The ideal candidate will be responsible for designing and implementing efficient workflows Required Candidate profile 5-7+ years of experience in technical project management, process optimization, or automation within data-intensive environments. Strong understanding of large-scale data workflows, data ingestion

Responsibilities: * Design, develop & maintain data pipelines using Snowflake, DBT,SQL, ETL tools. * Collaborate with cross-functional teams on project requirements & deliverables. Office cab/shuttle

About The Role Project Role : Advanced Application Engineer Project Role Description : Develop innovative technology solutions for emerging industries and products. Interpret system requirements into design specifications. Must have skills : Adobe Analytics Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Advanced Application Engineer, We are seeking an experienced Adobe Customer Journey Analytics (CJA) Specialist to design, implement, and optimize customer data analytics solutions using Adobe Experience Platform (AEP) and CJA. The ideal candidate will have a strong background in digital analytics, dat...

About The Role Project Role : Data Architect Project Role Description : Define the data requirements and structure for the application. Model and design the application data structure, storage and integration. Must have skills : Google Cloud Platform Architecture Good to have skills : NAMinimum 15 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Architect, you will design and deliver end-to-end data architecture solutions for platforms, products, or engagements on Google Cloud. You will define architectures that meet performance, scalability, security, and compliance requirements while ensuring data integrity and accessibility. You...

About The Role Project Role : Advanced Application Engineer Project Role Description : Develop innovative technology solutions for emerging industries and products. Interpret system requirements into design specifications. Must have skills : Adobe Journey Optimizer Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :The AEP-AJO Specialist will design and implement solutions and deployments across the Adobe Experience Platform, specifically AJO. Work closely with marketing, product and IT teams to design new solutions using AEP, AJO and other components of the Adobe Experience Cloud / Marketing Cloud. Be able to...

About The Role Project Role : Advanced Application Engineer Project Role Description : Develop innovative technology solutions for emerging industries and products. Interpret system requirements into design specifications. Must have skills : Adobe Experience Manager (AEM) Sites Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :The RT-CDP lead will design and develop solution implementations and deployments across the Adobe Experience Platform, specifically RTCDP. Work closely with marketing, product and IT teams to design new solutions using AEP and other components of the Adobe Experience Cloud / Marketing C...

About The Role Project Role : Advanced Application Engineer Project Role Description : Develop innovative technology solutions for emerging industries and products. Interpret system requirements into design specifications. Must have skills : Adobe Analytics Good to have skills : NAMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Advanced Application Engineer, We are seeking an experienced Adobe Customer Journey Analytics (CJA) Architect to design, implement, and optimize customer data analytics solutions using Adobe Experience Platform (AEP) and CJA. The ideal candidate will have a strong background in digital analytics, da...

About The Role Project Role : Advanced Application Engineer Project Role Description : Develop innovative technology solutions for emerging industries and products. Interpret system requirements into design specifications. Must have skills : Adobe Experience Manager (AEM) Sites Good to have skills : NAMinimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :The RT-CDP architect will architect, design and oversee solution implementations and deployments across the Adobe Experience Platform, specifically RTCDP. Work closely with marketing, product and IT teams to design new solutions using AEP and other components of the Adobe Experience Cl...

Job Description Summary This role will play a critical role in supporting the airline customers by designing, developing, and maintaining data pipelines and analytical solutions that drive operational efficiency and fuel savings. This role is responsible for ensuring high-quality data ingestion, transformation, and validation from diverse operational sources, enabling the team to monitor, analyze, and optimize fuel consumption across the airlines fleet. The engineer will work closely with fuel analysts, operations teams, and IT to deliver accurate, timely insights that support decision-making, sustainability goals, and cost reduction initiatives. Job Description Site Overview Role Overview B...

As a member of the Group Technology and Operations (T&O) team, your primary responsibility will be to design, implement, and maintain Elasticsearch clusters to ensure an efficient and resilient infrastructure for the bank. You will work towards optimizing Elasticsearch queries for efficient data retrieval and integrating Elasticsearch with other systems like Kibana, Logstash, or custom applications. Monitoring the performance and health of Elasticsearch clusters, troubleshooting and resolving related issues, and implementing security best practices will be key aspects of your role. Collaboration with data scientists, developers, and system administrators to enhance search and analytics capab...

As a MongoDB Developer with over 5 years of experience, you will be responsible for designing and developing MongoDB databases, collections, and schemas to efficiently store and manage party data for banking clients. Your role will involve implementing data ingestion, processing, and retrieval workflows using MongoDB features while adhering to banking industry standards. You will play a crucial role in optimizing MongoDB database performance by implementing indexing, sharding, and replication strategies to meet the high availability and low latency requirements of the banking sector. Ensuring data security and compliance will be a key aspect of your responsibilities, including implementing a...

About The Role Key Responsibilities: Provide expert-level support for Azure Machine Learning, OpenAI, Cognitive Services, Synapse, and Data Factory . Troubleshoot real-time data integration pipelines, model deployments, inference performance, and security configurations. Guide customers in implementing Responsible AI , security governance, and model versioning best practices. Collaborate with engineering teams to resolve service issues and release platform updates. Proactively identify patterns in customer challenges and build reusable diagnostics or automations. Work with cross-functional teams (Product, Engineering, Customer Success) to improve support processes and tooling. Skillset: Stro...

Key Responsibilities: 5 to 10 years of experience designing and building data pipelines using Apache Spark, Databricks or equivalent bigdata frameworks Handson expertise with streaming and messaging systems such as Apache Kafka (publish subscribe architecture), Confluent Cloud, RabbitMQ or Azure Event Hub. Experience creating producers, consumers and topics and integrating them into downstream processing. Deep understanding of relational databases and CDC. Proficiency in SQL Server, Oracle, or other RDBMSs; experience capturing change events using Debezium or native CDC tools and transforming them for downstream consumption. Implement CDC and deduplication logic. Capture change events from s...

Design and develop data ingestion pipelines using Apache NiFi for structured, semi-structured, and unstructured data sources. Build and maintain real-time and batch processing workflows to ingest data into AWS-based data lakes or warehouses. Configure and optimize NiFi processors, templates, and flows for scalability and reliability. Implement monitoring, alerting, and recovery strategies for NiFi flows and downstream processes. Integrate NiFi with AWS services such as S3, Lambda, Redshift, Glue, Kinesis, and RDS. Ensure data quality, integrity, and compliance across pipelines. Work closely with data analysts, architects, and business teams to define data requirements and delivery models. Do...

You are a skilled Data Engineer with over 4 years of experience, seeking a role in Trivandrum (Hybrid) for a contract duration of 6+ months in IST shift. Your main responsibility will be to design and develop data warehouse solutions utilizing Azure Synapse Analytics, ADLS, ADF, Databricks, and Power BI. You will be involved in building and optimizing data pipelines, working with large datasets, and implementing automation using DevOps/CI/CD frameworks. Your expertise should lie in Azure, AWS, Terraform, ETL, Python, and data lifecycle management. You will collaborate on architecture frameworks and best practices while working on data warehouse design and implementation. In this role, you wi...

Salary: 25 to 40 LPA Exp: 5 to 10 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Da...

The Data Engineer should have strong data infrastructure and data architecture skills, a proven track record of administration for data engineering teams, strong operational skills to drive efficiency and speed, strong project management skills, and a core value base for how analytics can proactively improve organizations. You will be part of the Data & Analytics team and will partner closely with a team of data scientists, business analysts & business intelligence leading a cloud-based strategy for our clients. You'll work on our Azure based data pipeline projects with a focus on collecting, parsing, managing, analyzing and visualizing large sets of data to turn information into insights us...

Job description Role & responsibilities Design, implement, configure, and maintain both the Moogsoft AIOps platform and the Apex AIOps Incident Management platform. Develop and manage integrations between Moogsoft, Apex AIOps, and other relevant IT monitoring, logging, and ITSM tools. Develop and implement automation workflows and runbooks within both AIOps platforms to streamline incident management and remediation processes. Collaborate with various IT teams (monitoring, application, infrastructure, security, operations) to understand their AIOps requirements and translate them into effective solutions on both platforms. Define and enforce best practices for the configuration, utilization,...

We are seeking Data Engineers (GCP) who can develop and maintain a high-performance streaming data platform for a leading healthcare CRM product. You will work across technologies like Python, PySpark, SQL, Continuous Integration/ Continuous Development, Kafka, GCP - BigQuery, Google cloud Compute, Looker, Data Modelling. Required Skill Set: Programming & Data Engineering: Python, PySpark, SQL, CICD Streaming & Orchestration: Kafka, GCP Composer/Airflow Cloud Tools: Google Cloud Platform (Dataproc, BigQuery, Looker) Data Architecture: Data Warehousing, Data Modeling Location : Manyata Tech Park, Bengaluru Roles and Responsibilities Responsibilities: Design, develop, and maintain scalable dat...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You’ll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you’ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you’ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporatin...