7560 Data Processing Jobs - Page 49

Design, develop, and maintain a robust, end-to-end data analytics pipeline for real-time data processing and visualization. Take ownership of the entire project lifecycle, from architectural design and component integration to deployment, security, and presentation. Work on data analytics platform (on GKE/GDC air gapped) to provide real-time hot spot prediction and ride recommendations for taxi drivers. The application will use the NYC taxi dataset and showcase the capabilities of Kafka, Spark, HBase, Solr, Trino, Apache Airflow, Apache Superset and Apache Ranger. Requirements Must Have: Big Data Ecosystem: Apache Kafka, Apache Spark, HBase, Apache Solr, and Trino Tools & Orchestration: Apac...

Design, develop, and maintain simulation services and tools for ML feature , model , and rule evaluation. Build and optimize data pipelines for point-in-time historical data access and feature backfilling. Containerize and deploy ML models and services using Docker and Seldon on Kubernetes clusters. Integrate with Client s cloud infrastructure (GCP) and internal APIs for seamless simulation workflows. Collaborate with data scientists, ML engineers, and QA to deliver robust, scalable solutions. Contribute to CI/CD pipelines and DevOps practices for automated testing, deployment, and monitoring. Write clean, maintainable, and well-documented code using Python and related SDKs. Participate in c...

ZiniosEdge Software Technologies Pvt Ltd is looking for AI Engineer to join our dynamic team and embark on a rewarding career journey Designing and developing AI algorithms and models to solve specific business problems Creating and maintaining databases for storing and processing large amounts of data Developing and deploying machine learning and deep learning models Implementing and integrating AI solutions with existing systems and software Analyzing and interpreting complex data sets to extract insights and drive decision-making Collaborating with cross-functional teams to develop and deploy AI applications Ensuring the security and privacy of data used in AI applications Communicating a...

The incumbent would be responsible for designing, implementing, and optimizing vector databases that enable high-performance, large-scale data processing and retrieval. You will work closely with our data science, machine learning, and software engineering teams to build robust solutions that support our clients data-intensive applications. What you will do Design, implement, and manage vector databases to support large-scale data storage and retrieval, ensuring low latency and high availability. Develop efficient data models that facilitate fast vector operations such as similarity search, nearest neighbor search, and other vector-based queries. Optimize database performance through indexin...

Were looking for a Data Engineer to modernize our data infrastructure, evaluate our large-scale Couchbase system, and potentially migrate to MySQL or a hybrid solution. You ll build reliable data feeds to partners like Google, Amazon, and Feedonomics, and create dashboards and reports for finance and leadership teams. Our core stack is Ruby on Rails, with Python used for data processing. Strong communication skills are essential for working with our U.S.-based team. Responsibilities: Assess and implement the best long-term data storage approach (Couchbase MySQL, on-premises, or hybrid). Build and maintain ETL/ELT pipelines in Ruby (with Python where appropriate). Create and manage data feeds...

The ideal candidate will have a solid understanding of data integration, transformation, and deployment processes and should be able to work independently as well as collaboratively with cross-functional teams Key Responsibilities: Design, develop, and maintain ETL pipelines using Java and SQL Understand complex data models and build efficient transformation logic Optimize existing data pipelines for performance and scalability Collaborate with data engineers, analysts, and business stakeholders to understand data requirements Ensure proper data quality and validation during the ETL process Participate in deployment processes including CI/CD and production support Mandatory Skills: Proficien...

We are looking for a skilled GCP Data Engineer with 3 to 6 years of experience to join our dynamic team. The ideal candidate will have a strong background in data engineering, cloud technologies, and experience with Google Cloud Platform (GCP) services. You will be responsible for designing, building, and maintaining scalable data pipelines and frameworks that support our data analytics and machine learning initiatives. Responsibilities Key Responsibilities: Design and implement data pipelines using GCP services such as BigQuery, Dataflow, and Pub/Sub. Collaborate with data scientists and analysts to understand data needs and deliver appropriate solutions. Optimize data storage and processin...

Java development with hands-on experience in Spring Boot. Strong knowledge of UI frameworks, particularly Angular, for developing dynamic, interactive web applications. Experience with Kubernetes for managing microservices-based applications in a cloud environment. Familiarity with Postgres (relational) and Neo4j (graph database) for managing complex data models. Experience in Meta Data Modeling and designing data structures that support high-performance and scalability. Expertise in Camunda BPMN and business process automation. Experience implementing rules with Drools Rules Engine. Knowledge of Unix/Linux systems for application deployment and management. Experience building data Ingestion...

":" As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements. You will work on developing solutions to enhance business operations and streamline processes. Roles & Responsibilities: - Expected to perform independently and become an SME. - Required active participation/contribution in team discussions. - Contribute in providing solutions to work related problems. - Collaborate with cross-functional teams to analyse business requirements and translate them into technical solutions. - Develop and implement software solutions using Microsoft Azure Databricks. - Troubleshoot and debug applicat...

Role Purpose Wipro Ltd. is looking for a Analyst(Customer Service) role for our Insurance Business into a International Blended Campaign. Provides an administrative support service within specified guidelines and Aviva brand values. Responds to customers enquiries where basic analysis and the provision of information is needed in order to resolve the issue, escalating where necessary. Gains the trust of the customer through the provision of accurate and timely information and support services. Records all information accurately on appropriate systems. Responsible for spotting opportunities for service and process improvement and feeding suggestions to manager. Make outbound calls to client/ ...

Skill: Azure Databricks Experience: 6 to 9 years Location: AIA Kochi Job Summary We are looking for a Sr. Developer with 6 to 9 years of experience to join our team. The ideal candidate will have strong expertise in PySpark and Databricks and will work from our office during day shifts. This role does not require travel. The Sr. Developer will contribute to the development and optimization of our data processing systems ensuring efficient and reliable data workflows. Responsibilities Develop and maintain scalable data processing systems using PySpark and Databricks Collaborate with data engineers and analysts to design and implement data pipelines Optimize and troubleshoot existing data work...

Role Purpose Wipro Ltd. is looking for a Associate (Customer Service) role for our Insurance Business into a International Blended Campaign. 1.Maintains quality service by enforcing quality standards, analyzing and resolving client's problems, and recommending system improvements 2.Maintain productivity targets 3.Ensure all the emails are responded within time 4.Timely completion of the task,ongoing quality service delivery of the task assigned. 5.Complying to all Data Security and Code of Conduct standards 6.Carrying out data entry and rule based entry for processes and performing simple process calculations 7. Make outbound calls to client/ stakeholders with the defined call tree 8. Mainta...

Skill: Snowflake Developer Experience: 6 to 9 years Location: AIA Kochi Job Description: • Be a technical guide on all aspects of Snowflake • Deploy Snowflake following best practices, including ensuring knowledge transfer so that customers are properly enabled and are able to extend the capabilities of Snowflake on their own • Work hands-on with customers to demonstrate and communicate implementation best practices on Snowflake technology • Maintain deep understanding of competitive and complementary technologies and vendors and how to position Snowflake in relation to them • Work with System Integrator consultants at a deep technical level to successfully position and deploy Snowflake in c...

EY GDS Data and Analytics (D&A) Azure/Databricks - Senior We re looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team. Your key responsibilities Architecting big data solutions in a cloud environment using Azure Cloud services ETL design, development, and deployment to Cloud Service Interact with Onshore, understand their business goals, contribute to the delivery of the workstreams Develop standardized practices for delivering new products and capabilities using Big Data technologies, including da...

EY-Advisory - Data and Analytics Snowflake Data Engineer EYs Advisory Services is a unique, industry-focused business unit that provides a broad range of integrated services that leverage deep industry experience with strong functional and technical capabilities and product knowledge. EY s financial services practice provides integrated advisory services to financial institutions and other capital markets participants, including commercial banks, retail banks, investment banks, broker-dealers & asset management firms, and insurance firms from leading Fortune 500 Companies. Within EY s Advisory Practice, Data and Analytics team solves big, complex issues and capitalize on opportunities to del...

We are currently looking for a Senior Software Engineer based in Pune with a proven experience in implementing high scale data-processing applications to work on building the Real-time Reporting & Analytics pipeline at Zendesk. As a Senior Software Engineer, you would contribute to designing, implementing, refactoring and optimising systems with ownership on major project components. The ideal candidate has experience in building large-scale cloud applications preferably in a SaaS environment and has previously contributed to real-time data processing, while partnering with team stakeholders. What youll be doing Solve complex problems and make decisions about technical tradeoffs that optimis...

Job Purpose and Impact The Senior Professional, Data Engineering job designs, builds and maintains complex data systems that enable data analysis and reporting. With minimal supervision, this job ensures that large sets of data are efficiently processed and made accessible for trading decision making. Key Accountabilities DATA INFRASTRUCTURE: Prepares data infrastructure to support the efficient storage and retrieval of data. DATA FORMATS: Examines and resolves appropriate data formats to improve data usability and accessibility across the organization. DATA & ANALYTICAL SOLUTIONS: Develops complex data products and solutions using advanced engineering and cloud based technologies, ensuring ...

Job Description Data Engineer (Snowflake, dbt, Airflow, Insurance Domain) Position Data Engineer Rank- Senior Experience 5 8 years Employment Type Full-time Overview We are seeking an experienced Data Engineer with strong expertise in Snowflake, dbt, and Astronomer- Airflow, along with a solid understanding of insurance business processes. This role will focus on building and optimizing scalable data pipelines, ensuring data quality, and enabling analytics capabilities for insurance data sets. Key Design, develop, and maintain ELT data pipelines using Snowflake, dbt, and Airflow. Build and optimize data models in Snowflake to support analytics and reporting requirements. Implement data trans...

At Fiserv, we are seeking an experienced and visionary Java Architect to lead the technical direction of our software projects. The ideal candidate will have extensive hands-on experience in Java development and a deep understanding of enterprise-level architecture, design patterns and best practices. The ability to think tactically as well as strategically and to articulate your expectations to a mixed team of engineers and senior level developers is critical to success in this role. In addition to these important skills, it is imperative that you can summarize technical issues relating to software implementation, function, and upgrades and prepare written and verbal updates to senior level...

Brickwork Ratings (BWR) is one of India s leading credit rating agencies, committed to providing the investment community with products and services needed to make informed investment decisions. Established in 2007, Brickwork Ratings, a SEBI-registered and RBI-accredited credit rating agency, has Canara Bank, a leading public sector bank as its promoter and strategic partner. BWR is headquartered in Bengaluru and has a pan-India presence. The rating team is headed by the analytical prowess of the industry s most experienced credit analysts and bankers. BWR offers rating services to Bank Loans, NCD, Commercial papers, Bonds, Mutual Funds, PPMLDs, and Security Receipts. BWR s ratings have rate...

Overview Bray Leino Labs AI Data Engineer Pune, India Hybrid working pattern (Mon, Tue, Wed in office days) Immediate joiners are preferred About Bray Leino Labs Bray Leino Labs is a full-funnel marketing and technology agency, part of The MISSION Group Plc. With offices in London and across the Asia-Pacific region, we help businesses unlock growth through innovative MarTech, data activation, and user-centric digital solutions. Founded in 2007, we ve built our reputation on expertise, collaboration, and a passion for excellence. We are proud to be part of the Bray Leino family one of the top 5 B2B agencies in the UK combining marketing creativity with cutting-edge technology to deliver measu...

Overview Bray Leino Labs Full Stack Developer Pune, India Hybrid working pattern (Mon, Tue, Wed in office days) Immediate joiners are preferred About Bray Leino Labs Bray Leino Labs is a full-funnel marketing and technology agency, part of The MISSION Group Plc. With offices in London and across the Asia-Pacific region, we help businesses unlock growth through innovative MarTech, data activation, and user-centric digital solutions. Founded in 2007, we ve built our reputation on expertise, collaboration, and a passion for excellence. We are proud to be part of the Bray Leino family one of the top 5 B2B agencies in the UK combining marketing creativity with cutting-edge technology to deliver m...

Why Lytx: As a Staff Software Engineer, you ll work with industry leading Lytx Safety Software, which manages massive amounts of video and data collected from over 700,000 vehicles worldwide and ensures the best possible outcomes by identifying behaviors and events that impact safety. Be responsible for building solutions that collect, organize, and present information for tracking the safety and efficiency of commercial transportation drivers and fleets. Lead projects, establish engineering best practices, mentor junior engineers, and collaborate across Agile teams. Using Video Telematics, Machine Vision, and AI to derive intelligent insights for all devices and vehicles on our network, you...

About ShyftLabs ShyftLabs is a fast-growing data product company founded in early 2020, working primarily with Fortune 500 clients. We design and deliver cutting-edge digital and data-driven solutions that help businesses accelerate growth, improve decision-making, and create measurable value through innovation. Position Overview We re looking for an experienced Data Engineer who s passionate about building scalable, high-performance data solutions. In this role, you ll collaborate with cross-functional teams-including Data Engineers, Analysts, and Product Managers-to design, implement, and maintain robust data pipelines and systems that power our clients most critical business decisions. Ke...

Were proud to be recognized as a Great Place to Work , a testament to our inclusive culture, strong leadership, and commitment to employee well-being and growth. At Tarento, you ll be part of a collaborative environment where ideas are valued, learning is continuous, and careers are built on passion and purpose. We are looking for a Senior Software Engineer to join CO360, a key component of Ingka s Retail Platform. Come help us build and evolve the capabilities that establish CO360 as the System of Truth for order data globally. This is an opportunity for a highly motivated person to join a very skilled and fun team in Order Management Location: Bangalore (Manyata Tech Park) or Noida (Sector...