16 Real-Time Processing Jobs

Write and manage ETL jobs to extract data from multiple sources and load into data marts Integrate data from various formats and systems, including databases, CSV files, XML files, and queues Handle data integration for batch, near real-time, and real-time processing Organize data across different aggregation levels and hierarchies Develop complex data transformation logic Proactively monitor and tune the performance of data jobs Design data integration jobs to be fault-tolerant and scalable Perform data quality checks, data modeling, and database-related tasks as needed

Location : Bangalore Experience : 3-10 years in R&D Employment Type : Full-time or Contract This is a research and development position requiring hands-on experience with real-world tracking projects, not theoretical knowledge alone. About StanceBeam Join StanceBeam, a pioneering sports technology startup revolutionising cricket through advanced computer vision and analytics. We're developing cutting-edge systems for broadcasting and Decision Review System (DRS) applications, specialising in precision ball and player tracking across cricket field distances. This R&D-focused position offers the unique opportunity to work on real-world challenges in sports technology - from developing algorith...

Builds vision-based AI solutions for facial recognition, AR/VR, and autonomous systems.You will work on end-to-end model development, from data collection and preprocessing to model training, optimization, and deployment.

Hi all, We are hiring for the role Cloud Data Engineer Experience: 7 - 9 years Location: Bangalore Notice Period: Immediate - 15 Days Skills: Overall, 7 to 9 years of experience in cloud data and analytics platforms such as AWS, Azure, or GCP • Including 3+ years experience with Azure cloud Analytical tools is a must • Including 5+ years of experience working with data & analytics concepts such as SQL, ETL, ELT, reporting and report building, data visualization, data lineage, data importing & exporting, and data warehousing • Including 3+ years of experience working with general IT concepts such as integrations, encryption, authentication & authorization, batch processing, real-time processi...

Design and develop data ingestion pipelines using Apache NiFi for structured, semi-structured, and unstructured data sources. Build and maintain real-time and batch processing workflows to ingest data into AWS-based data lakes or warehouses. Configure and optimize NiFi processors, templates, and flows for scalability and reliability. Implement monitoring, alerting, and recovery strategies for NiFi flows and downstream processes. Integrate NiFi with AWS services such as S3, Lambda, Redshift, Glue, Kinesis, and RDS. Ensure data quality, integrity, and compliance across pipelines. Work closely with data analysts, architects, and business teams to define data requirements and delivery models. Do...

Position Overview As a Sr. Principal Software Development Engineer, you will be a key technical leader responsible for defining the long-term architecture and engineering strategy of our enterprise-grade cybersecurity platform. You will drive the design and evolution of highly scalable, reliable, and secure systems, influencing not just components but the platform as a whole. Beyond hands-on technical contributions, you will mentor senior engineers and Principal SDEs, fostering excellence across the organization. This role requires close collaboration with cross-functional leaders in QA, UI, DevOps, Data Science, Ops, Product, and beyond, ensuring technology decisions align with business str...

Role & responsibilities: The Data Engineer, Specialist is responsible for building and maintaining scalable data pipelines to ensure seamless integration and efficient data flow across various platforms. This role involves designing, developing, and optimizing ETL (Extract, Transform, Load) processes, managing databases and leveraging big data technologies to support analytics and business intelligence initiatives. Preferred candidate profile: Design, develop and maintain scalable ETL (Extract, Transform, Load) processes to efficiently extract data from various structured and unstructured sources, ensuring accuracy, consistency and performance optimization. Architect and manage database syst...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Apache Kafka Good to have skills : NA Minimum 7.5 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will engage in problem-solving activities, part...

Hiring GCP Data Engineers (3–5 yrs) & Senior GCP Data Engineers (5–8 yrs). Skills: Python, SQL, BigQuery, Dataflow, Pub/Sub, Composer. Location: Remote/Hybrid/Onsite.

We are seeking a highly skilled and motivated Lead DS/ML engineer to join our team. The role is critical to the development of a cutting-edge reporting platform designed to measure and optimize online marketing campaigns. We are seeking a highly skilled Data Scientist / ML Engineer with a strong foundation in data engineering (ELT, data pipelines) and advanced machine learning to develop and deploy sophisticated models. The role focuses on building scalable data pipelines, developing ML models, and deploying solutions in production to support a cutting-edge reporting, insights, and recommendations platform for measuring and optimizing online marketing campaigns. The ideal candidate should be...

Key Deliverables : Architect and develop scalable systems for compensation and performance analytics. Build and manage robust real-time data pipelines. Define and enforce standards for code quality, security, and system reliability. Mentor engineers and foster cross-functional collaboration on the product roadmap. Role Responsibilities : Lead backend development and distributed systems design. Solve complex problems in high-throughput data processing. Influence consumer-grade product experiences with technical innovation. Communicate technical strategy clearly across diverse teams.

Senior Data Scientist - Machine Learning (Remote) ???? Join UnifyCX and Shape the Future of AI-Powered Customer Experience! ???? Who We Are: At UnifyCX , we are redefining customer experience (CX) through cutting-edge AI and automation . With a global presence spanning the U.S., India, Colombia, Jamaica, and more , we provide top-tier AI-driven contact center and business process solutions . Now, we're looking for a Senior Data Scientist - ML to help us push the boundaries of AI innovation and automation. Why Join Us ? Work remotely with a diverse, global AI team. ? Drive innovation by building domain-aware ML models for text, speech, and multimodal AI copilots. ? Own your impact in a fast-p...

partner globally with sponsors, users and engineering colleagues across multiple divisions to create end-to-end solutions, learn from experts, leverage various technologies depending on the team including; Java, JavaScript, TypeScript, React, APIs, GraphQL, Elastic Search, Kafka, Kubernetes, Machine Learning be able to innovate and incubate new ideas, have an opportunity to work on a broad range of problems, often dealing with large data sets, including real-time processing, messaging, workflow and UI/UX be involved in the full life cycle; defining, designing, implementing, testing, deploying, and maintaining software across our products. QUALIFICATIONS A successful candidate will possess th...

Hi all, We are hiring for the role Cloud Data Engineer Experience: 7 - 9 years Location: Bangalore Notice Period: Immediate - 15 Days Skills: Overall, 7 to 9 years of experience in cloud data and analytics platforms such as AWS, Azure, or GCP • Including 3+ years experience with Azure cloud Analytical tools is a must • Including 5+ years of experience working with data & analytics concepts such as SQL, ETL, ELT, reporting and report building, data visualization, data lineage, data importing & exporting, and data warehousing • Including 3+ years of experience working with general IT concepts such as integrations, encryption, authentication & authorization, batch processing, real-time processi...

We are seeking a Robotics Engineer with 10-15 years of experience to join our innovative team in India. The ideal candidate will have a strong background in designing and developing robotic systems, with a focus on integrating advanced technologies and ensuring reliability and efficiency. Responsibilities Design, develop, and test robotic systems and components. Collaborate with cross-functional teams to integrate robotics with existing systems. Conduct feasibility studies and simulations to assess project viability. Troubleshoot and resolve issues with robotic systems and software. Maintain documentation of designs, processes, and modifications. Skills and Qualifications Bachelor's or Maste...

1. Deep expertise in TensorFlow 2. Hands-on with MLOps toolchains (Kubeflow, MLflow), 3. Familiarity with GenAI concepts (LLM fine-tuning) embeddings, RAG, 4. Designing compute clusters (GPU/CPU), cost-optimization strategies, 5.Serverless vs. containerized deployments, autoscaling, 6. High-throughput, zero-downtime system design,Strong command of microservices, API design, event-driven patterns, 7. Building and optimizing data pipelines (Airflow/Spark) 8. Real-time processing and analytics/reporting