11 Streaming Frameworks Jobs

Role Overview: You will be joining the client's AI engineering team as a Senior Data Engineer specializing in AI & Manufacturing Intelligence. Your primary responsibility will be to lead and own the data foundation of the AI operating system for advanced manufacturing and battery R&D. This involves handling massive volumes of battery, equipment, and process data to provide actionable intelligence for engineers, significantly reducing root cause analysis time and preventing scrap and downtime. Key Responsibilities: - Design and own scalable data ingestion pipelines for battery testing data, equipment and sensor data, and process recipes using Snowflake, Databricks, AWS, and GCP-based data ser...

Job Description: Design and maintain distributed data infrastructure , ETL/ELT pipelines , and real-time data processing systems . Collaborate with cross-functional teams to build scalable data solutions, modernize applications, and establish best practices for data engineering. Must-Have Skills 5--7 years in software engineering with strong data engineering focus. Expertise in OOP , design patterns , and algorithm optimization . Proficient in Python (Java/Scala is a plus). Deep experience with ETL/ELT pipelines , data integration , and distributed computing frameworks . Strong knowledge of real-time data processing and streaming frameworks . Hands-on experience with cloud data platforms (AW...

Data Engineer Location: Bangalore Mode: Hybrid Role Overview We are seeking an experienced Data Engineer to design, build, and optimize data pipelines and solutions on modern big data platforms. The ideal candidate will have strong expertise in PySpark , Databricks , and distributed data processing frameworks, with a passion for delivering scalable and efficient data solutions. Key Responsibilities Design, develop, and maintain ETL pipelines using PySpark and Databricks . Work with large-scale datasets to ensure data quality, integrity, and availability. Optimize data workflows for performance and cost efficiency in cloud environments (Azure/AWS/GCP). Collaborate with data scientists, analys...

Senior Developer 7+ tech lead 11+ lead developer 9+ Java/JRE, Spring Boot, API development. AWS (EC2, S3, Lambda, AuroraDB, SQS, Kinesis). Streaming frameworks: Autobahn, Flink. Databases: AuroraDB, MySQL, SQL Server, Snowflake. ETL and data integration experience.

As a DataOps Engineer, you will be responsible for designing and maintaining scalable ML model deployment infrastructure using Kubernetes and Docker. Your role will involve: - Implementing CI/CD pipelines for ML workflows - Ensuring security best practices are followed - Setting up monitoring tools to track system health, model performance, and data pipeline issues To excel in this role, you should have: - Strong experience with Kubernetes and Docker for containerization and orchestration - Hands-on experience in ML model deployment in production environments - Proficiency with orchestration tools like Airflow or Luigi - Familiarity with monitoring tools such as Prometheus, Grafana, or ELK S...

Role Overview: As a Staff Engineer, you will lead the evolution of a next-generation, privacy-first advertising platform by embedding machine learning and generative AI into various layers of the system. Your responsibilities will include defining a technical roadmap, architecting ad-serving systems with AI, building ML pipelines, collaborating with data scientists, designing fault-tolerant systems, ensuring privacy compliance, leading platform initiatives, mentoring engineers, and influencing architectural decisions. Key Responsibilities: - Define the multi-year technical roadmap considering innovation, revenue, and regulatory requirements. - Architect low-latency, high-throughput ad-servin...

In this role as a Backend Developer / Data Engineer, your primary responsibility will be to lead and guide a team of Data Engineers in translating business requirements into analytical products to generate new insights. You will play a key role in driving the transformation journey of the company towards becoming data-driven in the future. **Key Responsibilities:** - Drive technical implementation and ensure accountability for strategy and execution - Define the scope of Minimum Viable Product (MVP) for upcoming initiatives and create a roadmap for future enhancements - Collaborate with data owners to plan and execute key initiatives - Monitor the performance and quality of integration pipel...

As a DataOps Engineer, your primary responsibility will be designing and maintaining scalable ML model deployment infrastructure using Kubernetes and Docker. You will need to implement CI/CD pipelines for ML workflows, ensure adherence to security best practices, and set up monitoring tools for tracking system health, model performance, and data pipeline issues. Collaboration with cross-functional teams to optimize the end-to-end lifecycle of data products and identify performance bottlenecks and data reliability issues in the ML infrastructure will also be part of your role. Key Responsibilities: - Design and maintain scalable ML model deployment infrastructure using Kubernetes and Docker -...

Role Overview: As a Staff Engineer, you will play a crucial role in leading the evolution of a next-generation, privacy-first advertising platform. Your primary responsibility will be to embed machine learning and generative AI into various layers of the platform to enhance ad targeting, bidding, attribution, fraud prevention, and creative optimization. Your contributions will be instrumental in defining speed, reliability, and innovation within a system that processes millions of requests per second and billions of events daily. Key Responsibilities: - Define the multi-year technical roadmap, considering innovation, revenue, and regulatory requirements. - Architect low-latency, high-through...

As a Backend developer / Data Engineer at Siemens Energy, you will lead a team of Data Engineers to translate business requirements into analytical products and drive the company's transformation into a data-driven organization. You will play a pivotal role in the energy transition by contributing to the Data Analytics & AI team. Your responsibilities will include driving technical implementation and strategy execution, defining the Minimum Viable Product (MVP) scope, collaborating with data owners, ensuring the performance and quality of integration pipelines, and promoting data literacy through self-service visualization capabilities for end users. To excel in this role, you should have ex...

As a DataOps Engineer, you will be responsible for designing and maintaining scalable ML model deployment infrastructure using Kubernetes and Docker. Your role will involve implementing CI/CD pipelines for ML workflows, ensuring security best practices are followed, and setting up monitoring tools to track system health, model performance, and data pipeline issues. You will collaborate with cross-functional teams to streamline the end-to-end lifecycle of data products and identify performance bottlenecks and data reliability issues in the ML infrastructure. To excel in this role, you should have strong experience with Kubernetes and Docker for containerization and orchestration, hands-on exp...