391 Apache Flink Jobs - Page 2

The impact youll make Enable rapid, responsible releases by coding evaluation pipelines that surface safety issues before models reach production. Drive operational excellence through reliable, secure, and observable systems that safety analysts and customers trust. Advance industry standards by contributing to bestpractice libraries, opensource projects, and internal frameworks for testing alignment, robustness, and interpretability. What youll do Design & implement safety toolingfrom automated adversarial test harnesses to driftmonitoring dashboardsusing Python, PyTorch/TensorFlow, and modern cloud services. Collaborate across disciplines with fellow engineers, data scientists, and product...

The impact youll make Enable rapid, responsible releases by coding evaluation pipelines that surface safety issues before models reach production. Drive operational excellence through reliable, secure, and observable systems that safety analysts and customers trust. Advance industry standards by contributing to bestpractice libraries, opensource projects, and internal frameworks for testing alignment, robustness, and interpretability. What youll do Design & implement safety toolingfrom automated adversarial test harnesses to driftmonitoring dashboardsusing Python, PyTorch/TensorFlow, and modern cloud services. Collaborate across disciplines with fellow engineers, data scientists, and product...

The impact youll make Enable rapid, responsible releases by coding evaluation pipelines that surface safety issues before models reach production. Drive operational excellence through reliable, secure, and observable systems that safety analysts and customers trust. Advance industry standards by contributing to bestpractice libraries, opensource projects, and internal frameworks for testing alignment, robustness, and interpretability. What youll do Design & implement safety toolingfrom automated adversarial test harnesses to driftmonitoring dashboardsusing Python, PyTorch/TensorFlow, and modern cloud services. Collaborate across disciplines with fellow engineers, data scientists, and product...

The impact youll make Enable rapid, responsible releases by coding evaluation pipelines that surface safety issues before models reach production. Drive operational excellence through reliable, secure, and observable systems that safety analysts and customers trust. Advance industry standards by contributing to bestpractice libraries, opensource projects, and internal frameworks for testing alignment, robustness, and interpretability. What youll do Design & implement safety toolingfrom automated adversarial test harnesses to driftmonitoring dashboardsusing Python, PyTorch/TensorFlow, and modern cloud services. Collaborate across disciplines with fellow engineers, data scientists, and product...

Head of Engineering, AI Safety Services Enable responsible AI innovation at the speed of progress. The impact youll make Accelerate responsible innovation by providing world-class AI safety services that allow our customers to quickly deploy new models and applications without compromising on safety. Influence the industry by establishing best practices, scalable tools, and clear benchmarks that set the standard for AI safety. Drive customer success through tools and platforms that integrate seamlessly into customer workflows, enabling safe and rapid innovation. What youll do Lead and inspire your team (AI engineers, platform engineers, and a product manager): Set clear goals, mentor team me...

Head of Engineering, AI Safety Services Enable responsible AI innovation at the speed of progress. The impact youll make Accelerate responsible innovation by providing world-class AI safety services that allow our customers to quickly deploy new models and applications without compromising on safety. Influence the industry by establishing best practices, scalable tools, and clear benchmarks that set the standard for AI safety. Drive customer success through tools and platforms that integrate seamlessly into customer workflows, enabling safe and rapid innovation. What youll do Lead and inspire your team (AI engineers, platform engineers, and a product manager): Set clear goals, mentor team me...

Head of Engineering, AI Safety Services Enable responsible AI innovation at the speed of progress. The impact youll make Accelerate responsible innovation by providing world-class AI safety services that allow our customers to quickly deploy new models and applications without compromising on safety. Influence the industry by establishing best practices, scalable tools, and clear benchmarks that set the standard for AI safety. Drive customer success through tools and platforms that integrate seamlessly into customer workflows, enabling safe and rapid innovation. What youll do Lead and inspire your team (AI engineers, platform engineers, and a product manager): Set clear goals, mentor team me...

Educational Requirements Bachelor of Engineering Service Line Information Systems Responsibilities Deploy, configure, and manage Kafka clusters across development, staging, and production environments. Ensure platform reliability, scalability, and performance through proactive monitoring, tuning, and capacity planning. Manage and maintain Kafka components such as Kafka Connect, Schema Registry, and REST Proxy. Implement platform-level security including access controls, TLS encryption, and audit logging. Monitor platform health using observability tools and respond to alerts and incidents. Collaborate with application and data engineering teams to support integration and usage of Kafka. Main...

Job Title: Executive - Data Engineer Overview: As a Senior Data Engineer, you will play a pivotal role in designing, implementing, and maintaining the data infrastructure of our organization. You will be responsible for developing robust data pipelines, optimizing data workflows, and ensuring the reliability and scalability of our data systems. Collaboration with cross-functional teams including data scientists, software engineers, and business analysts will be essential to drive data-driven decision-making and support various business initiatives. Responsibilities: 1. Data Pipeline Development: - Design, build, and maintain scalable data pipelines to ingest, process, and transform large vol...

Description: About The Role :: Minimum 5 years of experience in a data-driven information environment, designing and implementing analytic/data systems, ideally in a IOT context Detail-oriented and comfortable working with requirements that are open-ended Experience and familiarity with big data tools and services, such as Kafka, AWS, S3, Flink, Spark, Lambda, Experience working in a cloud-based environment, ideally familiar with the AWS toolset Expertise in one or more programming languages (Java mandatory, Scala and Python beneficial) Comfort with software development methodology around unit testing, performance tuning ,integration testing, etc. Experience in real-time data processing Name...

Monday to Friday (WFO) Timings : 9 am to 6 pm Desired Skills Expertise: Strong experience and mathematical understanding in one or more of Natural Language Understanding, Computer Vision, Machine Learning, and Optimization Proven track record in effectively building and deploying ML systems using frameworks such as PyTorch, TensorFlow, Keras, scikit-learn, etc. Expertise in modular, typed, and object-oriented Python programming Proficiency with core data science languages (such as Python, R, Scala), and familiarity & flexibility with data systems (e.g., SQL, NoSQL, knowledge graphs) Experience with financial data analysis, time series forecasting, and risk modeling Knowledge of financial reg...

4 Years Data Engineering Experience 5 years of consulting experience Completed Data Engineering Professional certification & required classes Minimum 2-3 projects delivered with hands-on experience in Databricks Completed Apache Spark Programming with Databricks, Data Engineering with Databricks, Optimizing Apache Spark on Databricks Experience in Spark and or Hadoop, Flink, Presto, other popular big data engines Familiarity with Databricks multi-hop pipeline architecture

Serko is a cutting-edge tech platform in global business travel & expense technology. When you join Serko, you become part of a team of passionate travellers and technologists bringing people together, using the world's leading business travel marketplace. We are proud to be an equal opportunity employer, we embrace the richness of diversity, showing up authentically to create a positive impact. There's an exciting road ahead of us, where travel needs real, impactful change. With offices in New Zealand, Australia, North America, and China, we are thrilled to be expanding our global footprint, landing our new hub in Bengaluru, India. With a rapid growth plan in place for India, we're hiring p...

Serko is a cutting-edge tech platform in global business travel & expense technology. When you join Serko, you become part of a team of passionate travellers and technologists bringing people together, using the world's leading business travel marketplace. We are proud to be an equal opportunity employer, we embrace the richness of diversity, showing up authentically to create a positive impact. There's an exciting road ahead of us, where travel needs real, impactful change. With offices in New Zealand, Australia, North America, and China, we are thrilled to be expanding our global footprint, landing our new hub in Bengaluru, India. With a rapid growth plan in place for India, we're hiring p...

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...

We have developed API gateway aggregators using frameworks like Hystrix and spring-cloud-gateway for circuit breaking and parallel processing. Our serving microservices handle more than 15K RPS on normal days and during saledays this can go to 30K RPS. Being a consumer app, these systems have SLAs of ~10ms Our distributed scheduler tracks more than 50 million shipments periodically fromdifferent partners and does async processing involving RDBMS. We use an in-house video streaming platform to support a wide variety of devices and networks. What Youll Do Design and implement scalable and fault-tolerant data pipelines (batch and streaming) using frameworks like Apache Spark , Flink , and Kafka...

5+ years of hands-on experience in predictive modeling, analysis and machine learning 5+ years of experience in using R, Python, Matlab or similar languages Orientation in modern standards and technical trends

Key Responsibilities: Develop, configure, and optimize Apache DolphinScheduler workflows for data processing and automation. Design and implement ETL pipelines, job scheduling, and workflow orchestration solutions. Troubleshoot and resolve performance, scalability, and reliability issues in DolphinScheduler. Integrate DolphinScheduler with big data tools such as Hadoop, Spark, Flink, Hive, and Kafka. Work closely with data engineers, DevOps, and software teams to enhance workflow automation. Develop custom plugins and extensions for DolphinScheduler as needed. Monitor and optimize job execution, resource allocation, and workflow efficiency. Maintain best practices for CI/CD, version control,...

Technical Skills Kafka platform knowledge like broker zookeepers replicators connectors etc.. Kafka implementation testing and platform design Kubernetes Docker and Helm Charts OpenShift EKS GKE working experience Event Driven design and development Kafka security Java Spring Spring Boot Java stream processing implementation and design Micro-Service Driven Architecture Principles Observability frameworks AWS/GCP Cloud familiarity CodeFresh / similar CI/CD tools KSQLDB and Flink Data Streaming DevOps Infrastructure as Code Mentality Additional Details Global Grade : C Level : To Be Defined Named Job Posting(if Yes - needs to be approved by SCSC) : No Remote work possibility : No Global Role F...

IT Operation L2 Application Support Engineer with 5 years of experience The successful candidate will be responsible for providing advanced technical support, troubleshooting complex issues, and ensuring the smooth operation of IT systems and applications. This role requires a proactive individual who can manage incidents, perform root cause analysis, and implement solutions to prevent future occurrences. strong experience working with Apache Kafka in a production environment. Strong knowledge of Kafka architecture, including brokers, topics, partitions, and replicas. Experience with Kafka security, including SSL, SASL, and ACLs. Proficiency in configuring, deploying, and managing Kafka clus...

About The Role Job Title :Industry & Function AI Data Engineer + S&C GN Management Level :09 - Consultant Location :Primary - Bengaluru, Secondary - Gurugram Must-Have Skills :Data Engineering expertise, Cloud platforms:AWS, Azure, GCP, Proficiency in Python, SQL, PySpark and ETL frameworks Good-to-Have Skills :LLM Architecture, Containerization tools:Docker, Kubernetes, Real-time data processing tools:Kafka, Flink, Certifications like AWS Certified Data Analytics Specialty, Google Professional Data Engineer,Snowflake,DBT,etc. Job Summary : As a Data Engineer, you will play a critical role in designing, implementing, and optimizing data infrastructure to power analytics, machine learning, an...

Hello Visionary! We empower our people to stay resilient and relevant in a constantly changing world. Were looking for people who are always searching for creative ways to grow and learn. People who want to make a real impact, now and in the future. Does that sound like you? Then it seems like youd make a great addition to our vibrant team. We are looking for a Backend Engineer (Java or Golang). This position is for Pune Location. Youll make a difference by Being responsible for designing and developing cloud native backend services using Golang or Java . Being Good with any one Technology Either Golang/Java backend/microservices Development. Having experience on streaming processing using K...

Skill set: 1. Solid coding skills in languages such as SQL/Python/Java/Scala. 2. Proficiency in Spark/Flink/Hive/Hadoop/Azure/Databricks for batch and real-time processing. 3. Solid understanding of data pipeline, data warehousing and data modelling. 4. Experience with data visualization tools like QlikSense or PowerBI. 5. Experience with data governance framework. 6. Exposure to cloud, Full stack (Angular, etc.) preferred. Responsibilities: 1. Design, build, and maintain efficient and reliable ETL pipelines to process and analyze large volumes of data from various sources. 2. Define and build data architecture for a trusted, governed repository of data. 3. Maintain a documented data warehou...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Apache Kafka, Apache Spark Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding the team in implementing effective solutions. ...

About the Role Were seeking a highly skilled Data Engineer with a strong development background and a passion for transforming data into valuable insights. The ideal candidate will play a key role in designing, building, and maintaining scalable data pipelines and analytics solutions that support critical business decisions. What youll be doing Design, build, and optimize robust data pipelines for large-scale data processing Write complex SQL queries for data extraction, transformation, and reporting Collaborate with analytics and reporting teams to deliver data-driven insights Develop scalable solutions using programming languages such as Java, Python, and Node.js Integrate APIs and third-p...