83 Streaming Jobs - Page 4

The Job We are looking out for a Sr Data Engineer responsible to Design, Develop and Support Real Time Core Data Products to support TechOps Applications. Work with various teams to understand business requirements, reverse engineer existing data products and build state of the art performant data pipelines. AWS is the cloud of choice for these pipelines and a solid understand and experience of architecting , developing and maintaining real time data pipelines in AWS Is highly desired. Design, Architect and Develop Data Products that provide real time core data for applications. Production Support and Operational Optimisation of Data Projects including but not limited to Incident and On Call Support , Performance Optimization , High Availability and Disaster Recovery. Understand Business Requiremensts interacting with business users and or reverse engineering existing legacy data products. Mentor and train junior team members and share architecture , design and development knowdge of data products and standards. Mentor and train junior team members and share architecture , design and development knowdge of data products and standards. Good understand and working knowledge of distributed databases and pipelines. Your Profile An ideal candidate will have 4+ yrs of experience in Real Time Streaming along with hands on Spark, Kafka, Apache Flink, Java, Big data technologies, AWS and MSK (managed service kafka) AWS Distrubuited Database technologies including Managed Services Kafka, Managed Apache Flink, DynamoDB, S3, Lambda. Experience designing and developing with Apache Flink real time data products.(Scala experience can be considered) Experience with python and pyspark SQL Code Development AWS Solutions Architecture experience for data products is required Manage, troubleshoot, real time data pipelines in the AWS Cloud Experience with High Availability and Disaster Recovery Solutions for Real time data streaming Excellent Analytical, Problem solving and Communication Skills Must be self-motivated, and ability to work independently Ability to understand existing SQL and code and user requirements and translate them into modernized data products.

Job Title: AWS Data Engineer Hire Type: Fulltime Location: Hyderabad exp: Min 6+ years Only Immediate joiners Job Description: 6+ years of experience in data engineering, specifically in cloud environments like AWS. Proficiency in PySpark for distributed data processing and transformation. Solid experience with AWS Glue for ETL jobs and managing data workflows. Hands-on experience with AWS Data Pipeline (DPL) for workflow orchestration. Strong experience with AWS services such as S3, Lambda, Redshift, RDS, and EC2. Nice to have : Proficiency in Python and PySpark for data processing and transformation tasks. Deep understanding of ETL concepts and best practices. Familiarity with AWS Glue (ETL jobs, Data Catalog, and Crawlers). Experience building and maintaining data pipelines with AWS Data Pipeline or similar orchestration tools. Familiarity with AWS S3 for data storage and management, including file formats (CSV, Parquet, Avro). Strong knowledge of SQL for querying and manipulating relational and semi-structured data. Experience with Data Warehousing and Big Data technologies, specifically within AWS. if you are interested

Who we are looking for: The ACV Marketplace is growing! We are looking for software engineers that will help build new digital capabilities that allow our customers to make informed decisions when trading on our platform. As a Software Engineer at ACV Auctions you will develop, write, and modify code. You will work alongside software and production engineers to build and ship new features that optimize operational efficiency and drive growth. What you will do: Actively and consistently support all efforts to simplify and enhance the customer experience. Design, develop, and maintain code for our web-based applications. Collaborate with software and production engineers to design scalable services, plan feature roll-out, and ensure high reliability and performance of our products. Conduct code reviews, develop high-quality documentation, and build robust test suites for your products. Design and build complex systems that can scale rapidly with little maintenance. Design and implement effective service/product interfaces. Develop complex data models using common patterns like EAV, normal forms, append only, event sourced, or graphs. Able to lead and successfully complete software projects without major guidance from a manager/lead. Provide technical support for many applications within the technology portfolio. Respond to and troubleshoot complex problems quickly, efficiently, and effectively. Handle multiple competing priorities in an agile, fast-paced environment. Perform additional duties as assigned. What you will need: Ability to read, write, speak, and understand English. Bachelor’s degree in Computer Science, or a related technical discipline or equivalent practical experience. 3 years’ programming in Java, Preferred experience in second Language: Python , C#, or JavaScript. 3 years’ work with continuous integration and build tools. Deep knowledge in day-day tools and how they work including deployments, k8s, monitoring systems, and testing tools. Highly proficient in version control systems including trunk-based development, multiple release planning, cherry picking, and rebase. Proficient in databases (RDB), SQL, and can contribute to table definitions. Self-sufficient debugger who can identify and solve complex problems in code. Deep understanding of major data structures (arrays, dictionaries, strings). Experience with Domain Driven Design. Experience with containers and Kubernetes. Hands-on experience with Kafka or other event streaming technologies. Hands-on with micro-service architecture and restful service. #LI-NX1

A hands-on Java Architect/Lead with a stellar track record in designing and leading enterprise-grade applications. This role calls for someone with deep architectural insight, strong system design instincts, and the ability to mentor and guide technical teams toward building resilient, distributed platforms.T he ideal candidate will have strong expertise in Java , Spring Boot , and distributed streaming technologies like Kafka . Experience with Apache Storm is a plus. Key Competencies: 10+ years of robust Java development experience, including 5+ years in architecture or technical leadership Expertise in Java (JDK 17+), Spring Boot, and modular microservices architecture Proven delivery of large-scale applications using Kafka for messaging and event-driven designs Strong grasp of distributed system design, scalability engineering, and fault tolerance strategies Hands-on experience with CI/CD tooling and implementing DevOps best practices Preferred Skills: Experience with real-time stream processing using Apache Storm or similar technologies Containerization and orchestration using Docker and Kubernetes Familiarity with monitoring, logging, and performance tuning of distributed systems Qualifications: Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field Roles and Responsibilities Lead end-to-end software architecture for large-scale enterprise applications Design, develop, and maintain distributed systems using Java and Spring Boot Define technical strategy and roadmaps in alignment with business goals Guide and mentor the development team through technical decisions and best practices Collaborate with stakeholders across engineering, product, and operations Ensure high performance, scalability, and resilience of applications Oversee integration of real-time data pipelines using Kafka Evaluate and incorporate Apache Storm for stream processing (where applicable) Conduct code reviews and enforce architectural standards Drive Agile development and manage project timelines effectively

Professional Services Consultant - CDN We are seeking an experienced and highly technical Professional Services Consultant to lead the transition of enterprise CDN, security, and performance services from Akamai to Cloudflare. You will work directly with customers, solutions architects, and engineering teams to design, plan, and implement the migration of caching, WAF, bot mitigation, edge delivery, and DNS services while ensuring minimal downtime and optimal performance. Key Responsibilities: Analyze existing Akamai configurations (Property Manager, EdgeWorkers, Ion, etc.) Map equivalent features to Cloudflare (Rulesets, Workers, Cache policies, etc.) Architect and implement Cloudflare configurations: WAF rules, caching, page rules, Workers, and Rate Limiting Lead DNS migration to Cloudflare (Zone transfers, DNSSEC, TTL optimization) Migrate origin shields, SSL/TLS certs, custom rules, and performance optimizations Implement and validate security features: Bot protection, WAF rules, and DDoS mitigation Set up performance monitoring, real-user monitoring (RUM), and synthetic testing post-migration Conduct performance benchmarks and A/B tests to ensure migration success Provide technical training to customer teams on using Cloudflare dashboards, analytics, and APIs Collaborate with internal teams to escalate and resolve technical issues Document architecture, migration process, and support handover\ Technical Skills: CDN Platforms Deep knowledge of Akamai (Property Manager, EdgeWorkers, Ion) and Cloudflare (Rulesets, Workers, Cache, Polish, Argo) Protocols HTTP/1.1, HTTP/2, HTTP/3 (QUIC), TLS/SSL, DNS, TCP/IP Caching CDN cache control headers, edge caching, cache invalidation, tiered caching Security WAF rule configuration, Bot protection, Rate Limiting, IP reputation handling DNS Experience with DNS management, DNSSEC, CNAME setup, TTL strategies Scripting / Edge Compute Akamai EdgeWorkers, Cloudflare Workers (JavaScript / TypeScript) DevOps / Automation Terraform, Ansible, CI/CD pipelines Monitoring & Analytics Real User Monitoring (RUM), synthetic monitoring (Pingdom, Catchpoint), Grafana, Cloudflare analytics Certificates SSL/TLS certificate migration, Let's Encrypt, Cloudflare SSL modes Soft Skills: Strong client-facing communication and technical consulting ability Excellent documentation and project management skills Ability to troubleshoot under pressure Collaborative team player with cross-functional coordination ability Comfortable handling enterprise-level migrations with phased cutovers Qualifications: Bachelors degree in Computer Science, IT, or related field Overall 7+ years with 5+ years in CDN, web performance, or network security roles Previous experience migrating or working with both Akamai and Cloudflare Certifications (preferred): Cloudflare Certified Developer or Architect Akamai ACA (Akamai Certified Architect) Network+, Security+ or equivalent Good to have Skills: Experience with multi-CDN strategies Familiarity with Zero Trust architectures Knowledge of performance optimization for mobile and global users Experience integrating CDNs with CI/CD workflows NGINX, Varnish, HAProxy API integrations with Terraform, Cloudflare API v4 Log forwarding and SIEM tools (Splunk, ELK)

Minimum 4+ years of development and design experience in Java/Scala with Flink, Beam (or spark streaming) and Kafka Extensive coding experience and knowledge in Event driven and streaming architecture Experience in JVM tuning for performance Knowledge on Containerisation using Docker and Kubernetes. Working knowledge on Caching systems, with particular experience using Redis will be preferable. [Nice to have] Linux OS configuration and use, including shell scripting. Good hands on experience with design patterns and their implementation. Well versed with CI/CD principles (GitHub, Jenkins etc.) , and actively involved in solving, troubleshooting issues in distributed services ecosystem Experience working with SQL and NoSQL databases Familiar with Distributed services resiliency and monitoring in a production environment. Experience in designing, building, testing and implementing security systems including identifying security design gaps in existing and proposed architectures and recommend changes or enhancements. Responsible for adhering to established policies, following best practices, developing and possessing an in-depth understanding of exploits and vulnerabilities, resolving issues by taking the appropriate corrective action. Knowledge on security controls designing Source and Data Transfers including CRON, ETLs, and JDBC-ODBC scripts. Understand basics of Networking including DNS, Proxy, ACL, Policy and troubleshooting High level knowledge of compliance and regulatory requirements of data including but not limited to encryption, anonymization, data integrity, policy control features in large scale infrastructures Understand data sensitivity in terms of logging, events and in memory data storage such as no card numbers or personally identifiable data in logs. Implements wrapper solutions for new/existing components with no/minimal security controls to ensure compliance to bank standards. Experience in Agile methodology. Ensure quality of technical and application architecture and design of systems across the organization. Effectively research and benchmark technology against other best in class technologies. Experience in Banking, Financial and Fintech experience in an enterprise environment preferred Able to influence multiple teams on technical considerations, increasing their productivity and effectiveness, by sharing deep knowledge and experience. Self-motivator and self-starter, Ability to own and drive things without supervision and works collaboratively with the teams across the organization.

The ideal candidate will have a strong technical background in broadcast engineering, satellite communications, and project management, ensuring successful installations and customer satisfaction.

Job Description: Senior Content QC Specialist with deep experience in VOD (Video-on-Demand) quality control workflows. The candidate will be responsible for ensuring content readiness across multiple platforms by performing and managing automated and manual QC checks. Key Responsibilities: Perform and oversee VOD asset QC to ensure compliance with technical, editorial, and platform-specific guidelines Work with automated QC tools like Interra Baton, Vidchecker, Aurora etc. Identify and troubleshoot issues related to audio/video sync, encoding artifacts, loudness, captioning, metadata Coordinate with content operations and engineering teams to streamline delivery Key Skills: Strong knowledge of broadcast standards, codecs, wrappers, and OTT delivery formats Experience with QC tools (Baton, Vidchecker) and content validation Familiarity with streaming platform requirements (e.g., FAST, AVOD, SVOD delivery ) Understanding of cloud-based workflows and MAM systems is a plus