Technology Engineer- RTS(Real Time streaming)

Job Description

Role: Technology Engineer- RTS(Real time streaming) Location: Dubai(On-site) Job Description: Minimum 5+ years of development and design experience in Java/Scala/Python with Flink, Beam (or Spark Streaming using Real Time data and not batch data) and Kafka. • Containerization and orchestration (Docker and OpenShift/Kubernetes) • Kafka, Flink, Beam / Kafka streams, Apache Spark or similar streaming technologies • Source control (GIT), automated build/deployment pipelines (Jenkins, ArgoCD, Kaniko, Shipwright etc.) • Public Cloud preferably Azure and OCI • Linux OS configuration and using shell scripting • Working with streaming data sets at scale • Public Cloud automation toolset • Cloud Native applications • Understanding of GitOps • Extensive coding experience and knowledge in event driven and streaming architecture • Good hands-on experience with design patterns and their implementation • Experience doing automated unit and integration testing • Well versed with CI/CD principles (GitHub, Jenkins etc.), and actively involved in solving, troubleshooting issues in distributed services ecosystem • Familiar with Distributed services resiliency and monitoring in a production environment. • Responsible for adhering to established policies, following best practices, developing, and possessing an in-depth understanding of exploits and vulnerabilities, resolving issues by taking the appropriate corrective action. • High level knowledge of compliance and regulatory requirements of data including but not limited to encryption, anonymization, data integrity, policy control features in large scale infrastructures • Understand data sensitivity in terms of logging, events and in memory data storage such as no card numbers or personally identifiable data in logs. • Distributed systems • Network fundamentals and host-level routing • Tuning distributed systems • Automated testing • Security engineering practices and tools. • Event driven architecture • Experience in Agile methodology. • Ensure quality of technical and application architecture and design of systems across the organization. • Analytical thinking • Effectively research and benchmark technology against other best in class technologies. • Able to influence multiple teams on technical considerations, increasing their productivity and effectiveness, by sharing deep knowledge and experience. • Self-motivator and self-starter, ability to own and drive things without supervision and works collaboratively with the teams across the organization.