Senior Staff Backend Engineer - AI Workspace

What You Will Do

Senior Staff Software Engineer

You will technically guide teams working on full stack development teams using JAVA, AWS, Kafka, Kubernetes, Kubeflow, Argo CD and gRPC. You will be accountable for hiring and developing technical leaders and top talent, raising the bar on engineering and operational excellence.

In this role, you will:

• Lead the design of scalable, event-driven microservices for optimized resource management.
• Design and implement the development of a next-generation Resource Manager and AI developer tools, enabling efficient, secure, and policy-compliant data access across hybrid environments.
• Ensure reliability, observability, and performance of backend systems through rigorous testing and monitoring.
• Mentor junior engineers and contribute to architectural decisions that shape the future of AI infrastructure.
• Hands-on develop critical infrastructure components.
• Decompose complex problems into simple, straightforward solutions, providing mechanisms for the teams to prioritize ruthlessly and move with urgency.
• Envision roadmaps for the scalable and robust growth of Workspace infrastructure.
• Collaborate with Product owner, TPMs, and Compliance teams to define end-to-end ML model development lifecycle experiences. Proactively drive Workspace initiatives and align with stakeholders.
• Demonstrate excellence resulting in scalable systems and services with the highest quality architecture and design.
• Dive deep into critical system issues, proactively addressing similar root causes, and raise the bar on Operational Excellence.
• Collaborate with other Coupang tech leaders to make the service extensible to unlock opportunities for innovations.

Qualifications

• Bachelors degree in computer science or related technical fields.
• 13+ years professional software development experience
• Track record of building multi-tenant, financial-grade cloud infrastructure at scale.
• Expertise in stream processing, distributed stateful services, immutable data models.
• Experience with technologies like Redis, Kafka, workflow orchestration, model insights and storage systems.
• Strong communication skills with ability to influence org-wide technical decisions.
• Hands-on experience in designing and developing large scale distributed system in the last 4 years.
• One who is fluent in one or more among Java, Go and Python.
• Proven track record of delivering mission critical systems.
• Experience developing and growing senior individual contributors globally.
• Experience with cloud computing using AWS or Azure or GCP.
• Experienced in Machine learning job deployment infrastructure like Argo CD workflow.

Preferred Qualifications

• Experience in Kubernetes, gRPC, Spring.
• Experience in AI model lifecycle.
• Deep expertise in Java Spring Boot, Hibernate, and RESTful API design.
• Understanding data governance, compliance, and access control in distributed systems.
• Experience with Kubernetes, Docker, and container orchestration in production environments.
• Experience in concurrency, multi-threading, synchronization, and non-blocking IO.
• Deep understanding of operating system kernel and distributed system such as Kafka, Cassandra, ClickHouse and Mongo DB.
• Experience integrating with AI/ML frameworks or pipelines (e.g., TensorFlow, PyTorch, ONNX).
• Experience with observability tools (e.g., Prometheus, Grafana, ELK stack).
• Familiarity with cloud platforms (AWS, GCP, Azure) and cloud-native development practices.