Principal Engineer - Datalakehouse + Kubernetes

Key Responsibilities:

Design, develop, and maintain Kubernetes controllers, operators, and CRDs to manage data platform components and infrastructure automation.

Implement MetaControllers, Knative to simplify and orchestrate controller logic.

Develop backend services and automation scripts using Python.

Integrate with REST APIs for inter-service communication and platform integration.

Contribute to Kubernetes-based microservices architecture and CI/CD automation.

Monitor, debug, and optimize controllers for performance and reliability.

Collaborate with DevOps and platform engineering teams to enhance cluster efficiency and observability.

Required Skills & Experience

8+ years of hands-on experience with Kubernetes (including API server, controllers, admission webhooks).

Proven experience in building custom controllers, operators, MetaControllers, Serverless using Knative.

Strong programming skills in Python (Go experience is a plus).

Good understanding of Kubernetes API machinery, CRDs, reconciliation loops, and event-driven patterns.

Experience with REST API design and integration.

Familiarity with Helm, Argocd, GitOps, and CI/CD pipelines.

Working knowledge of cloud-native tools (Docker, Prometheus, Grafana).

Preferred (Nice-to-Have)

Experience with multi-cluster management and scaling custom controllers.

Exposure to Istio/Service Mesh and observability frameworks like grafana, opensearch, Fluentd, KIbana.

Knowledge of cloud providers (AWS, GCP, Azure).

Experience with event-driven systems (Kafka, RabbitMQ, NATS, etc.).