Must-Have Skills: Apache Spark expertise : design, configure, and optimize Spark clusters (or similar engines like Dremio) Data Integrity QA : create and execute test cases to validate accuracy, consistency, and completeness of data; implement and maintain automated test scripts Performance Testing : architect and run benchmark tests; analyze the impact of Spark cluster configurations on query/workflow performance Leadership : mentor and guide other testers on best practices in both data integrity and performance testing Good-to-Have Skills: Familiarity with performance testing tools (e.g., JMeter, Gatling) Experience integrating tests into CI/CD pipelines (e.g., Jenkins, GitLab CI) Exposure to cloud-based Spark services (AWS EMR, Azure Synapse) Who You Are A data-driven QA leader passionate about ensuring both correctness and speed in big-data pipelines Comfortable translating complex requirements into repeatable, automated test suites Skilled at troubleshooting anomalous results , performing root-cause analysis, and optimizing system configurations A collaborative mentor who elevates team practices and drives continuous improvement What You ll Do & Learn Design & run comprehensive data integrity tests for Spark queries, investigating failures and ensuring zero data discrepancies Implement automated validation scripts that integrate with our CI/CD workflows Define & execute performance benchmarks across varied Spark cluster setups; report on metrics like throughput, latency, and resource utilization Tune Spark configurations to meet SLAs for data freshness and query response times Lead test planning sessions, coach junior testers, and document best practices for reproducible, scalable testing Collaborate with data engineering, DevOps, and product teams to embed quality gates into the development lifecycle Why Join Us? Own the quality and performance of our core big-data platform powering mission-critical analytics Work alongside experienced data engineers and architects on cutting-edge Spark deployments Drive automation and efficiency in a growing, innovation-focused environment Enjoy opportunities for professional growth , training, and attending industry conferences

Requirements 7+ years of experience with Python Strong expertise in Python frameworks (Django, Flask, or FastAPI) Experience with GCP, Terraform, and Kubernetes Deep understanding of REST API development and GraphQL Strong knowledge of SQL and NoSQL databases Experience with microservices architecture Proficiency with CI/CD tools (Jenkins, CircleCI, GitLab) Experience with container orchestration using Kubernetes Understanding of cloud architecture and serverless computing Experience with monitoring and logging solutions Strong background in writing unit and integration tests Familiarity with AI/ML concepts and integration points Responsibilities Design and develop scalable backend services for our AI platform Architect and implement complex systems with high reliability Build and maintain APIs for internal and external consumption Work closely with AI engineers to integrate ML functionality Optimize application performance and resource utilization Make architectural decisions that balance immediate needs with long-term scalability Mentor junior engineers and promote best practices Contribute to the evolution of our technical standards and processes

Work mode- WFO 5 days Experience- 7+ K8s Hands-on experience Linux Troubleshooting Skills Experience on OnPrem Servers and Management Helm Docker Ingress and Ingress Controllers Networking Basics Proficient Communication Must-Have Skills: Hands-on experience with airgap Kubernetes clusters , ideally in regulated industries (finance, healthcare, etc.) . Strong expertise in CI/CD pipelines , programmable infrastructure , and automation . Proficiency in Linux troubleshooting, observability (Prometheus, Grafana, ELK), and multi-region disaster recovery . Security & compliance knowledge for regulated industries. Preferred: Experience with GKE, RKE, Rook-Ceph, and certifications like CKA, CKAD . Who You Are A Kubernetes expert who thrives on scalability, automation, and security . Passionate about optimizing infrastructure, CI/CD, and high-availability systems . Comfortable troubleshooting Linux, improving observability , and ensuring disaster recovery readiness . A problem solver who simplifies complexity and drives cloud-native adoption . What You ll Do Architect & automate Kubernetes solutions for airgap and multi-region clusters . Optimize CI/CD pipelines & cloud-native deployments . Work with open-source projects , selecting the right tools for the job. Educate & guide teams on modern cloud-native infrastructure best practices. Solve real-world scaling, security, and infrastructure automation challenges . Why Join Us? Work on high-impact Kubernetes projects in regulated industries . Solve real-world automation & infrastructure challenges with cutting-edge tools . Grow in a team that values learning, open-source contributions, and innovation . Location: Hyderabad (Onsite) Ready to shape the future of Kubernetes infrastructure? Apply now!