Principal Engineer - Elastic search

Job Description

Saviynt is seeking a Principal Data Engineer with deep expertise in ElasticSearch to lead the development, administration, performance optimization, and upgrade process for ElasticSearch. The ideal candidate will own the strategy and execution for scalable, high-performance search and analytics solutions, ensuring optimal data indexing, retrieval, and storage efficiency. This role is critical to modernizing our data infrastructure while maintaining high availability, security, and performance. About the Team The Data Engineering team at Saviynt is responsible for designing, optimizing, and scaling our data infrastructure to support fast, reliable, and secure identity access management solutions. We work with large-scale distributed systems, leveraging MySQL, ElasticSearch, Redis, and AWS/Azure cloud services to provide scalable data solutions that power our platform. WHAT YOU WILL BE DOING Lead and execute ElasticSearch upgrades from version 6.x to 7.x and from version 7.x to 8.x, ensuring minimal downtime and smooth migrations. Design and implement best practices for scalability, performance tuning, and security of ElasticSearch clusters. Optimize search indexing and query performance for large-scale datasets, improving search relevance and efficiency. Develop and maintain monitoring and alerting mechanisms for ElasticSearch clusters, ensuring high availability and resilience. Collaborate with cross-functional teams (Engineering, DevOps, Security) to integrate ElasticSearch with existing applications and infrastructure. Evaluate and implement multi-tenant architecture within ElasticSearch to support large-scale deployments across multiple customers. Define and enforce best practices for data modeling, indexing strategies, and cluster sharding to ensure optimal system performance. Troubleshoot and resolve ElasticSearch issues related to query performance, data consistency, and infrastructure scaling. Maintain and enhance security configurations, including encryption, access control, and compliance with industry standards. Automate operational tasks using scripting and infrastructure-as-code (IaC) tools for ElasticSearch management. Mentor and guide engineers on ElasticSearch administration, optimization, and best practices. WHAT YOU BRING 8+ years of experience in Data Engineering, DevOps, or Software Engineering, with a focus on ElasticSearch administration and optimization. Proven experience upgrading ElasticSearch (6.x to 7.x, 7.x to 8.x) in a production environment. Strong expertise in ElasticSearch performance tuning, cluster scaling, and optimization techniques. Experience designing and implementing multi-tenant solutions in ElasticSearch. Hands-on experience with indexing strategies, data partitioning, and sharding techniques. Solid understanding of Elasticsearch security best practices, including TLS encryption, role-based access control (RBAC), and secure data storage. Proficiency in SQL, NoSQL databases, and data storage technologies (eg, MySQL, Redis, S3). Experience integrating ElasticSearch with Java/SpringBoot applications and working with RESTful APIs. Strong knowledge of cloud platforms (AWS, Azure) and experience deploying ElasticSearch in containerized environments (Docker, Kubernetes). Experience with infrastructure automation tools (Terraform, Ansible, Helm, or CloudFormation) for managing ElasticSearch clusters. Strong problem-solving and analytical skills with the ability to troubleshoot complex distributed systems. Excellent communication and collaboration skills to work cross-functionally with engineers, architects, and business stakeholders.