To lead the design, development, and optimization of high-scale search and discovery systemsleveraging deep expertise in OpenSearch. The Search Staff Engineer will enhance searchrelevance, query performance, and indexing efficiency by utilizing OpenSearch's full-text, vectorsearch, and analytics capabilities. This role focuses on building real-time search pipelines,implementing advanced ranking models, and architecting distributed indexing solutions todeliver a high-performance, scalable, and intelligent search experience.
Responsibilities
- Architect, develop, and maintain a scalable OpenSearch-based search infrastructure for
high-traffic applications.
- Optimize indexing strategies, sharding, replication, and query execution to improve
search performance and reliability.
- Implement cross-cluster search, multi-tenant search solutions, and real-time search
capabilities.
- Ensure efficient log storage, retention policies, and lifecycle management in
OpenSearch.
- Monitor and troubleshoot performance bottlenecks, ensuring high availability and
resilience.
- Design and implement real-time and batch indexing pipelines for structured and
unstructured data.
- Optimize schema design, field mappings, and tokenization strategies for improved
search performance.
- Manage custom analyzers, synonyms, stopwords, and stemming filters for multilingual
search.
- Ensure search infrastructure adheres to security best practices, including encryption,
access control, and audit logging.
- Optimize search for low latency, high throughput, and cost efficiency.
- Collaborate cross-functionally with engineering, product, and operations teams to
ensure seamless platform delivery.
- Define and communicate a strategic roadmap for Search initiatives aligned with business
goals.
- Work closely with stakeholders to understand database requirements and provide
technical solutions.
Requirements
- 8+ years of experience in search engineering, with at least 3+ years of deep experience in
OpenSearch.
- Strong expertise in search indexing, relevance tuning, ranking algorithms, and query
parsing.
- Hands-on experience with OpenSearch configurations, APIs, shards, replicas, and
cluster scaling.
- Strong programming skills in Node.js and Python and experience with OpenSearch SDKs.
- Proficiency in REST APIs, OpenSearch DSL queries, and aggregation frameworks.
- Knowledge of observability, logging, and monitoring tools (Prometheus, OpenTelemetry,
Grafana).
- Experience managing OpenSearch clusters on AWS OpenSearch, Containers, or self-
hosted environments.
- Strong understanding of security best practices, role-based access control (RBAC),
encryption, and IAM.
- Familiarity with multi-region, distributed search architectures.
- Strong analytical and debugging skills, with a proactive approach to identifying and
mitigating risks.
- Exceptional communication skills, with the ability to influence and drive consensus
among stakeholders.
Skills:- Search Engine Optimization (SEO), Elastic Search and Python
