ELK Stack Architect

Role & responsibilities

ELK Stack Architect

As an ELK Stack Architect, you will be the technical authority responsible for envisioning, designing, and leading PB-scale Elasticsearch solutions. This role demands ownership across architecture, governance, scalability, and performance of ELK ecosystems running 100s of pipelines and managing multi-PB datasets. You will work closely with leadership, infra, and product teams to define roadmaps, migrate workloads from on-prem to cloud, implement hybrid strategies, and ensure the platform is secure, resilient, and future-proof.

The candidate must be visionary + hands-on: capable of driving architectural decisions, while also diving deep to debug cluster-level issues

Technical Skills (Must-Have Architect Level)

10+ years overall in IT/Data Engineering/Infra, with 8+ years in ELK Stack and distributed systems.

Elasticsearch: Query DSL, templates, data streams, ILM, CCR, snapshots, shard management.

• Pipelines: Logstash, Beats (Filebeat/Metricbeat/Auditbeat), Kafka/Redis/JDBC ingestion, ingest pipelines.
• Visualization: Kibana Spaces, Data Views, dashboards, Canvas, alerting, reporting.
• Security: X-Pack, LDAP/SAML, TLS, RBAC, audit logging, compliance frameworks.
• Infra & DevOps: Kubernetes, Docker, Helm, Terraform/Ansible/Puppet, CI/CD pipelines.
• Cloud/Hybrid: AWS OpenSearch/Elastic Cloud, Azure Elastic, GCP integrations; migration playbooks.
• Performance & Debugging: JVM tuning, Linux internals, disk I/O, HBA/storage, network stack, GC, cluster state recovery.
• Ecosystem: Integrating DBs, APIs, custom apps; working knowledge of monitoring (Grafana/Prometheus/Elastic-native).

Soft Skills

• Architect mindset: ability to balance business needs, scalability, and operational cost.
• Strong leadership, mentoring, and cross-team collaboration.
• Excellent communication with both engineers and executives.

• Calm under pressure during critical production incidents.

Preferred Qualifications

• Elastic Certified Architect / Engineer.
• Bachelors/Masters degree in Computer Science, IT, or related.
• Experience leading global-scale Elastic clusters (300+ nodes, PBs of data).
• Exposure to SIEM/APM and advanced ML plugins for predictive analytics.