ELK SME

Role & responsibilities

• Design, implement, and configuration of Elastic stack, Kibana visualizations and Grafana for the Client.
• Present and demonstrate ELK / Grafana capabilities to the prospective clients
• Designs and optimizes ELK platform architecture for large-scale and distributed deployments
• Establishes best practices and development standards, and ensures that the team adopts them
• Maintains a close partnership with ELK / grafana on feature requests, upgrade planning, and product roadmap alignment
• Develops and customizes various dashboards and Builds advanced visualizations
• Performs assessment of Monitoring estate and derive at recommendations with quantified business benefits

Good understanding and experience on:

• End to end ELK Stack / Grafana Enterprise & Cloud deployment
• Administering Production Systems, where Elastic Stack runs / where Grafana with data sources as Prometheus, Graphite, M3DB,etc.
• Data onboarding from multiple data sources and build Transformation framework
• Migration / upgrade planning & execution for ELK / Grafana platform
• End to end ELK / Grafana data Ingestion, enrichment, transformation and visualization
• Deployment & Administration of Elastic Stack version 5.0 and above & Grafana Stack version 7.x and above
• Docker, Kubernetes, Artifactory and Gitlab & cloud platforms (preferably Azure / AWS)
• Deeper understanding on VPC, Subnet, NI, LBs and Availability Zones & AWS Services limitations
• Hands on / Knowledge on ML modules with good insights on Event Aggregation / Event correlation / Anomaly detection areas
• Watchers for Alerting leveraging Painless scripts / Python
• Should have hands on experience with:
• Design Elasticsearch indices to efficiently store metric data by optimizing both performance and its growth into consideration.
• Design access control using X-Pack.
• Configuration of X-Pack including Shield, Watcher, Marvel, Graph, and Reporting.
• Configuration of Logstash, FileBeats, MetricsBeats and other ELK Stack components to collect and the store the data necessary to meet customer requirements efficiently.
• Inbound / Outbound Integrations IT & business systems and custom plugin creations
• Implementing Active directory integration, cross-cluster search & replication, Infra UI and Compact UI display.
• Setting up and configuring Grafana & Integration experience with different multiple data sources like 3rd party monitoring tools Devops / APIs,etc.
• Configuring dashboards, alerts and alarms
• Exposure to analyze from dashboard, recommend and problem solving skills to debug issues / integrate using Json, API, CI/CD pipeline using scripts
• Data visualization using Grafana for creating Grafana dashboards to display time-based data plots
• AWS Services
• Cloud Formation
• ASG, EC2
• S3, Route53
• CloudWatch

Preferred candidate profile