Senior Consultant - Elasticsearch & Observability

Position Overview:

At SquareShift, we are seeking an experienced Senior Consultant specializing in Elasticsearch, Observability, and Data Migration to drive complex infrastructure and data initiatives for our clients. This role involves designing, deploying, and integrating scalable Elasticsearch clusters, executing seamless data migrations, and enhancing observability through log collection, monitoring, and custom dashboards.

We are looking for a professional with 5 to 8 years of experience, strong expertise in Elasticsearch, cloud infrastructure, security, and integrations, and a proven ability to deliver enterprise-grade observability solutions.

Key Responsibilities:

1. Architecture & Deployment

• Design and implement highly available and scalable Elasticsearch clusters.
  
• Conduct architecture reviews, capacity planning, and performance optimization.
  
• Ensure robust security configurations, including access controls and encryption.
  

2. Data Migration

• Develop and execute data migration strategies, including snapshot and restore mechanisms.
  
• Ensure seamless data movement across multiple clusters while maintaining data integrity.
  

3. Observability & Monitoring

• Set up log collection pipelines using Beats and Logstash, normalizing data to Elastic Common Schema (ECS).
  
• Deploy and configure uptime monitoring (Heartbeat), APM agents for Java applications, and synthetic monitoring.
  
• Define ILM policies for optimized data retention and management.
  

4. Custom Integrations & Security

• Implement and configure third-party integrations with Elasticsearch.
  
• Develop custom parsers and ingestion pipelines for structured and unstructured data.
  
• Enforce role-based access control (RBAC) and security best practices.
  

5. Dashboards & Alerting

• Develop custom Kibana dashboards for monitoring system health and business metrics.
  
• Implement 20+ detection rules and alerts for proactive system monitoring.
  
• Work closely with stakeholders to define observability use cases and data visualizations.
  

Requirements:

• 5 to 8 years of experience in Elasticsearch, Observability, or Cloud Data Engineering.
  
• Excellent communication skills are mandatory for effective client interactions and solution presentations.
  
• Strong expertise in Elasticsearch, Logstash, Kibana, and Beats.
  
• Experience in Elastic Security, ILM, and data migration strategies.
  
• Proficiency in cloud platforms (AWS, GCP, or Azure) and Kubernetes.
  
• Hands-on experience in log collection, normalization, and custom pipeline development.
  
• Strong knowledge of Linux environments, scripting, and automation.
  
• Excellent problem-solving skills and ability to work in a client-facing role.