Data Engineer - Elasticsearch Specialist | 4 + years

Data Engineer

data ingestion, transformation, indexing, and querying

Key Responsibilities:

• Design, develop, and maintain robust

  ETL/ELT pipelines

  to ingest data into Elasticsearch from multiple data sources (structured, semi-structured, and unstructured).
• Automate and optimize data workflows for transformation and indexing.
• Ensure reliability, scalability, and data quality across all pipeline processes.
• Configure and manage

  Elasticsearch clusters

  for optimal performance, scalability, and fault tolerance.
• Optimize

  index settings, mappings, analyzers

  , and

  shard allocation

  strategies.
• Design efficient

  index structures

  and leverage

  aggregations, filters, and full-text search

  for fast, accurate queries.
• Implement

  monitoring and alerting systems

  using Elastic Stack (Kibana, Beats) and other observability tools.
• Develop

  automated health checks

  for APIs, endpoints, and infrastructure components.
• Define and manage

  key performance metrics

  and escalation procedures for system health.
• Work closely with

  application developers, data analysts, architects, and DevOps

  teams to ensure Elastic-based solutions are stable and scalable.
• Provide technical guidance on

  Elasticsearch best practices

  , query design, and performance tuning.
• Contribute to

  data governance

  by ensuring high standards in data quality, metadata management, and lineage tracking.

Required Skills

• Strong hands-on experience with

  Elasticsearch architecture, indexing, and query optimization

  .
• Proven ability to design and build

  ETL/ELT data pipelines

  for search and analytics.
• Expertise in

  data modeling

  for search-driven applications.
• Experience with

  data warehousing

  concepts and

  data governance

  principles.
• Familiarity with tools such as

  BigQuery

  ,

  Kibana

  , or similar analytics dashboards.
• Strong scripting and automation skills using

  Python

  ,

  Shell

  , or equivalent languages.

Preferred Skills

• Experience with

  3DX

  or

  Teamcenter

  data structures.
• Exposure to

  AI/ML workflows

  and integrating Elasticsearch with machine learning models.
• Familiarity with

  Elasticsearch observability stack

  (e.g., Beats, Logstash, APM).
• Understanding of

  data lake

  or

  data lakehouse architectures

  .