Elastic Search Developer

Role & responsibilities

Elasticsearch Administration:

• Install, configure, and manage Elasticsearch clusters.
• Optimize cluster performance, including shard management and indexing strategies.
• Monitor and maintain cluster health, performance, and security.
• Perform regular backups, recovery operations, and upgrades of Elasticsearch clusters.
• Manage Elasticsearch plugins and integration with other systems.
• Manage pipelines via Kafka topics.
• Migrate from beats to Fleet based management.

Elasticsearch Development:

• Design and implement search solutions using Elasticsearch, including indexing, query processing, and data modeling.
• Write and optimize complex queries and aggregations.
• Experience with data ingest, Extract, Transform, and Load (ETL) techniques preferable Logstash and Beats.
• Integrate Elasticsearch with other data sources and applications.
• Write efficient queries to extract data from Elasticsearch as a possible payload for visualization in an external dashboard.

Technical Requirements:

Operating Systems:

• Proficiency with Linux and Windows operating systems.

Programming Languages:

• Proficiency in Java, DotNet and/or Python.
• Experience with other languages such as Scala or Go is a plus.

Scripting Languages:

• Expertise in scripting with Bash, Python, or Perl.

Database Technologies:

• Experience with SQL and NoSQL databases.
• Experience with database query languages like SQL, T-SQL, KQL.

DevOps and Automation:

• Experience with CI/CD pipelines, Docker, Kubernetes, and configuration management tools like Ansible or Puppet.

Architectural and Design Skills:

• Ability to design and architect scalable, high-performance search solutions.
• Experience with distributed systems and microservices architecture.
• Strong understanding of data structures, algorithms, and software design patterns.
• Excellent communication, and relationship skills to articulate advanced technical topics and build consensus.

Additional Responsibilities:

• Collaborate with cross-functional teams to gather requirements and develop search solutions.
• Troubleshoot and resolve issues related to Elasticsearch infrastructure and applications.
• Provide mentorship and guidance to junior developers.
• Stay updated with the latest developments in Elasticsearch and related technologies.
• Participate in on-call rotation and provide support for production environments.