ELK / ESS Engineer

Key feature required include query tuning, indexing strategy, cluster monitoring, and troubleshooting, often using the ELK stack
Designing, implementing, and managing search and analytics solutions using Elasticsearch.
Responsibilities may include indexing large datasets, optimizing search queries, maintaining cluster performance, and ensuring data availability.
Single person in requirement backlog and direct interaction with client.

Key Responsibilities

Visualization Creation: Build and assemble interactive panels, charts, maps, and metrics using Kibana Lens to create comprehensive dashboards.
Data Analysis & Mapping: Design efficient time-series index mappings and data streams to ensure optimal data storage and retrieval.
Query Optimization: Utilize aggregations, date histograms, and filters (KQL) to analyze large datasets and ensure fast dashboard response times.
Alerting & Monitoring: Set up threshold-based alerts (Watcher) and monitor system health to provide actionable insights.
Dashboard Optimization: Tune dashboard panels for performance, implementing data retention policies (ILM) to maintain efficiency.
Cluster Management: Deploy, configure, and maintain Elasticsearch clusters on-premise or in cloud environments (AWS, Azure). [NICE TO HAVE]
Performance Optimization: Fine-tune query performance, index management, and shard allocation for large-scale data.  [NICE TO HAVE]
Data Integration: Develop pipelines for indexing data from various sources using Logstash or ingestion APIs.
Monitoring & Security: Monitor cluster health, maintain security protocols, and ensure data integrity.
Troubleshooting: Perform root cause analysis on performance bottlenecks and cluster failures 
Work with Development Teams: Collaborate with software engineers to implement search features and improve user experiences.
Provide Technical Support: Troubleshoot and resolve issues related to Elasticsearch performance, data integrity, and availability.
Knowledge of indexing strategies for high-volume data.
Experience in designing scalable, secure, and resilient search architectures.
Ability to work INDEPENDENTLY  in agile teams, collaborating with DevOps and Data Engineers