Elastic Observability Architect
Primary Responsibilities
Architect, design, and manage enterprise-grade Elastic Stack (Elasticsearch, Logstash, Kibana) environments
Implement scalable observability solutions for logging, metrics, and monitoring across multiple systems
Design and optimize Elasticsearch clusters for performance, scalability, high availability, and disaster recovery
Build and maintain data ingestion pipelines using Logstash, Beats, Kafka, or similar tools
Develop advanced Kibana dashboards, visualizations, alerts, and reports for operational and business stakeholders
Tune indexing strategies, shard allocation, and query performance for large-scale datasets
Implement Index Lifecycle Management (ILM), data streams, and storage optimization strategies
Ensure security best practices including RBAC, TLS encryption, and secure access controls
Troubleshoot and resolve complex production issues including cluster health, latency, and garbage collection tuning
Collaborate with infrastructure, DevOps, and application teams to define observability requirements
Provide technical leadership, mentoring, and guidance on Elastic Stack best practices
Participate in system design reviews and architectural governance for observability solutions
Required Skills & Experience
Strong hands-on expertise in Elasticsearch and the Elastic Stack (expert level)
Deep understanding of distributed systems, cluster architecture, indexing, sharding, and Query DSL
Experience with large-scale log, metrics, and search data environments
Strong expertise in performance tuning, optimization, and troubleshooting of Elasticsearch clusters
Experience with high availability (HA) and disaster recovery (DR) architectures
Proficiency in Logstash, Beats, and integration tools such as Kafka or similar streaming platforms
Strong experience in Kibana dashboarding and observability solutions
Cloud experience with AWS, Azure, or Google Cloud Platform
Experience with Docker and Kubernetes in production environments
Familiarity with CI/CD pipelines and Infrastructure as Code tools such as Terraform or Ansible
Strong understanding of security frameworks including RBAC and TLS encryption
Proficiency in scripting/programming languages such as Python or Java
Preferred Skills
Experience building enterprise observability or APM solutions
Exposure to SRE (Site Reliability Engineering) practices
Experience in multi-tenant or multi-region Elasticsearch deployments
Knowledge of hybrid cloud observability architectures