Apache Druide Support
Overview
In this role you will design and maintain scalable data pipelines and analytics platforms around Apache Druid and Airflow. You will work with cross-functional teams to ensure reliable, high-performing data systems and proactive incident management. You’ll optimize data ingestion, queries, and workflows while implementing robust monitoring and logging. This position offers impact through shaping data-driven operations and ensuring system resilience at scale.
ResponsibilitiesEnsure high availability and reliability of production systemsImplement and maintain monitoring and alerting systems; participate in on-call rotationsManage and optimize Apache Druid clusters for performance and scalabilityTroubleshoot Druid performance issues and implement ingestion/query optimization strategiesDesign, develop, and maintain Airflow DAGs for data orchestrationMonitor and troubleshoot Airflow performance; optimize workflowsImplement monitoring and logging solutions (Prometheus, Grafana, ELK) and analyze metrics/logsCollaborate with development, data, and operations teams; document processes and procedures
Key requirementsApache DruidApache AirflowData ingestionOptimizationPrometheus OR Grafana OR ELK stackCollaborationEffective communicationProblem-solvingApache DruidApache AirflowData ingestion