Elastic Data Engineer

Mission Overview Our client is undergoing an ambitious digital and organizational transformation. Within the Digital Transformation Office (DTO), we are building modern processes, stronger operational support, and more data-driven services. This consultancy mission at the client site represents Keystone Solutions, where you will contribute to impactful projects that combine digitalization, legacy modernization, and societal relevance. Responsibilities Set up and manage an event-driven data architecture using Apache Kafka as a buffering and processing layer, and Elasticsearch as a data lake solution for structured and unstructured data. Focus on establishing performant Kafka and Elastic stacks (schema management, topic management, indexing strategies) while ensuring data consistency, scalability, and observability throughout the entire data ingestion to consumption process. Design, implement, and document necessary components, making data available via a data service layer (REST APIs, microservices) and ensuring error handling and optimization of the entire pipeline. Develop a data service layer (REST APIs, microservices) that makes data from Elasticsearch available for analysis, monitoring, or integration with other systems. Utilize Docker, Kubernetes, and Openshift for the deployment of components. Ensure data consistency and scalability throughout the entire data ingestion to consumption process, and manage observability, error handling, and optimization via CI/CD pipelines (GitLab CI) and Python scripting. Requirements Proven experience as a data engineer with a focus on event-driven systems and real-time data integration. In-depth knowledge of Apache Kafka (Streams, Connect, Schema Registry, Avro, ksqlDB) and Elasticsearch (including Kibana, ingest pipelines, index lifecycle management). Methodical and precise work ethic to ensure data consistency and scalability within the Kafka and Elastic architecture. Ability to work autonomously, propose solutions, and adapt quickly to changes in the situation. Strong documentation skills to clearly and structurally document analyses, pipelines, schemas, configurations, and technical choices (reports, documentation). Excellent written and verbal communication skills to participate seamlessly in meetings with specialists and user representatives. Ability to work in a team, prioritize within a complex environment with multiple data pipelines, processes, and technical dependencies, and demonstrate flexibility in scheduling. Client-oriented and solution-focused attitude, stress-resistant, creative, constructive, and attentive to user-needs. Keystone Solutions Advantages Consultancy Nature: Engage in on-site work and embody the consultant identity. Dynamic Projects: Tackle diverse challenges across various client environments. Turbo-Charged Learning: Experience professional development and broad learning opportunities. Skyrocketing Ambition: Commit to career growth within our framework. Values: As a Duration 01/09/2026 - 31/12/2026 4 months (full time) Skills required Apache Kafka (Streams, Connect, Schema Registry, Avro, ksqlDB) - Level: Confirmed - Most recent: Any time CI/CD tools (GitLab CI) - Level: Confirmed - Most recent: Any time Data Service Layer (REST API's, microservices) - Level: Confirmed - Most recent: Any time Docker, Kubernetes en Openshift - Level: Confirmed - Most recent: Any time Elasticsearch (Kibana, ingest pipelines, index lifecycle management) - Level: Confirmed - Most recent: Any time Indexingstrategieën en data-consistentie (Elasticsearch) - Level: Confirmed - Most recent: Any time Observability, foutafhandeling en optimalisatie van data-pipelines - Level: Confirmed - Most recent: Any time PostgreSQL - Level: Confirmed - Most recent: Any time Python - Level: Confirmed - Most recent: Any time Schema management en topicbeheer (Kafka) - Level: Confirmed - Most recent: Any time Language requirements Dutch Level Active knowledge English Level Active knowledge French Level Active knowledge J-18808-Ljbffr