Lead Data Engineer

We are looking for a Lead Data Engineer to join our growing team and take ownership of designing, building, and scaling modern data platforms. In this role, you’ll lead technical delivery on complex data projects, mentor other engineers, and collaborate closely with business stakeholders to ensure data becomes a true enabler of decision-making.Who are you?6+ years of experience delivering data-related projects, from architecture to implementation.Proven expertise in Databricks, Azure or Microsoft Fabric.Strong programming skills in Python and SQL.Solid experience in data architecture and modeling.Excellent communication skills, with the ability to translate technical concepts into business value.Consultancy mindsetA proactive, problem-solving mindset and the drive to push projects forward.Nice to have: Experience with Power BIWhat can we offer you?You will work in a growing company with plenty of opportunities for self-growth and for learning new skills. You make up your career and we will guide you! Next to this, you will be able to work on very interesting projects for mainly enterprise companies.You will be responsible for guiding a team of motivated and highly skilled data engineers, while maintaining flexibility in making architectural decisions for building future-proof data platforms.To give you a better understanding on what type of profile we are looking for, we want you to meet one of your future colleagues.Apply nowMeet VincentI am an experienced Java developer and Data Engineer with a broad skillset that enables me to setup on-premise and cloud based scalable and performant data-driven applications, using technologies like Apache Spark and Kafka. I’m a certified AWS developer with relevant experience in both AWS (using EMR, Glue, Kinesis, SageMaker, Redshift and more) and Azure Cloud platform (Synapse, Fabric or Databricks).My hands-on experience has lead me to a more architectural role, where I support organizations in making the right architectural decisions, aswell as with the implementation.Oh yeah, and I also love gaming, Star Wars, Marvel, beer and pizza!Years at the farmI’ve been at the farm for 10 exciting years!Favourite languageMy absolute favourite is Java, followed by ScalaEducationI have a bachelor in Information ManagementMade inThe beautiful city of AntwerpJoin the teamSkillsGreat minds come with great skillsTechnical skillsJavaScalaPythonApache SparkAWS (Amazon Web Services)Azure (Synapse, Fabric, Databricks, …)Apache AirflowTerraFormApache FlinkKubernetesPersonal skillsCommunicationTrustworthyBusiness mindedTeamplayerTechnical CoachingProjectsWhat kind of projects can you expectBig Data Environment setupData EngineerSet up of a new Big Data Cluster at VDAB for the standardization of the intake and processing of different data sources, and for the creation of a framework to aid the staff in the development and deployment of new data sources. We use Spark for disributed processing.Apache SparkScalaHadoopSupply Chain PlatformData EngineerMaintaining a Spark architecture with Scala for mapping supply chain business processes an for batch tracing. We used Azure Databricks for the cluster management of spark jobs and the creation of Delta Lake layers enabling us to run Spark code on the datasets.Apache SparkScalaDatabricksStreaming architectureData Tech LeadProviding support to a data team in altering their current functions to a batch/streaming architecture. I’m using Apache Hadoop and Kafka to setup the Streaming architecture and I evaluated the capabilities of the application on Graph Databases.Apache SparkScalaHadoopAre you looking for a job like Vincent?Leave your contact details and we will be in touch with you shortlyHow do we workUpload your cvAre you a good fit on paper? Let’s meet!The MatchWe look at your goals, what you are looking for in a job and if we find a good match for that within the farmLet’s get technical!We do a technical deep dive into the past projects you did so we learn what you can teach usMeet the farmersYou talk to some of your future colleagues. The atmosphere in our team is most important to us, so we need to make sure you’re fun to work withThe decision.We meet with all interviewers and see if we can’t find any reasons not to hire you. We are looking for the creme de la cremeThe gates are open.We make you an offer you can’t refuse and tell you all about your new role within the company