Data Engineer – AI & Data Platform
Data Engineer – AI & Data Platform - Long Term Contract - €600 - 700 Per day Location: Remote / Hybrid Contract: Long-term opportunity Day Rate: €600 - 700 Per day My client is looking for an experienced Data Engineer to join a growing AI & Data Platform team, working across a large-scale Databricks Lakehouse environment. This is a hands-on role focused on building scalable data platforms that support both data and AI/GenAI workloads.
What you’ll be doing:
- Build and optimise production data pipelines using Databricks, Spark, Python and SQLDesign and maintain the Databricks Lakehouse, including Delta Lake and Unity Catalog
- Support LLM, RAG and Mosaic AI initiatives
- Develop scalable patterns for data ingestion, transformation and consumption
- Implement best practices across CI/CD, testing, monitoring and cost optimisation
- Work with data, cloud and business teams to deliver scalable technical solutions
- Contribute to platform security and governance
- Databricks Genie is nice to have too
- What they’re looking for:5+ years’ experience in Data Engineering or Platform Engineering 3+ years of hands-on Azure Databricks experience
- Strong experience with Databricks, Spark, Delta Lake and Unity Catalog
- Strong Python and SQL skills
- Experience building and operating production data pipelines at scale
- Strong understanding of Databricks security, governance and workspace administration
- Experience with Mosaic AI and/or AI/ML workloads
- Understanding of RAG, LLMs and vector databases
- You must hold a current Databricks certification to be considered.