{"schemaVersion":"jobsearcher.job.v1","id":"6b761fa60f3f4c70d48d1348","url":"https://jobsearcher.com/jobs/6b761fa60f3f4c70d48d1348","canonicalUrl":"https://jobsearcher.com/jobs/6b761fa60f3f4c70d48d1348","title":"Senior Data Engineer","description":"Welcome! Super excited you dropped by\nLet's redefine cyber security expertise standards and connect business - community through highly engaging hacking experiences. (Find out more insights about Hack The Box culture in our career site).\n\n✨The core mission of the Senior Data Engineer:\n\nYou will own and evolve our data pipelines on GCP — building new ones, hardening existing ones, improving data quality, and making clean, trustworthy data available across the organisation. You'll work end-to-end on streaming and batch pipelines, from CDC and event ingestion through transformation, serving, and the feature layer that powers our ML and AI products.\n\nYour day-to-day will include designing ELT/ETL processes on BigQuery and ClickHouse, building real-time pipelines on Pub/Sub and Kafka with Dataflow (and where it fits, Flink/Spark), orchestrating workflows with Airflow, and ensuring data is properly cleaned, modelled, and served for analytics, ML training, and online inference. You'll partner with ML engineers on feature pipelines, monitoring data drift, and keeping models well-fed and retrained as needed. You'll consume and build REST APIs, integrate with third-party SaaS sources, and treat infrastructure as code.\n\nLocation & Work Mode:\n\nUS\nFully Remote\nThe fellowship you’ll be joining:\n\nYou will be part of the Data, Analytics & AI team, collaborating closely with Infrastructure, Software Engineering, Product, and ML/AI engineers. We're in the middle of a GCP-native modernisation — migrating away from Snowflake toward BigQuery, Bigtable, Pub/Sub, and Dataflow — so we're looking for someone who's opinionated about clean architecture, allergic to over-engineering, and comfortable owning systems end-to-end. If retiring a legacy warehouse and standing up its replacement sounds like a good time, you'll fit right in.\n\n⚔️ Technology tools & weapons you’ll be using:\nCloud & warehouse: GCP, BigQuery, Bigtable, Cloud Storage\nStreaming & messaging: Pub/Sub, Kafka\nProcessing: Dataflow (Apache Beam), with Flink/Spark where appropriate\nOrchestration: Airflow (Cloud Composer)\nAnalytical store: ClickHouse\nLanguages: Python, SQL\nModelling & quality: dbt, data quality gates\nContainers & CI/CD: Docker, Kubernetes, GitHub Actions / equivalent\nLegacy (being retired): Snowflake\nThe adventures that await you after becoming Senior Data Engineer at Hack The Box:\nDesign and build batch and streaming pipelines on Dataflow, Pub/Sub, and Kafka feeding BigQuery, Bigtable, and ClickHouse\nHelp drive the migration off Snowflake onto our GCP-native stack — and retire shadow pipelines along the way\nOwn the orchestration layer in Airflow, including SLAs, retries, and data quality gates\nModel data for analytics and for ML — including feature pipelines that serve both training and low-latency online inference\nPartner with ML engineers on feature stores, drift monitoring, and retraining workflows\nCapture requirements from stakeholders and translate them into pragmatic, well-scoped data products\nContinuously improve data quality, reliability, observability, and cost efficiency\nIdentify new data sources worth acquiring and integrate them cleanly\nSkills, knowledge, and experience points required to unlock the role of the Senior Data Engineer at Hack The Box:\nStrong data modelling and warehouse architecture skills (dimensional modelling, event-driven, lakehouse patterns)\nHands-on experience with GCP data services — BigQuery is a must; Pub/Sub, Dataflow, Bigtable, Cloud Composer are strong pluses\nProduction experience with streaming pipelines on Dataflow/Beam, Flink, or Spark Structured Streaming, ingesting from Kafka and/or Pub/Sub\nSolid SQL and strong Python — you write production-quality code, not just notebooks\nExperience with ClickHouse or another columnar OLAP engine in production\nWorkflow orchestration experience with Airflow (or Prefect/Dagster)\nComfortable with dbt or equivalent transformation frameworks\nExperience migrating off legacy warehouses (Snowflake, Redshift, Synapse) onto cloud-native stacks is a plus\nWorking knowledge of ML in production — feature engineering, feature stores, model deployment, drift monitoring, retraining\nDocker & Kubernetes experience\nCI/CD mindset, infrastructure-as-code sensibility, and a bias for simple, observable systems\nBonus: CDC tooling (Datastream, Debezium), Vertex AI / Feature Store\nWhat your Hack The Box adventure will have in store:\nYou'll have the exhilarating opportunity to contribute to a product that is highly appreciated by users and the cybersecurity community at large\nYou'll experience a highly supportive and caring environment, fostering growth, flexibility, and autonomy\nYou'll embark on an exciting journey of continuous learning and problem-solving, leveling up as our organization grows\nMost importantly, you'll have a blast at HTB because fun is an essential ingredient in our recipe for success! Just wait until you see our global meet-ups!\n The gems you’ll be enjoying as a Senior Data Engineer:\nComp: $140,000-160,000\nMedical, Dental & Vision (employee coverage 100% paid for by Hack The Box)\n401K w/ employer match\nEmployer-paid Life and AD&D Insurance\nSupplemental Life Insurance\nShort-term and Long-term Disability\nHealthcare and Dependent Care FSA\nPaid parental leave\n25 annual leave days\nHome Office Allowance\nDedicated budget for training and professional development, participation in conferences\nState-of-the-art equipment\nFull access to the Hack The Box lab offerings; so you can learn how to hack\n️ The Quest of Becoming Hack The Box’s Senior Data Engineer:\nLevel 1: To complete level one’s objective, submit your application.\nLevel 2: Meet the Talent Acquisition team. Level’s objective: highlight your past achievements, ambitions, and values.\nLevel 3: Meet the hiring team. Level’s objective: connect with the hiring team and share with them your achievements.\nLevel 4: Complete 2 assignments that align with day-to-day job-related tasks and responsibilities. Part of the assignment is discussing it with the hiring team in a debriefing session, in order to walk the team through your thinking process.\nLevel 5: Congratulations! Not many reach this level . Level’s objective: have a constructive, final conversation with senior leadership to explore the role and your future at HTB.\nLevel 6: You've officially received an offer from HTB! To complete the last level and the Quest, all you need to do is accept the offer.\nQuest complete. Congratulations, you’re officially one of us Your next quest: complete the onboarding.\n\nHack Your Career, Today. Join us in this epic adventure of cybersecurity at Hack The Box!\n\nAt Hack The Box, we are on a quest to find the most exceptional and enthusiastic talent to join our team. Whether or not you consider yourself a gamer, we value what makes you unique and want to know more about you. This job post provides just a glimpse of the incredible gamified experience our business and consumer customers enjoy through our platforms. So, if you're ready to embark on a journey of growth and adventure, we can't wait to meet you!\n\nABOUT HACK THE BOX\n\nHack The Box is the Cyber Performance Center with the mission to provide a human-first platform to create and maintain high-performing cybersecurity individuals and organizations.\n\nHack The Box is the only platform that unites upskilling, workforce development, and the human focus in the cybersecurity industry, and it’s trusted by organizations worldwide for driving their teams to peak performance. Offering an all-in-one environment for continuous growth, assessment, and recruitment, Hack The Box provides solutions for all cybersecurity domains.\n\nLaunched in 2017, Hack The Box brings together the largest global cybersecurity community of more than 3 million platform members. Rapidly growing its international footprint and reach, Hack The Box is headquartered in the UK, with additional offices in the US, Australia, and Greece.\n\nExciting News:\n\nGet the most important updates on HTB’s latest year!\nWe are super proud to share that HTB’s all three entities across the UK, US, and Greece have been Certified as a Great Place to Work (Oct 2023-Oct 2024).\nFurthermore, in 2024 the HTB's Greek entity has been listed by the Great Place to Work Institute as the #2 Best Workplace in Greece and #10 Best Workplace in Europe (among Small & Medium Workplaces).\nTake a sneak peek at how it is to be part of HTB and our 2023 Global Retreat. Get more insights about our HTB culture and employee experience by visiting the “about us” section of our site, our career site, and Glassdoor.\n\nAt Hack The Box, we are committed to fostering a diverse, inclusive, and equitable workplace. We believe that diversity enriches our performance, services, and the communities we serve. As such, we ensure that all job applications are considered solely based on merit, skills, and qualifications. We do not discriminate on grounds of race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. We are dedicated to providing a fair and respectful work environment that reflects our values.","company":"Hackthebox","rawCompany":"hackthebox","city":"Orlando","state":"FL","isRemote":false,"isActive":false,"createdAt":"2026-08-29T10:09:42.319Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Data Engineer","description":"Welcome! Super excited you dropped by\nLet's redefine cyber security expertise standards and connect business - community through highly engaging hacking experiences. (Find out more insights about Hack The Box culture in our career site).\n\n✨The core mission of the Senior Data Engineer:\n\nYou will own and evolve our data pipelines on GCP — building new ones, hardening existing ones, improving data quality, and making clean, trustworthy data available across the organisation. You'll work end-to-end on streaming and batch pipelines, from CDC and event ingestion through transformation, serving, and the feature layer that powers our ML and AI products.\n\nYour day-to-day will include designing ELT/ETL processes on BigQuery and ClickHouse, building real-time pipelines on Pub/Sub and Kafka with Dataflow (and where it fits, Flink/Spark), orchestrating workflows with Airflow, and ensuring data is properly cleaned, modelled, and served for analytics, ML training, and online inference. You'll partner with ML engineers on feature pipelines, monitoring data drift, and keeping models well-fed and retrained as needed. You'll consume and build REST APIs, integrate with third-party SaaS sources, and treat infrastructure as code.\n\nLocation & Work Mode:\n\nUS\nFully Remote\nThe fellowship you’ll be joining:\n\nYou will be part of the Data, Analytics & AI team, collaborating closely with Infrastructure, Software Engineering, Product, and ML/AI engineers. We're in the middle of a GCP-native modernisation — migrating away from Snowflake toward BigQuery, Bigtable, Pub/Sub, and Dataflow — so we're looking for someone who's opinionated about clean architecture, allergic to over-engineering, and comfortable owning systems end-to-end. If retiring a legacy warehouse and standing up its replacement sounds like a good time, you'll fit right in.\n\n⚔️ Technology tools & weapons you’ll be using:\nCloud & warehouse: GCP, BigQuery, Bigtable, Cloud Storage\nStreaming & messaging: Pub/Sub, Kafka\nProcessing: Dataflow (Apache Beam), with Flink/Spark where appropriate\nOrchestration: Airflow (Cloud Composer)\nAnalytical store: ClickHouse\nLanguages: Python, SQL\nModelling & quality: dbt, data quality gates\nContainers & CI/CD: Docker, Kubernetes, GitHub Actions / equivalent\nLegacy (being retired): Snowflake\nThe adventures that await you after becoming Senior Data Engineer at Hack The Box:\nDesign and build batch and streaming pipelines on Dataflow, Pub/Sub, and Kafka feeding BigQuery, Bigtable, and ClickHouse\nHelp drive the migration off Snowflake onto our GCP-native stack — and retire shadow pipelines along the way\nOwn the orchestration layer in Airflow, including SLAs, retries, and data quality gates\nModel data for analytics and for ML — including feature pipelines that serve both training and low-latency online inference\nPartner with ML engineers on feature stores, drift monitoring, and retraining workflows\nCapture requirements from stakeholders and translate them into pragmatic, well-scoped data products\nContinuously improve data quality, reliability, observability, and cost efficiency\nIdentify new data sources worth acquiring and integrate them cleanly\nSkills, knowledge, and experience points required to unlock the role of the Senior Data Engineer at Hack The Box:\nStrong data modelling and warehouse architecture skills (dimensional modelling, event-driven, lakehouse patterns)\nHands-on experience with GCP data services — BigQuery is a must; Pub/Sub, Dataflow, Bigtable, Cloud Composer are strong pluses\nProduction experience with streaming pipelines on Dataflow/Beam, Flink, or Spark Structured Streaming, ingesting from Kafka and/or Pub/Sub\nSolid SQL and strong Python — you write production-quality code, not just notebooks\nExperience with ClickHouse or another columnar OLAP engine in production\nWorkflow orchestration experience with Airflow (or Prefect/Dagster)\nComfortable with dbt or equivalent transformation frameworks\nExperience migrating off legacy warehouses (Snowflake, Redshift, Synapse) onto cloud-native stacks is a plus\nWorking knowledge of ML in production — feature engineering, feature stores, model deployment, drift monitoring, retraining\nDocker & Kubernetes experience\nCI/CD mindset, infrastructure-as-code sensibility, and a bias for simple, observable systems\nBonus: CDC tooling (Datastream, Debezium), Vertex AI / Feature Store\nWhat your Hack The Box adventure will have in store:\nYou'll have the exhilarating opportunity to contribute to a product that is highly appreciated by users and the cybersecurity community at large\nYou'll experience a highly supportive and caring environment, fostering growth, flexibility, and autonomy\nYou'll embark on an exciting journey of continuous learning and problem-solving, leveling up as our organization grows\nMost importantly, you'll have a blast at HTB because fun is an essential ingredient in our recipe for success! Just wait until you see our global meet-ups!\n The gems you’ll be enjoying as a Senior Data Engineer:\nComp: $140,000-160,000\nMedical, Dental & Vision (employee coverage 100% paid for by Hack The Box)\n401K w/ employer match\nEmployer-paid Life and AD&D Insurance\nSupplemental Life Insurance\nShort-term and Long-term Disability\nHealthcare and Dependent Care FSA\nPaid parental leave\n25 annual leave days\nHome Office Allowance\nDedicated budget for training and professional development, participation in conferences\nState-of-the-art equipment\nFull access to the Hack The Box lab offerings; so you can learn how to hack\n️ The Quest of Becoming Hack The Box’s Senior Data Engineer:\nLevel 1: To complete level one’s objective, submit your application.\nLevel 2: Meet the Talent Acquisition team. Level’s objective: highlight your past achievements, ambitions, and values.\nLevel 3: Meet the hiring team. Level’s objective: connect with the hiring team and share with them your achievements.\nLevel 4: Complete 2 assignments that align with day-to-day job-related tasks and responsibilities. Part of the assignment is discussing it with the hiring team in a debriefing session, in order to walk the team through your thinking process.\nLevel 5: Congratulations! Not many reach this level . Level’s objective: have a constructive, final conversation with senior leadership to explore the role and your future at HTB.\nLevel 6: You've officially received an offer from HTB! To complete the last level and the Quest, all you need to do is accept the offer.\nQuest complete. Congratulations, you’re officially one of us Your next quest: complete the onboarding.\n\nHack Your Career, Today. Join us in this epic adventure of cybersecurity at Hack The Box!\n\nAt Hack The Box, we are on a quest to find the most exceptional and enthusiastic talent to join our team. Whether or not you consider yourself a gamer, we value what makes you unique and want to know more about you. This job post provides just a glimpse of the incredible gamified experience our business and consumer customers enjoy through our platforms. So, if you're ready to embark on a journey of growth and adventure, we can't wait to meet you!\n\nABOUT HACK THE BOX\n\nHack The Box is the Cyber Performance Center with the mission to provide a human-first platform to create and maintain high-performing cybersecurity individuals and organizations.\n\nHack The Box is the only platform that unites upskilling, workforce development, and the human focus in the cybersecurity industry, and it’s trusted by organizations worldwide for driving their teams to peak performance. Offering an all-in-one environment for continuous growth, assessment, and recruitment, Hack The Box provides solutions for all cybersecurity domains.\n\nLaunched in 2017, Hack The Box brings together the largest global cybersecurity community of more than 3 million platform members. Rapidly growing its international footprint and reach, Hack The Box is headquartered in the UK, with additional offices in the US, Australia, and Greece.\n\nExciting News:\n\nGet the most important updates on HTB’s latest year!\nWe are super proud to share that HTB’s all three entities across the UK, US, and Greece have been Certified as a Great Place to Work (Oct 2023-Oct 2024).\nFurthermore, in 2024 the HTB's Greek entity has been listed by the Great Place to Work Institute as the #2 Best Workplace in Greece and #10 Best Workplace in Europe (among Small & Medium Workplaces).\nTake a sneak peek at how it is to be part of HTB and our 2023 Global Retreat. Get more insights about our HTB culture and employee experience by visiting the “about us” section of our site, our career site, and Glassdoor.\n\nAt Hack The Box, we are committed to fostering a diverse, inclusive, and equitable workplace. We believe that diversity enriches our performance, services, and the communities we serve. As such, we ensure that all job applications are considered solely based on merit, skills, and qualifications. We do not discriminate on grounds of race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. We are dedicated to providing a fair and respectful work environment that reflects our values.","datePosted":"2026-08-29T10:09:42.319Z","dateModified":"2026-08-29T10:09:42.319Z","hiringOrganization":{"@type":"Organization","name":"Hackthebox","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Orlando","addressRegion":"FL","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"6b761fa60f3f4c70d48d1348"},"url":"https://jobsearcher.com/jobs/6b761fa60f3f4c70d48d1348"}}