{"schemaVersion":"jobsearcher.job.v1","id":"eba6de1d5404fdf52f299e61","url":"https://jobsearcher.com/jobs/eba6de1d5404fdf52f299e61","canonicalUrl":"https://jobsearcher.com/jobs/eba6de1d5404fdf52f299e61","title":"Senior Data Platform Engineer","description":"Government-backed Abu Dhabi organization focused on advanced technology R&D (est. 2020), defining strategy, funding, and policies across AI, robotics, and emerging technologies. Oversees the full innovation lifecycle - from research and programs to commercialization - through dedicated applied research, innovation, and venture entities.\r\nThe first production system is an AI-enabled operational platform that gives a senior leadership team a shared situational picture, an AI-classified signal feed, a daily AI-generated briefing, and an action accountability tracker. MVP target: operational within two weeks of team formation. The platform is also the technical foundation for all subsequent Data & AI systems across the organization.\r\nResponsibilities\r\nBuild and operate the data platform that powers the DAIO's (Data & AI Office) production systems and the long-term data estate. In the immediate term: the signal ingestion pipeline, data quality layer, and observability for all data flows. In the medium term: the enterprise data warehouse on Azure and sovereign compute, the metadata catalog, and the governed data access layer for AI agents.\r\nWHAT THIS ROLE BUILDS & OWNS\r\nSignal ingestion pipeline — 30-minute polling job across all defined open-source feeds (news wires, maritime AIS, financial feeds, social/keyword feeds)\r\nDeduplication and normalization layer — common signal schema across all sources\r\nIngestion observability — every item logged with source, timestamp, processing status, and failure reason; no silent drops\r\nPostgreSQL schema deployment and migration scripts (Alembic)\r\nAzure Redis Cache — session management and ingestion queue configuration\r\nPhase2 data warehouse: ADLS + Synapse/Fabric, data ingestion from SAP, M365, and ATRC enterprise systems\r\nData quality monitoring — automated checks on signal completeness, classification coverage, and freshness\r\nKEY DECISIONS THIS ROLE OWNS\r\nPolling frequency, retry logic, and backoff strategy for each signal source\r\nDeduplication key design — what makes a signal unique across sources\r\nWhether a data quality failure is a warning (flag it) or a stop (pause ingestion)\r\nSchema migration approach — blue-green, Alembic auto-migrate, or manual rollout\r\nData retention schedule — what is archived, what is purged, and when\r\nWHAT THIS ROLE DOES NOT DO\r\nDefine the data model or classification schema — that is the Head of Data Architecture\r\nBuild the application API endpoints — that is the Backend/Systems Engineers\r\nWrite AI prompts or tune classification outputs\r\nManage cloud infrastructure provisioning — that is a DevOps/infra function\r\nSkills Required\r\nMicrosoft data stack - Fabric or Synapse;\r\nBuilding and supporting data pipelines(Airflow or similar);\r\nObservability and monitoring(prometheus/grafana/etc)\r\nEngagement Model: Direct Independent Contractor (Please read carefully)\r\nThis is an independent contractor opportunity based on a direct contractual relationship between Zoolatech and the individual service provider.\r\nTo facilitate this direct partnership, we engage with professionals who are registered and operate as a sole proprietorship, private entrepreneur, or an equivalent self-employment status in your country.\r\nPlease note, our model does not accommodate contracts through third-party intermediaries such as agencies, incubators, or umbrella companies. The essential requirement is your ability to enter into a service agreement and invoice Zoolatech directly. This is not an offer of direct employment\r\nPlease note that only candidates whose profiles closely match our requirements will be contacted.\r\nJ-18808-Ljbffr","company":"Zoolatech","rawCompany":"zoolatech","city":"Poland","state":"NY","isRemote":false,"isActive":false,"createdAt":"2026-04-09T15:27:40.943Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Data Platform Engineer","description":"Government-backed Abu Dhabi organization focused on advanced technology R&D (est. 2020), defining strategy, funding, and policies across AI, robotics, and emerging technologies. Oversees the full innovation lifecycle - from research and programs to commercialization - through dedicated applied research, innovation, and venture entities.\r\nThe first production system is an AI-enabled operational platform that gives a senior leadership team a shared situational picture, an AI-classified signal feed, a daily AI-generated briefing, and an action accountability tracker. MVP target: operational within two weeks of team formation. The platform is also the technical foundation for all subsequent Data & AI systems across the organization.\r\nResponsibilities\r\nBuild and operate the data platform that powers the DAIO's (Data & AI Office) production systems and the long-term data estate. In the immediate term: the signal ingestion pipeline, data quality layer, and observability for all data flows. In the medium term: the enterprise data warehouse on Azure and sovereign compute, the metadata catalog, and the governed data access layer for AI agents.\r\nWHAT THIS ROLE BUILDS & OWNS\r\nSignal ingestion pipeline — 30-minute polling job across all defined open-source feeds (news wires, maritime AIS, financial feeds, social/keyword feeds)\r\nDeduplication and normalization layer — common signal schema across all sources\r\nIngestion observability — every item logged with source, timestamp, processing status, and failure reason; no silent drops\r\nPostgreSQL schema deployment and migration scripts (Alembic)\r\nAzure Redis Cache — session management and ingestion queue configuration\r\nPhase2 data warehouse: ADLS + Synapse/Fabric, data ingestion from SAP, M365, and ATRC enterprise systems\r\nData quality monitoring — automated checks on signal completeness, classification coverage, and freshness\r\nKEY DECISIONS THIS ROLE OWNS\r\nPolling frequency, retry logic, and backoff strategy for each signal source\r\nDeduplication key design — what makes a signal unique across sources\r\nWhether a data quality failure is a warning (flag it) or a stop (pause ingestion)\r\nSchema migration approach — blue-green, Alembic auto-migrate, or manual rollout\r\nData retention schedule — what is archived, what is purged, and when\r\nWHAT THIS ROLE DOES NOT DO\r\nDefine the data model or classification schema — that is the Head of Data Architecture\r\nBuild the application API endpoints — that is the Backend/Systems Engineers\r\nWrite AI prompts or tune classification outputs\r\nManage cloud infrastructure provisioning — that is a DevOps/infra function\r\nSkills Required\r\nMicrosoft data stack - Fabric or Synapse;\r\nBuilding and supporting data pipelines(Airflow or similar);\r\nObservability and monitoring(prometheus/grafana/etc)\r\nEngagement Model: Direct Independent Contractor (Please read carefully)\r\nThis is an independent contractor opportunity based on a direct contractual relationship between Zoolatech and the individual service provider.\r\nTo facilitate this direct partnership, we engage with professionals who are registered and operate as a sole proprietorship, private entrepreneur, or an equivalent self-employment status in your country.\r\nPlease note, our model does not accommodate contracts through third-party intermediaries such as agencies, incubators, or umbrella companies. The essential requirement is your ability to enter into a service agreement and invoice Zoolatech directly. This is not an offer of direct employment\r\nPlease note that only candidates whose profiles closely match our requirements will be contacted.\r\nJ-18808-Ljbffr","datePosted":"2026-04-09T15:27:40.943Z","dateModified":"2026-04-09T15:27:40.943Z","hiringOrganization":{"@type":"Organization","name":"Zoolatech","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Poland","addressRegion":"NY","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"eba6de1d5404fdf52f299e61"},"url":"https://jobsearcher.com/jobs/eba6de1d5404fdf52f299e61"}}