{"schemaVersion":"jobsearcher.job.v1","id":"68ed7285d34e36e93cce1b22","url":"https://jobsearcher.com/jobs/68ed7285d34e36e93cce1b22","canonicalUrl":"https://jobsearcher.com/jobs/68ed7285d34e36e93cce1b22","title":"Senior Data Platform Engineer","description":"Overview In this role you will own the core platform capabilities underlying a large-scale, AI-powered data platform. You’ll work closely with platform consumers to design reusable ingestion, storage, and compute foundations, enabling business teams to build their pipelines. You apply an agentic development approach to accelerate delivery and collaborate across multi-technology stacks. This position offers impact through platform scalability, governance, and tooling that empowers AI agents and humans alike. You will help shape a resilient, observable data platform that supports mission-critical workloads. Compensation / Benefits medical, dental, and vision coverage 401(k) with company match paid time off and holidays parental leave professional development reimbursement Responsibilities Design, build, and operate core platform capabilities on top of Airflow, Spark, and Flink for batch and streaming processing to enable downstream pipelines Own the data lakehouse layer built on Iceberg, Nessie, Trino, and StarRocks, including table format management, catalog governance, and storage lifecycle Build and maintain Kafka-based streaming infrastructure for internal and downstream use Develop reusable ingestion, cleansing, and harmonization frameworks to standardize data onboarding Create UI components for platform visibility into state, catalogs, job status, and data quality Design and build APIs to expose platform data/capabilities to downstream teams with governance and security Develop MCP servers/interfaces for AI agents/LLM tools to access platform data and lineage Extend agentic tooling with guardrails and human-in-the-loop controls for autonomous actions Partner with platform consumers to translate needs into capability requirements Ensure scalable, resilient platform through capacity planning, performance tuning, and architectural evolution Establish engineering best practices: testing, CI/CD, IaC, code/architecture reviews Mentor other engineers on platform internals and agentic tooling Key requirements 8-12 years of software/data engineering experience Hands-on experience with at least several: Airflow, Iceberg, Spark, Flink, Kafka, Nessie, Trino, StarRocks Strong understanding of lakehouse architecture (table formats, catalog management, query engines) Experience designing APIs with governance, versioning, and multi-tenant security Experience or strong interest in MCP-like agent-facing interfaces for AI agents Hands-on experience using AI coding agents to boost delivery speed and quality Strong systems engineering fundamentals: distributed systems, performance, capacity planning Experience building production observability (metrics, logging, tracing) for complex data infra Comfortable as an individual contributor with mentorship ability ownership mindset ability to mentor others without formal authority collaboration with cross-functional teams Apache Airflow Apache Iceberg Apache Spark","company":"SSC Technologies","rawCompany":"ssc technologies","city":"Plainfield","state":"CT","isRemote":false,"isActive":true,"createdAt":"2026-11-15T11:53:49.045Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Data Platform Engineer","description":"Overview In this role you will own the core platform capabilities underlying a large-scale, AI-powered data platform. You’ll work closely with platform consumers to design reusable ingestion, storage, and compute foundations, enabling business teams to build their pipelines. You apply an agentic development approach to accelerate delivery and collaborate across multi-technology stacks. This position offers impact through platform scalability, governance, and tooling that empowers AI agents and humans alike. You will help shape a resilient, observable data platform that supports mission-critical workloads. Compensation / Benefits medical, dental, and vision coverage 401(k) with company match paid time off and holidays parental leave professional development reimbursement Responsibilities Design, build, and operate core platform capabilities on top of Airflow, Spark, and Flink for batch and streaming processing to enable downstream pipelines Own the data lakehouse layer built on Iceberg, Nessie, Trino, and StarRocks, including table format management, catalog governance, and storage lifecycle Build and maintain Kafka-based streaming infrastructure for internal and downstream use Develop reusable ingestion, cleansing, and harmonization frameworks to standardize data onboarding Create UI components for platform visibility into state, catalogs, job status, and data quality Design and build APIs to expose platform data/capabilities to downstream teams with governance and security Develop MCP servers/interfaces for AI agents/LLM tools to access platform data and lineage Extend agentic tooling with guardrails and human-in-the-loop controls for autonomous actions Partner with platform consumers to translate needs into capability requirements Ensure scalable, resilient platform through capacity planning, performance tuning, and architectural evolution Establish engineering best practices: testing, CI/CD, IaC, code/architecture reviews Mentor other engineers on platform internals and agentic tooling Key requirements 8-12 years of software/data engineering experience Hands-on experience with at least several: Airflow, Iceberg, Spark, Flink, Kafka, Nessie, Trino, StarRocks Strong understanding of lakehouse architecture (table formats, catalog management, query engines) Experience designing APIs with governance, versioning, and multi-tenant security Experience or strong interest in MCP-like agent-facing interfaces for AI agents Hands-on experience using AI coding agents to boost delivery speed and quality Strong systems engineering fundamentals: distributed systems, performance, capacity planning Experience building production observability (metrics, logging, tracing) for complex data infra Comfortable as an individual contributor with mentorship ability ownership mindset ability to mentor others without formal authority collaboration with cross-functional teams Apache Airflow Apache Iceberg Apache Spark","datePosted":"2026-11-15T11:53:49.045Z","dateModified":"2026-11-15T11:53:49.045Z","hiringOrganization":{"@type":"Organization","name":"SSC Technologies","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Plainfield","addressRegion":"CT","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"68ed7285d34e36e93cce1b22"},"url":"https://jobsearcher.com/jobs/68ed7285d34e36e93cce1b22"}}