JOBSEARCHER

Senior Backend Engineer (Audience Builder Platform Customer Data Platform Engineering)

ARCHIVED

We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.

Senior Backend Engineer (Audience Builder Platform — Customer Data Platform Engineering)Client is building the next generation of its Customer Data Platform (CDP) a massive scale Audience Builder and Campaign Management platform serving over 400 million customer profiles.We're looking for a Senior Backend Engineer who loves hard problems distributed systems at scale, real-time data pipelines, and the infrastructure that powers one of the most ambitious marketing technology platforms in the industry.This role sits at the intersection of CDP engineering, data platform architecture, and marketing technology.You will design, build, and own the services, APIs, and platform capabilities that underpin client ability to understand, segment, and activate its customer base across every channel in near real-time.Customer Data Platforms are the backbone of modern, personalized marketing. At client scale 400M+ profiles, petabytes of behavioral and transactional data, dozens of activation channels building the CDP backend is a genuine engineering challenge.You'll work on:Identity resolution and profile unification across fragmented customer touchpointsSub-second audience segmentation across hundreds of millions of profilesEvent-driven data pipelines that keep customer profiles fresh in near real-timeMulti-channel activation from Kafka topics to S3 exports to partner APIsThe observability, reliability, and security infrastructure that makes all of it trustworthy at scaleKey Responsibilities:CDP Customer Profile PlatformDesign and operate the unified customer profile layer the core of client CDP supporting 400M+ profiles with high-throughput ingestion, identity resolution, and real time enrichment.Architect and build scalable customer profile services supporting 400M+ profiles with sub-second access patternsImplement identity resolution and profile stitching across first-party and third party data sources a critical CDP capabilitySupport high-volume batch ingestion, incremental processing, and near real time profile updates driven by behavioral eventsEvaluate and implement storage technologies including Cassandra, DynamoDB, ScyllaDB, MongoDB, and PostgreSQL for distinct workload profilesBuild attribute enrichment pipelines that continuously improve profile completeness and accuracyImplement data governance controls including consent management, data suppression, and regulatory compliance hooks (CCPA, TCPA)Real Time Data Ingestion & Event ProcessingBuild the event driven infrastructure that keeps customer profiles synchronized with what's happening right now the heartbeat of a modern CDP.Design and build event-driven architectures using Kafka and event streaming platforms for real time profile updatesImplement change data capture (CDC) pipelines to propagate updates from source systems into the CDP profile storeBuild data synchronization services supporting multi source fan-in and downstream fan out to activation channelsImplement dead-letter queues, retry strategies, and failure recovery for mission-critical data pipelinesEnsure event ordering guarantees and exactly once processing semantics where requiredAudience Segmentation EngineBuild the high-performance segmentation engine that enables marketers to define and generate audiences of any complexity at scale.Design and build an audience generation service capable of evaluating complex nested filter logic across 400M+ profilesSupport attribute-based filtering, hierarchical attribute traversal, AND/OR conditional logic, inclusion and exclusion criteriaImplement dynamic audience generation with real-time estimation to support pre-activation reach planningOptimize query execution using columnar storage, pre-aggregation, and intelligent caching strategiesBuild audience snapshot and version management to support reproducibility and campaign historyIntegrate with the CDP profile store to ensure segmentation reflects the most current available profile stateCampaign Management & Lifecycle ServicesBuild the durable, consistent services that manage campaign definitions from creation through execution.Develop APIs for campaign creation, versioning, configuration, approval, scheduling, and lifecycle transitionsPersist campaign definitions, segmentation rules, targeting criteria, and execution metadata with full audit supportImplement campaign versioning and change tracking to support rollback, comparison, and governance requirementsBuild approval workflow services supporting configurable multi-stage review before campaign activationAnalytics & Audience InsightsBuild the analytical layer that gives users visibility into audience composition, campaign reach, and performance — a defining capability of enterprise CDPs.Build services providing real-time audience size estimation, reachability calculations, and channel eligibility analysisImplement segment distribution analytics demographic breakdowns, attribute frequency distributions, overlap analysisSupport both real-time query serving and scheduled batch analytical workloadsBuild historical campaign reporting infrastructure for performance analysis and optimization feedback loopsExpose analytical APIs that the UI layer can leverage for interactive explorationActivation & Multi-Channel DeliveryImplement the delivery layer that gets audience segments into activation channels reliably and at scale.Build file-based delivery to Amazon S3, Azure Blob Storage, and Google Cloud Storage for downstream consumptionImplement API-based delivery to internal and external partner systems via REST and event-based integrationsBuild event-based delivery using Kafka topics, Event Hubs, and Pub/Sub systemsImplement delivery monitoring, configurable retry policies, and failure recovery with full observabilitySupport delivery SLAs with alerting and automated escalation for time-sensitive campaign activationsCampaign Execution OrchestrationBuild the orchestration layer that reliably executes campaign activations on schedule and at scale.Design and build an orchestration service supporting one-time, recurring, and scheduled campaign activationsImplement distributed scheduling with fault tolerance, retry, and idempotent execution guaranteesBuild execution monitoring with real-time status tracking, alerting, and SLA enforcementSupport parallel execution across large audience segments with configurable concurrency and rate limitingSecurity, Multi Tenancy & GovernanceImplement Role-Based Access Control (RBAC) with fine-grained permissions at workspace, campaign, and data levelsBuild multi-workspace architecture with strict data isolation and cross-workspace access controlsImplement audit logging for all data access, mutation events, and system actionsIntegrate data governance controls supporting consent flags, data suppression lists, and regulatory requirementsBuild security monitoring and anomaly detection for sensitive customer data access patternsPlatform Reliability & ObservabilityBuild observability solutions including metrics, structured logging, distributed tracing, and alertingDefine and instrument SLIs, SLOs, and SLAs across all platform servicesImplement capacity planning tooling and auto-scaling patterns for traffic variabilityConduct regular chaos engineering and failure mode analysis to improve platform resilienceTechnical Skills:Languages DatabasesJava / Kotlin (primary) Cassandra / ScyllaDBPython DynamoDBGo MongoDBSQL PostgreSQL / AuroraScala (preferred) Redis / ElastiCacheStreaming & Messaging Cloud & InfrastructureApache Kafka AWS (primary)Event Streaming Platforms AzureMessage Queues (SQS, Pub/Sub) Google Cloud PlatformChange Data Capture (Debezium) Kubernetes / DockerCI/CD PipelinesArchitecture Patterns Data & ObservabilityMicroservices Architecture Spark / Flink (batch/stream)Event-Driven Architecture dbt / Data ModelingREST APIs / gRPC OpenTelemetry / JaegerDistributed Systems Prometheus / GrafanaPreferred Qualifications:CDP & MARKETING TECHNOLOGY EXPERIENCECustomer Data Platform (CDP) design and implementation at scaleIdentity