{"schemaVersion":"jobsearcher.job.v1","id":"8e9fbecf062eaef87db145da","url":"https://jobsearcher.com/jobs/8e9fbecf062eaef87db145da","canonicalUrl":"https://jobsearcher.com/jobs/8e9fbecf062eaef87db145da","title":"Senior Python Kafka Engineer DRS Platform Modernization","description":"Job Title : Senior Python Kafka Engineer DRS Platform ModernizationLocation : Boston MAWork Mode : Remote (1st day onsite Mandatory at nearest LTM or End-Client work location)Interviews: 5 rounds of meetingResponsibilities:We are seeking a hands-on Senior Software Engineer to support the enhancement of an event driven digital repository platform. The role will focus on improving observability event lineage workflow reconciliation and Kafka delivery reliability across a distributed microservices ecosystem built primarily on Python and Kafka The engineer will work closely with the clients internal engineering team to implement solutions in a live production environmentPrimary Skills Mandatory:Python DevelopmentStrong experience developing and maintaining production grade Python applicationsUnderstanding of concurrency multithreading and asynchronous processingExperience with API integrations and distributed systemsFamiliarity with Python testing frameworks PyTest preferredApache KafkaHandson experience with Kafka in production environmentsStrong understanding of:Consumer groupsOffset managementPartitioning strategiesRetry mechanismsDeadletter queuesMessage delivery guaranteesConsumer rebalancing and troubleshootingPostgreSQLStrong SQL skillsExperience with PostgreSQL performance tuningExperience using JSONJSONB capabilitiesData modelling and query optimizationObservability LoggingDesign and implementation of structured JSON loggingLog standardization across distributed servicesMonitoring ing and troubleshooting best practicesEventDriven ArchitectureUnderstanding of distributed systems and event driven design patternsExperience with idempotency transactional processing and messaging reliabilitySecondary Skills Preferred:OpenTelemetryDistributed tracing implementationInstrumentation of microservicesEnd-to-end transaction visibilityOpen Lineage Data Lineage SolutionsEvent lineage trackingWorkflow traceabilityData movement and process visibilityKubernetesWorking knowledge of containerized workloadsDeployments ConfigMaps Secrets scaling and troubleshootingGitOps Deployment ToolsArgoCDKustomizeCICD deployment practicesMonitoring PlatformsGrafanaLokiMetrics and dashboard creationKey Responsibilities:Implement structured logging standards across Python based servicesEnhance Kafka consumer and producer reliabilityImprove retry recovery and dead letter handling mechanismsDesign and implement end-to-end event lineage and tracing capabilitiesDevelop reconciliation and completion tracking mechanisms to identify incomplete workflowsAnalyse and resolve production issues related to event processing and workflow executionCollaborate with platform engineers to improve observability and operational excellenceContribute to architecture discussions and implementation decisions related to distributed systemsExperience:8 years of software engineering experience3 years working with Kafka based distributed systemsStrong hands-on Python development experienceExperience working in Kubernetes based environmentsExperience with observability and monitoring implementationsMandatory Skills: Python","company":"VBeyond","rawCompany":"vbeyond","city":"Denver","state":"CO","isRemote":false,"isActive":false,"createdAt":"2026-09-22T13:25:21.625Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1211.00","title":"Computer Systems Analysts","slug":"computer-systems-analysts"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Python Kafka Engineer DRS Platform Modernization","description":"Job Title : Senior Python Kafka Engineer DRS Platform ModernizationLocation : Boston MAWork Mode : Remote (1st day onsite Mandatory at nearest LTM or End-Client work location)Interviews: 5 rounds of meetingResponsibilities:We are seeking a hands-on Senior Software Engineer to support the enhancement of an event driven digital repository platform. The role will focus on improving observability event lineage workflow reconciliation and Kafka delivery reliability across a distributed microservices ecosystem built primarily on Python and Kafka The engineer will work closely with the clients internal engineering team to implement solutions in a live production environmentPrimary Skills Mandatory:Python DevelopmentStrong experience developing and maintaining production grade Python applicationsUnderstanding of concurrency multithreading and asynchronous processingExperience with API integrations and distributed systemsFamiliarity with Python testing frameworks PyTest preferredApache KafkaHandson experience with Kafka in production environmentsStrong understanding of:Consumer groupsOffset managementPartitioning strategiesRetry mechanismsDeadletter queuesMessage delivery guaranteesConsumer rebalancing and troubleshootingPostgreSQLStrong SQL skillsExperience with PostgreSQL performance tuningExperience using JSONJSONB capabilitiesData modelling and query optimizationObservability LoggingDesign and implementation of structured JSON loggingLog standardization across distributed servicesMonitoring ing and troubleshooting best practicesEventDriven ArchitectureUnderstanding of distributed systems and event driven design patternsExperience with idempotency transactional processing and messaging reliabilitySecondary Skills Preferred:OpenTelemetryDistributed tracing implementationInstrumentation of microservicesEnd-to-end transaction visibilityOpen Lineage Data Lineage SolutionsEvent lineage trackingWorkflow traceabilityData movement and process visibilityKubernetesWorking knowledge of containerized workloadsDeployments ConfigMaps Secrets scaling and troubleshootingGitOps Deployment ToolsArgoCDKustomizeCICD deployment practicesMonitoring PlatformsGrafanaLokiMetrics and dashboard creationKey Responsibilities:Implement structured logging standards across Python based servicesEnhance Kafka consumer and producer reliabilityImprove retry recovery and dead letter handling mechanismsDesign and implement end-to-end event lineage and tracing capabilitiesDevelop reconciliation and completion tracking mechanisms to identify incomplete workflowsAnalyse and resolve production issues related to event processing and workflow executionCollaborate with platform engineers to improve observability and operational excellenceContribute to architecture discussions and implementation decisions related to distributed systemsExperience:8 years of software engineering experience3 years working with Kafka based distributed systemsStrong hands-on Python development experienceExperience working in Kubernetes based environmentsExperience with observability and monitoring implementationsMandatory Skills: Python","datePosted":"2026-09-22T13:25:21.625Z","dateModified":"2026-09-22T13:25:21.625Z","hiringOrganization":{"@type":"Organization","name":"VBeyond","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Denver","addressRegion":"CO","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"8e9fbecf062eaef87db145da"},"url":"https://jobsearcher.com/jobs/8e9fbecf062eaef87db145da"}}