Software Engineer – Data Streaming Platforms

DescriptionJob DescriptionWe are seeking a Software Engineer with a strong focus on data streaming and real-time processing platforms to help design, build, and operate scalable, high-throughput, low-latency systems. This role will work on distributed systems that ingest, process, and deliver streaming data used for analytics, machine learning, monitoring, and mission-critical applications. You will collaborate closely with data engineers, platform engineers, product teams, and infrastructure to ensure reliability, performance, and scalability across streaming pipelines.ResponsibilitiesDesign, build, and maintain scalable data streaming pipelinesDevelop and operate event-driven architectures using streaming technologiesImplement real-time and near-real-time data processing applicationsEnsure data correctness, ordering, fault tolerance, and exactly-once or at-least-once semantics as requiredContribute to the design and evolution of streaming platforms and internal data infrastructureBuild resilient, high-availability services capable of handling large volumes of dataOptimize systems for throughput, latency, and resource efficiencyParticipate in capacity planning and performance tuningImplement monitoring, logging, alerting, and metrics for streaming applicationsDebug production issues related to performance, lag, data loss, or backpressureSupport on-call rotations and incident response for critical data systemsImprove automation, deployment pipelines, and operational toolingCollaborate with product, analytics, and ML teams to support data use casesWrite clean, maintainable, and well-tested codeParticipate in design reviews, code reviews, and technical discussionsContribute to documentation and engineering best practicesRequired QualificationsBachelor’s degree in Computer Science, Computer Engineering, or a related technical field (or equivalent practical experience).3+ years of professional software engineering experience.Systems Programming: 2+ years of hands-on experience programming real-time applications at the Low-Level / Packet Level using C, C++, or Rust.Must be highly comfortable with manual memory management, pointer manipulation, and multi-threaded optimizations.Strong experience in a modern concurrency language like Go or Python for stream orchestration, tooling, and control-plane API development.Network Protocols: Deep, foundational understanding of UDP and TCP/IP networking mechanics. Direct experience managing socket programming, custom congestion control, packet pacing, and error correction techniques (ARQ / selective retransmission).Media Transport: Proven experience with broadcast and linear video workflows, including media containers and multiplexing (specifically MPEG-TS wrappers).Experience building custom stream troubleshooting, diagnostic, or real-time monitoring software.Codecs: Codec-agnostic architecture mindset with low-level implementation knowledge of H.264/AVC, H.265/HEVC, and emerging standards like AV1.Automation & Scripting: Strong scripting capabilities in Python or Bash for stream orchestration, pipeline automation, and local-first systems management.Preferred QualificationsDirect development experience with libsrt, librist, RTMP, or similar APIs.Deep familiarity with open-source media frameworks like FFmpeg, Astreamer, GStreamer, and low level packet streaming tools.Experience using network analysis to debug packet loss, jitter, clock drift, and MTU issues on live networks.Familiarity with AWS, GCP, or Azure specifically regarding networking components (firewall traversal, listener/caller architecture, and high-bandwidth ingress).Lightweight containerization experience or portable streaming endpoints or edge-compute tools.Knowledge of serialization formats (like Protobuf or JSON) strictly for control-plane APIs and performance telemetry aggregation.About the Organization Eccalon provides global solutions to the most challenging technological issues of the 21st-century, and our evolving portfolio spans five major markets: Machine Learning, Cybersecurity, Aerospace & Defense, Material Sciences, Advance Manufacturing, Sports Science, Biotechnology, and Health & Life Sciences.Why Join Us?Eccalon's Executives foster a supportive work environment allowing our teams to thrive, and have a fierce dedication to innovation, security, and people. Our culture is built on inclusion, teamwork, trust, and we are committed to offering career advancement opportunities to all employees. Encouraging a healthy and balanced life, we offer an extensive benefits package to support the wellness of our employees and their families. You will be joining a team of innovators, working with cutting edge technologies, supporting mission critical projects, and making an impact.Apply today to advance your career!EOE Statement Eccalon provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.EEO is the law.