{"schemaVersion":"jobsearcher.job.v1","id":"5243acbbbd192d3f25d64a9a","url":"https://jobsearcher.com/jobs/5243acbbbd192d3f25d64a9a","canonicalUrl":"https://jobsearcher.com/jobs/5243acbbbd192d3f25d64a9a","title":"Principal Machine Learning Engineer, Recommendation Platform (ML Platform)","description":"As a Principal Recommendation System/Platform Engineer, you will lead the upgrade of our core recommendation architecture and recommendation model platform, transforming our existing rule-based personalization system into an industrial-grade, large-scale, real-time ML recommendation platform. This role spans key business scenarios, including trading products, content feeds, the community, and AI-powered investment workflows such as TradeGPT.\r\nYou will work closely with recommendation algorithm, growth product and operations, and data science teams to build a high-throughput, low-latency, highly available foundation for personalization at scale, serving more than 80 million users globally. You will lead architectural decisions, infrastructure development, and end-to-end delivery, taking the platform from zero to one in a resource-constrained, fast-moving environment.\r\nKey ResponsibilitiesDevelop high-throughput, low-latency recommendation services. Continuously improve system performance and reliability, and establish robust degradation and disaster-recovery mechanisms.\r\nBuild and optimize large-scale model training infrastructure, including distributed training, job scheduling, resource management, fault recovery, and training observability. Improve training efficiency, stability, and resource utilization.\r\nBuild model deployment capabilities and high-performance online inference services. Optimize model loading, inference latency, throughput, and infrastructure cost; implement autoscaling, canary releases, graceful degradation, and disaster recovery to ensure service availability under high traffic.\r\nEstablish an engineering feedback loop from offline evaluation and online experimentation to production monitoring. Monitor model quality, service performance, and anomalies; build alerting capabilities to support incident diagnosis and safe rollback.\r\nCollaborate with recommendation algorithm and business engineering teams to identify common needs across trading products, content feeds, community, and other recommendation scenarios. Standardize training, deployment, and inference capabilities to bring models into production reliably and efficiently.\r\nMajor RequirementsAt least 4 years of recommender systems engineering experience at a consumer-facing internet company. You have contributed substantially to the design and development of a model training platform, model deployment platform, or large-scale online inference service, and have hands‑on experience resolving production issues.\r\nStrong computer science fundamentals and proficiency in at least one of Go, Java, or C++. You write well-structured code, apply sound design principles, and enjoy tackling challenging engineering problems.\r\nFamiliarity with at least one mainstream deep learning framework, such as PyTorch or TensorFlow. You understand the end-to-end workflow of training, exporting, deploying, and serving recommendation models, and have practical experience with distributed training or training job orchestration.\r\nAn understanding of the recommendation system lifecycle and the engineering considerations involved in sequence models, multi-objective models, and other recommender model types. You can work with algorithm teams to turn model requirements into reusable, maintainable production platform capabilities.\r\nExperience designing and optimizing high-throughput, low-latency services. You can diagnose and resolve online inference issues involving throughput, P99 latency, reliability, and resource cost.\r\nNice-to-have:Architecture experience in search, advertising, or recommendations at major technology companies\r\nExperience leading the development of a training platform, model deployment platform, or online inference pipeline from the ground up in a large-scale recommendation, advertising, or search system, and making those capabilities reusable across business scenarios.\r\nExperience optimizing distributed training or inference for complex recommendation models, or scheduling heterogeneous CPU/GPU resources.\r\nExperience with cross-region high-availability deployments, active-active architectures, model release governance, or large-scale production incident response.\r\nAn AI-driven approach and hands‑on experience bringing LLM or agent applications into production for search, advertising, or recommendation use cases.\r\nWhy Join UsA multi-domain recommendation challenge in fintech:Go beyond a single domain such as video or e-commerce. You will build personalization capabilities across trading products, market intelligence, community content, campaigns, and AI-powered investment workflows.\r\nProven business impact with substantial room for ML advancement:Our current recommendation system has demonstrated a 71% increase in CTR and a 1,285% increase in conversion rate, with significant potential for an ML-native upgrade.\r\nWork at the intersection of AI and recommendations:Build where traditional recommender systems, generative AI, and LLM agents meet—one of the most active frontiers in engineering.\r\nAn opportunity to lead, not just follow:Our combination of trading, content, community, AI, and campaigns creates distinctive technical challenges and enables rapid iteration.\r\nGlobal scale:Serve more than 80 million users across over 200 countries, tackling the real-world complexity of large-scale, real-time systems.#J-18808-Ljbffr","company":"Bylabs","rawCompany":"bylabs","city":"Millbrae","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-11-04T03:07:41.766Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1221.00","title":"Computer and Information Research Scientists","slug":"computer-and-information-research-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Principal Machine Learning Engineer, Recommendation Platform (ML Platform)","description":"As a Principal Recommendation System/Platform Engineer, you will lead the upgrade of our core recommendation architecture and recommendation model platform, transforming our existing rule-based personalization system into an industrial-grade, large-scale, real-time ML recommendation platform. This role spans key business scenarios, including trading products, content feeds, the community, and AI-powered investment workflows such as TradeGPT.\r\nYou will work closely with recommendation algorithm, growth product and operations, and data science teams to build a high-throughput, low-latency, highly available foundation for personalization at scale, serving more than 80 million users globally. You will lead architectural decisions, infrastructure development, and end-to-end delivery, taking the platform from zero to one in a resource-constrained, fast-moving environment.\r\nKey ResponsibilitiesDevelop high-throughput, low-latency recommendation services. Continuously improve system performance and reliability, and establish robust degradation and disaster-recovery mechanisms.\r\nBuild and optimize large-scale model training infrastructure, including distributed training, job scheduling, resource management, fault recovery, and training observability. Improve training efficiency, stability, and resource utilization.\r\nBuild model deployment capabilities and high-performance online inference services. Optimize model loading, inference latency, throughput, and infrastructure cost; implement autoscaling, canary releases, graceful degradation, and disaster recovery to ensure service availability under high traffic.\r\nEstablish an engineering feedback loop from offline evaluation and online experimentation to production monitoring. Monitor model quality, service performance, and anomalies; build alerting capabilities to support incident diagnosis and safe rollback.\r\nCollaborate with recommendation algorithm and business engineering teams to identify common needs across trading products, content feeds, community, and other recommendation scenarios. Standardize training, deployment, and inference capabilities to bring models into production reliably and efficiently.\r\nMajor RequirementsAt least 4 years of recommender systems engineering experience at a consumer-facing internet company. You have contributed substantially to the design and development of a model training platform, model deployment platform, or large-scale online inference service, and have hands‑on experience resolving production issues.\r\nStrong computer science fundamentals and proficiency in at least one of Go, Java, or C++. You write well-structured code, apply sound design principles, and enjoy tackling challenging engineering problems.\r\nFamiliarity with at least one mainstream deep learning framework, such as PyTorch or TensorFlow. You understand the end-to-end workflow of training, exporting, deploying, and serving recommendation models, and have practical experience with distributed training or training job orchestration.\r\nAn understanding of the recommendation system lifecycle and the engineering considerations involved in sequence models, multi-objective models, and other recommender model types. You can work with algorithm teams to turn model requirements into reusable, maintainable production platform capabilities.\r\nExperience designing and optimizing high-throughput, low-latency services. You can diagnose and resolve online inference issues involving throughput, P99 latency, reliability, and resource cost.\r\nNice-to-have:Architecture experience in search, advertising, or recommendations at major technology companies\r\nExperience leading the development of a training platform, model deployment platform, or online inference pipeline from the ground up in a large-scale recommendation, advertising, or search system, and making those capabilities reusable across business scenarios.\r\nExperience optimizing distributed training or inference for complex recommendation models, or scheduling heterogeneous CPU/GPU resources.\r\nExperience with cross-region high-availability deployments, active-active architectures, model release governance, or large-scale production incident response.\r\nAn AI-driven approach and hands‑on experience bringing LLM or agent applications into production for search, advertising, or recommendation use cases.\r\nWhy Join UsA multi-domain recommendation challenge in fintech:Go beyond a single domain such as video or e-commerce. You will build personalization capabilities across trading products, market intelligence, community content, campaigns, and AI-powered investment workflows.\r\nProven business impact with substantial room for ML advancement:Our current recommendation system has demonstrated a 71% increase in CTR and a 1,285% increase in conversion rate, with significant potential for an ML-native upgrade.\r\nWork at the intersection of AI and recommendations:Build where traditional recommender systems, generative AI, and LLM agents meet—one of the most active frontiers in engineering.\r\nAn opportunity to lead, not just follow:Our combination of trading, content, community, AI, and campaigns creates distinctive technical challenges and enables rapid iteration.\r\nGlobal scale:Serve more than 80 million users across over 200 countries, tackling the real-world complexity of large-scale, real-time systems.#J-18808-Ljbffr","datePosted":"2026-11-04T03:07:41.766Z","dateModified":"2026-11-04T03:07:41.766Z","hiringOrganization":{"@type":"Organization","name":"Bylabs","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Millbrae","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"5243acbbbd192d3f25d64a9a"},"url":"https://jobsearcher.com/jobs/5243acbbbd192d3f25d64a9a"}}