Data Platform Software Engineer

ONE Technology Services is hiring an experienced Data Platform Software Engineer on behalf of one of our prestigious clients. This role is a unique opportunity to establish the foundational direction and strategy for the data platform team. As the founding member, you will take the lead in designing, building, and scaling data storage and caching systems to petabyte-level capacity, setting the standard for reliability, availability, and performance in support of mission-critical applications. Additionally, you’ll have a pivotal role in pioneering retrieval-augmented generation systems, setting a precedent for cutting-edge data-driven capabilitiesWhat you need / Qualifications:Foundational Engineering Leadership: Significant experience in software engineering with a specialization in architecting, optimizing, and scaling data infrastructure, ideally as a founding or principal engineer.Visionary Data Store Architecting: Proven track record of architecting and scaling data stores to accommodate petabyte-level data volumes, with a clear vision for long-term data infrastructure strategy.Advanced Caching System Design: In-depth experience in designing high-efficiency caching systems to eliminate latency, enabling near-instantaneous data access across applications.Database & Infrastructure Mastery: Hands-on expertise in scaling, managing, and fine-tuning complex database systems, including MySQL, PostgreSQL, Redis, and OpenSearch, to meet enterprise-level demands.Programming & Software Development Excellence: Strong programming skills, particularly in Python and C++, with expertise in applying software development best practices to ensure robust, maintainable code.Distributed Data Processing Frameworks: Familiarity with distributed data processing frameworks and a comprehensive understanding of various database management systems to guide strategic technology decisions.Retrieval-Augmented Generation Systems Expertise: A solid background in retrieval-augmented generation systems and their application within data workflows, with the ability to leverage this technology for innovation.What you'll do:You will lead the design, development, and scaling of our data storage and caching systems to petabyte scale while also spearheading the development of advanced retrieval augmented generation systems.Develop highly efficient caching systems that obliterate latency, ensuring lightning-fast data access.Tackle data infrastructure challenges head-on, swiftly troubleshooting and resolving issues to minimize downtime.Lead groundbreaking efforts in the retrieval of augmented generation systems, pushing the boundaries of what's possible.ONE Technology Services We specialize in staffing and software development services, including custom app development, custom web development, staff augmentation, managed and cloud solutions, technical recruitment, and IT consultancy.ONE Technology Services is also a product-based company. Our products, Workshop solution and ERP solution for services-based businesses, are already well-tested and solve business problems by hitting the bull's eye. These products are highly customizable to address the specific needs of our clients. Having 20+ years of industry experience with top US and Canadian companies enables us to know exactly how to solve all our clients’ business challenges.