{"schemaVersion":"jobsearcher.job.v1","id":"9f1ecba8b7d7a21a4607f2c8","url":"https://jobsearcher.com/jobs/9f1ecba8b7d7a21a4607f2c8","canonicalUrl":"https://jobsearcher.com/jobs/9f1ecba8b7d7a21a4607f2c8","title":"Senior Engineer - Data, Schema & Knowledge Systems","description":"Introduction\nAt IBM Software, we transform client challenges into solutions. Building the world’s leading AI-powered, cloud-native products that shape the future of business and society. Our legacy of innovation creates endless opportunities for IBMers to learn, grow, and make an impact on a global scale. Working in Software means joining a team fueled by curiosity and collaboration. You’ll work with diverse technologies, partners, and industries to design, develop, and deliver solutions that power digital transformation. With a culture that values innovation, growth, and continuous learning, IBM Software places you at the heart of IBM’s product and technology landscape. Here, you’ll have the tools and opportunities to advance your career while creating software that changes the world.\n\nYour role and responsibilities\nWe are seeking a Senior Software Engineer to own and evolve core platform systems spanning knowledge ingestion, memory architecture, evaluation infrastructure, and gateway data management. This role has deep architectural ownership across Rust- and Go-based services and directly impacts search quality, model evaluation, compliance, and platform extensibility.\n\nWhat You’ll Own\nKnowledge Base & Memory (Rust)\n\nDesign and evolve the data schema and ingestion pipeline supporting large-scale documentation corpora, including document extraction, segmentation, and hybrid search (BM25 + vector).\n\nImprove corpus quality through deduplication, relevance tuning, quality scoring, source-of-truth tracking, and versioned corpus management.\n\nOwn the memory architecture across working, semantic, and observational memory tiers, designing retrieval that is context-aware and budget-conscious.\n\nEvolve federated search capabilities, including multi-KB querying, relevance tuning, embedding model selection, and quality metrics.\n\nBuild and scale an evaluation curation system for an LLM-as-judge framework, including versioned eval datasets, regression baselines, and authoring tooling.\n\nGateway Data Management (Go / Rust)\n\nDesign and implement a schema-driven entity registry with YAML-defined schemas, enabling new infrastructure connectors without code changes.\n\nOwn declarative state machine configuration decoupled from hardcoded logic.\n\nDesign a domain-agnostic evidence model to support audit and compliance requirements (e.g., PCI-DSS, SOX).\n\nFormalize metadata and provenance tracking across entities, including import/export and multi-connector support.\n\nEvaluation Infrastructure (Go)\n\nExtend evaluation frameworks for end-to-end coverage across composable pipelines.\n\nDesign eval schemas, dataset management tooling, and regression thresholds.\n\nPartner with other teams on shared benchmarks, test corpora, and multi-model evaluation strategy.\n\nTrack and report model quality metrics to support production deployment decisions.\n\nWhat the First 90 Days Look Like\nMonth 1: Onboard onto the Rust and Go services. Understand the knowledge base ingestion pipeline end-to-end: document download, extraction, chapter splitting, indexing, federated search. Run the eval framework, review existing eval cases, understand the LLM-as-judge scoring rubric. Identify quality issues in the current documentation corpus.\n\nMonth 2: Ship the entity registry refactor — dynamic entity registration with YAML schema definitions. Design the eval curation system — dataset versioning, case authoring tooling, regression baseline management. Begin expanding eval corpus coverage.\n\nMonth 3: Ship the evidence model schema. Implement eval curation tooling. Begin knowledge base quality improvements — deduplication, source-of-truth tracking, relevance tuning. Establish eval quality dashboard with cross-model comparison.\n\nRequired technical and professional expertise\n\nData modeling instincts. You think naturally about schemas, entity relationships, state machines, and how data evolves over time. You’ve designed data models that other engineers build against.\n\nInformation retrieval or search experience. You’ve worked with search indexing, document processing, corpus management, or similar — you understand how to make unstructured data findable and useful.\n\nYou can ship across languages. This role works in both Rust and Go. You don’t need to be an expert in both, but you need to be productive in at least one and willing to learn the other.\n\nQuality measurement mindset. You’ve built or worked with evaluation systems, quality metrics, regression detection, or A/B testing infrastructure. You understand how to measure whether something is getting better or worse.\n\nPreferred technical and professional experience\n\nIBM Z domain knowledge — the documentation sets, infrastructure concepts, and operational patterns that the knowledge base serves\n\nLLM evaluation methodology — rubric-based scoring, LLM-as-judge patterns, baseline regression, multi-model comparison\n\nOur knowledge base ingestion pipeline (document extraction, chunking, vector + full-text indexing)\n\nIBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.\n\n#J-18808-Ljbffr","company":"IBM Computing","rawCompany":"ibm computing","city":"Austin","state":"TX","isRemote":false,"isActive":false,"createdAt":"2026-06-17T03:31:25.795Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"}],"industries":[{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Engineer - Data, Schema & Knowledge Systems","description":"Introduction\nAt IBM Software, we transform client challenges into solutions. Building the world’s leading AI-powered, cloud-native products that shape the future of business and society. Our legacy of innovation creates endless opportunities for IBMers to learn, grow, and make an impact on a global scale. Working in Software means joining a team fueled by curiosity and collaboration. You’ll work with diverse technologies, partners, and industries to design, develop, and deliver solutions that power digital transformation. With a culture that values innovation, growth, and continuous learning, IBM Software places you at the heart of IBM’s product and technology landscape. Here, you’ll have the tools and opportunities to advance your career while creating software that changes the world.\n\nYour role and responsibilities\nWe are seeking a Senior Software Engineer to own and evolve core platform systems spanning knowledge ingestion, memory architecture, evaluation infrastructure, and gateway data management. This role has deep architectural ownership across Rust- and Go-based services and directly impacts search quality, model evaluation, compliance, and platform extensibility.\n\nWhat You’ll Own\nKnowledge Base & Memory (Rust)\n\nDesign and evolve the data schema and ingestion pipeline supporting large-scale documentation corpora, including document extraction, segmentation, and hybrid search (BM25 + vector).\n\nImprove corpus quality through deduplication, relevance tuning, quality scoring, source-of-truth tracking, and versioned corpus management.\n\nOwn the memory architecture across working, semantic, and observational memory tiers, designing retrieval that is context-aware and budget-conscious.\n\nEvolve federated search capabilities, including multi-KB querying, relevance tuning, embedding model selection, and quality metrics.\n\nBuild and scale an evaluation curation system for an LLM-as-judge framework, including versioned eval datasets, regression baselines, and authoring tooling.\n\nGateway Data Management (Go / Rust)\n\nDesign and implement a schema-driven entity registry with YAML-defined schemas, enabling new infrastructure connectors without code changes.\n\nOwn declarative state machine configuration decoupled from hardcoded logic.\n\nDesign a domain-agnostic evidence model to support audit and compliance requirements (e.g., PCI-DSS, SOX).\n\nFormalize metadata and provenance tracking across entities, including import/export and multi-connector support.\n\nEvaluation Infrastructure (Go)\n\nExtend evaluation frameworks for end-to-end coverage across composable pipelines.\n\nDesign eval schemas, dataset management tooling, and regression thresholds.\n\nPartner with other teams on shared benchmarks, test corpora, and multi-model evaluation strategy.\n\nTrack and report model quality metrics to support production deployment decisions.\n\nWhat the First 90 Days Look Like\nMonth 1: Onboard onto the Rust and Go services. Understand the knowledge base ingestion pipeline end-to-end: document download, extraction, chapter splitting, indexing, federated search. Run the eval framework, review existing eval cases, understand the LLM-as-judge scoring rubric. Identify quality issues in the current documentation corpus.\n\nMonth 2: Ship the entity registry refactor — dynamic entity registration with YAML schema definitions. Design the eval curation system — dataset versioning, case authoring tooling, regression baseline management. Begin expanding eval corpus coverage.\n\nMonth 3: Ship the evidence model schema. Implement eval curation tooling. Begin knowledge base quality improvements — deduplication, source-of-truth tracking, relevance tuning. Establish eval quality dashboard with cross-model comparison.\n\nRequired technical and professional expertise\n\nData modeling instincts. You think naturally about schemas, entity relationships, state machines, and how data evolves over time. You’ve designed data models that other engineers build against.\n\nInformation retrieval or search experience. You’ve worked with search indexing, document processing, corpus management, or similar — you understand how to make unstructured data findable and useful.\n\nYou can ship across languages. This role works in both Rust and Go. You don’t need to be an expert in both, but you need to be productive in at least one and willing to learn the other.\n\nQuality measurement mindset. You’ve built or worked with evaluation systems, quality metrics, regression detection, or A/B testing infrastructure. You understand how to measure whether something is getting better or worse.\n\nPreferred technical and professional experience\n\nIBM Z domain knowledge — the documentation sets, infrastructure concepts, and operational patterns that the knowledge base serves\n\nLLM evaluation methodology — rubric-based scoring, LLM-as-judge patterns, baseline regression, multi-model comparison\n\nOur knowledge base ingestion pipeline (document extraction, chunking, vector + full-text indexing)\n\nIBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.\n\n#J-18808-Ljbffr","datePosted":"2026-06-17T03:31:25.795Z","dateModified":"2026-06-17T03:31:25.795Z","hiringOrganization":{"@type":"Organization","name":"IBM Computing","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Austin","addressRegion":"TX","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"9f1ecba8b7d7a21a4607f2c8"},"url":"https://jobsearcher.com/jobs/9f1ecba8b7d7a21a4607f2c8"}}