AI/ML Software Engineer

AI/ML Software Engineer Location: Administrative Office of the Courts (AOC) - Annapolis, Maryland Role: The AI/ML Software Engineer will build software tools that incorporate artificial intelligence and machine learning techniques to automate narrowly defined tasks with high accuracy, assist internal users with their job functions, and improve the experience external users have when interacting with user-facing systems. The work includes developing AI-enabled solutions for automation, knowledge retrieval, document processing, and data analysis within established technical constraints. Duties: The AI/ML Software Engineer will: System Design & CollaborationDesign and build software systems that integrate AI/ML techniques to automate tasks, assist internal users, and improve user-facing servicesWork within established constraints related to infrastructure, programming languages, and model selectionContribute to technical decision-making related to data processing, retrieval strategies, and system integrationCollaborate with team members to define agent architectures, workflows, and system design decisionsEvaluate and select appropriate approaches for assigned tasks, including determining when to use LLM-based versus non-LLM techniques Testing, Evaluation & Quality AssuranceAssist in the design and implementation of testing and evaluation pipelines for AI/ML systemsDevelop unit and integration tests for AI-enabled workflows and data pipelinesGenerate and use synthetic data to support evaluation and benchmarking effortsContribute to improving system performance, including accuracy, latency, and cost efficiency Deployment & OperationsSupport deployment of AI/ML applications within a hybrid cloud environmentWork with containerized applications to ensure reliable deployment and updatesOptimize systems for environments with limited computational resources, including minimal GPU availability General ResponsibilitiesDeliver production-grade systems aligned with defined requirements while supporting iterative improvement of evolving toolsDocument system designs, workflows, and technical decisions as requiredStay informed on relevant advancements in AI/ML and apply them where appropriate within project constraints Education:Bachelor of Science in Engineering, Computer Science, Data Science, Mathematics, or a related technical field is required Required Experience and Skills:At least 3 years' experience in data science, machine learning, or applied AI developmentAt least 3 years' experience in software engineering, architecture, or web developmentExperience building AI/ML-enabled software systems, including LLM-based and non-LLM approachesExperience with Python for developing backend services, APIs, middleware, and data pipelinesExperience with SQL and relational databases (e.g., PostgreSQL) Preferred Skills:Experience working with large language models, including API-based integration and local deploymentExperience with RAG systems, including embeddings, vector similarity, reranking, and graph-based retrievalFamiliarity with testing and evaluation pipelines for AI systems, including the use of synthetic dataExperience validating AI-generated outputs and integrating AI tools into production systemsExperience with Git, Docker, containerization, and service-oriented architecturesKnowledge of hybrid cloud environments and distributed systemsExperience designing multi-agent or task-oriented AI systemsFamiliarity with graph databases, asynchronous processing, and backend queuesKnowledge of classical NLP techniques alongside LLM-based approaches