AI/ML Software Engineer

Public Sector Experience required in recent times. Candidates within DMV area or nearby area will be preferred,I’m working with the Administrative Office of the Courts (AOC) on an opportunity and wanted to connect regarding an AI/ML Software Engineer (LLMs / RAG / AI Systems) role.Please review the details below and let me know if you’re interested. If so, share your resume, rate expectations, and availability.Additional Details:JLocation: Remote (with occasional onsite in Annapolis, MD)Address: 189 Harry S Truman Parkway, Annapolis, MD 21401Duration: 5 yearsSubmission Requirements: Resume, LOC, 3 ReferencesInterview Process: Panel interview (Teams/Zoom, camera required)Work Model:Primarily remoteMust be onsite for first 2 daysMust be able to report onsite within 72 hours if requiredAbout the Role:This role focuses on building AI/ML-powered software systems to automate tasks, enhance internal workflows, and improve user-facing services. Work includes LLM-based applications, RAG systems, chatbots, and intelligent automation solutions.Scope of the Project:The focus is on designing and deploying AI-driven systems including document processing, knowledge retrieval, automation tools, and intelligent assistants, while working within constrained infrastructure and ensuring production-grade reliability.Daily Duties / Responsibilities:Design and develop AI/ML systems (LLMs, RAG, automation tools)Build and integrate chatbots, agents, and AI-powered workflowsDevelop backend services, APIs, and data pipelines (Python-based)Collaborate on system architecture, workflows, and model selectionImplement testing, evaluation, and performance optimization pipelinesDeploy and manage solutions in hybrid cloud / containerized environmentsOptimize systems for accuracy, latency, and cost efficiencyDocument system design and continuously improve solutionsRequired Skills (Ranked):3+ years experience in AI/ML, data science, or applied AI development3+ years experience in software engineering / backend developmentStrong proficiency in Python (APIs, data pipelines, backend systems)Experience with LLMs, embeddings, and retrieval systems (RAG)Experience with SQL / relational databases (PostgreSQL preferred)Experience with Docker, Git, and service-oriented architecturesPreferred Skills:Experience with multi-agent AI systems and workflow orchestrationExperience with vector databases, graph databases (Neo4j), retrieval systemsExperience fine-tuning language models or embedding modelsExperience integrating AI into production pipelines and mitigating hallucinationsFamiliarity with React or Teams Toolkit (chatbot UI development)Environment and Tools:Python, APIs, Data PipelinesLLM frameworks, RAG systemsPostgreSQL, SQLDocker, GitHybrid cloud environmentsAdditional Skills:Strong problem-solving and system design abilityAbility to work with ambiguous datasets and evolving requirementsStrong collaboration across technical teamsAbility to balance performance, cost, and scalabilityThis is not a basic ML role you’re expected to build production-grade AI systems, not just models or notebooks. If your experience is limited to experimentation or academic work, you’ll struggle here.