Software Developer S3

Workplace Type: On-site

Employment Type: Contract

Job Summary: All IT Solutions is seeking a Software Developer S3 to join a client engagement.

Responsibilities: Design and develop scalable AI-powered microservices and APIs using Python and FastAPI Build and maintain enterprise-grade RAG and Graph RAG solutions Develop intelligent agentic workflows that leverage organizational knowledge and business context Optimize knowledge retrieval, context orchestration, and response quality for AI applications Implement evaluation frameworks and monitoring solutions using DeepEval and Arize Deploy, monitor, and maintain AI applications on Azure Collaborate with product, engineering, and business teams to translate use cases into production-ready AI solutions

Required Qualifications: 8+ years of experience in software engineering with strong expertise in Python Hands-on experience designing and developing microservices-based architectures using FastAPI or similar Python frameworks Experience building scalable, secure, and production-grade APIs Strong experience with Microsoft Azure, including AI, data, and application services Expertise in MongoDB and NoSQL database design, optimization, and data modeling Experience deploying and managing cloud-native applications and containerized workloads Generative AI & Agentic Systems Proven experience developing Generative AI solutions using modern LLM frameworks Hands-on experience building AI Agents, multi-agent systems, and autonomous workflows Strong understanding of Retrieval-Augmented Generation (RAG) architectures, including Hybrid retrieval systems Context-aware retrieval pipelines Experience designing enterprise knowledge bases, semantic search solutions, and context-building frameworks Strong understanding of Large Language Models (LLMs) and Small Language Models (SLMs) Experience with model selection, prompt engineering, grounding strategies, fine-tuning approaches, and inference optimization Familiarity with model performance, latency, cost optimization, and governance considerations Hands-on experience implementing Agentic Evaluation frameworks, including tools such as DeepEval Experience designing evaluation metrics for Retrieval quality Hallucination detection Answer relevance Agent task completion Safety and reliability Experience with AI observability and monitoring platforms, particularly Arize AI, for production monitoring, tracing, and model performance analysis Must have existing hands on experience Neo4j or Graph Databases Vector Databases (Azure AI Search, Pinecone, Weaviate, Qdrant) GitHub Actions / Azure DevOps

Preferred Qualifications: Experience with vector databases and embedding models Familiarity with LangChain, LangGraph, Semantic Kernel, LlamaIndex, or similar AI orchestration frameworks Experience building enterprise AI applications with governance, security, and compliance considerations Knowledge of MLOps/LLMOps practices, CI/CD pipelines, and model lifecycle management Experience working in Agile product development environments ABOUT ALL IT SOLUTIONS LLC Headquartered in Mount Laurel, New Jersey, All IT Solutions LLC is a technology and workforce solutions company serving government and commercial organizations throughout the United States. AIS provides IT staffing and staff augmentation, cybersecurity, IT consulting, custom software development, cloud services, data engineering, artificial intelligence, application development, and related technology solutions. AIS is an NMSDC/EMSDC-certified Minority Business Enterprise and an NYC Department of Small Business Services-certified M/WBE. We participate in E-Verify and are committed to maintaining professional, transparent, and compliant hiring practices. EQUAL EMPLOYMENT OPPORTUNITY All IT Solutions LLC is an equal opportunity employer. Employment decisions are made based on qualifications, merit, performance, and legitimate business requirements without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, military or veteran status, or any other characteristic protected by applicable federal, state, or local law. Reasonable accommodations are available to qualified applicants with disabilities during the application and interview process. RECRUITMENT NOTICE All IT Solutions LLC is a staffing and technology services company and may receive fees or compensation from client organizations for recruiting, staffing, placement, or workforce services. Candidates are never charged an application, recruitment, placement, or interview fee by All IT Solutions LLC. Any commercial rates, fees, or staffing arrangements are between All IT Solutions LLC and its clients and do not require payment from the candidate. Official recruiting communications will come from an authorized All IT Solutions representative or an @allitsolutions.us email address. Apply Apply Now: https://careers.allitsolutions.net/jobs/software-developer-s3-2026-b8fbe4bf/apply