<Back to Search
AI Architect - Heatlhcare
New York, NYMarch 20th, 2026
Must Have Technical/Functional Skills
• Experience:
o Must have SI experience with larger IT service provider
o 10+ years of experience in software architecture or engineering, with at least 5+ years in AI/ML specifically.
o Proven experience designing and developing multi-agent AI systems in a production environment.
o Significant experience in the healthcare industry, with a deep understanding of clinical workflows, RCM,
data standards (HL7, FHIR), and regulated environments.
• Technical skills:
o Expertise in multi-agent orchestration frameworks (e.g., LangChain, LangGraph, CrewAI, AutoGen).
o Deep knowledge of LLM architectures, RAG implementation, and techniques for fine-tuning models.
o Extensive experience with cloud platforms (AWS, Azure, or GCP) and related AI services.
o Strong background in data engineering, including building ETL pipelines and managing vector stores.
o Proficiency in Python and relevant AI/ML libraries (e.g., PyTorch, TensorFlow).
o Hands-on experience with MLOps practices and tools (e.g., Docker, Kubernetes, MLflow).
Roles & Responsibilities
• System architecture: Define the architectural vision and strategy for agentic AI solutions, designing end-to-end architectures
that include model integration, orchestration frameworks, memory systems, and tool-use capabilities.
• Technical leadership: Guide and mentor cross-functional teams of AI engineers, data scientists, and DevOps specialists on
architectural patterns and best practices for building scalable and reliable agentic AI systems.
• Cloud infrastructure and MLOps: Design and deploy multi-agent AI systems on cloud platforms (AWS, Azure, or GCP),
building and managing cloud-native AI pipelines with MLOps best practices for monitoring, evaluating, and scaling agents.
• Healthcare integration: Lead the integration of agentic AI solutions with existing healthcare systems, and other enterprise platforms,
while ensuring data interoperability and security.
• Responsible AI: Ensure the implementation of strong AI governance, security, and ethical practices throughout the agent lifecycle,
including bias mitigation, fairness checks, and compliance with healthcare regulations like HIPAA.
• Proof of concept and scaling: Lead proof-of-concept (PoC) initiatives to validate new agentic capabilities, then develop
strategies to scale successful prototypes into production-ready systems.
• Technology evaluation: Evaluate and integrate a wide range of open-source and proprietary AI tools and technologies,
including vector databases, orchestration frameworks (e.g., LangChain, CrewAI), and cloud-native AI services.
• Thought leadership: Stay current with the latest advancements in agentic AI, generative models, and multi-agent frameworks,
driving innovation within the company and potentially presenting at industry conferences.
2,030 matching similar jobs near New York, NY
- C++ Developer
- Consulting-Tech Con-AI and Data-Enterprise Data-Data Science-Manager-Multiple Positions - 1693808
- Technical Solution Architect, C&IP
- Principal GenAI Engineer
- Senior Synon Developer
- Sr. GenAI & ML Specialist Solutions Architect
- Solutions Architect - Federal
- Epic Tapestry Architect
- Senior Full Stack Software Developer
- Senior Engineer, AI-Orchestrated Full Stack Development
- Finance AI Manager
- Software Development Engineer III, Android
- Sales Practice Lead, Modern Infrastructure Solutions
- Sales Practice Lead, Modern Infrastructure Solutions
- Deliver with Gopuff - Earn Big & Keep 100% of Your Tips
- Applications Integration Specialist
- Senior Scalability Engineer - Observability
- Client Principal Architect, Cloud Digital - HCLS (Healthcare, Life Sciences)
- Staff ML Engineer
- Staff ML Engineer
- Principal Full Stack (AWS) Engineer
- Principal Full Stack (AWS) Engineer
- Senior Java Engineer
- Senior Java Engineer
- Senior Machine Learning Engineer (KServe Kubernetes, building Kubernetes Clusters, PyTorch, TensorFlow)
- VP of Engineering, API & Event Management Platform
- Artificial Intelligence Engineer
- Artificial Intelligence Engineer
- Broker Developer
- AI/ML Engineering Manager, Payment Intelligence
- Data Engineer: ETL & Analytics (Visa Sponsorship)
- Analytics Engineer - FanDuel Careers
- Data Engineering Solutions Architect
- Equity Full Stack Developer
- VP, Database Security & Data Protection (Hybrid)
- Full-Stack Engineer: Java, React & Kafka
- Consulting Systems Engineer, SLED New England
- Java Software Developer/Lead
- Staff Backend & Infra Engineer - Scale, Reliability, AI
- Infrastructure Architect