<Back to Search
AI Architect - Heatlhcare
New York, NYMarch 20th, 2026
Must Have Technical/Functional Skills
• Experience:
o Must have SI experience with larger IT service provider
o 10+ years of experience in software architecture or engineering, with at least 5+ years in AI/ML specifically.
o Proven experience designing and developing multi-agent AI systems in a production environment.
o Significant experience in the healthcare industry, with a deep understanding of clinical workflows, RCM,
data standards (HL7, FHIR), and regulated environments.
• Technical skills:
o Expertise in multi-agent orchestration frameworks (e.g., LangChain, LangGraph, CrewAI, AutoGen).
o Deep knowledge of LLM architectures, RAG implementation, and techniques for fine-tuning models.
o Extensive experience with cloud platforms (AWS, Azure, or GCP) and related AI services.
o Strong background in data engineering, including building ETL pipelines and managing vector stores.
o Proficiency in Python and relevant AI/ML libraries (e.g., PyTorch, TensorFlow).
o Hands-on experience with MLOps practices and tools (e.g., Docker, Kubernetes, MLflow).
Roles & Responsibilities
• System architecture: Define the architectural vision and strategy for agentic AI solutions, designing end-to-end architectures
that include model integration, orchestration frameworks, memory systems, and tool-use capabilities.
• Technical leadership: Guide and mentor cross-functional teams of AI engineers, data scientists, and DevOps specialists on
architectural patterns and best practices for building scalable and reliable agentic AI systems.
• Cloud infrastructure and MLOps: Design and deploy multi-agent AI systems on cloud platforms (AWS, Azure, or GCP),
building and managing cloud-native AI pipelines with MLOps best practices for monitoring, evaluating, and scaling agents.
• Healthcare integration: Lead the integration of agentic AI solutions with existing healthcare systems, and other enterprise platforms,
while ensuring data interoperability and security.
• Responsible AI: Ensure the implementation of strong AI governance, security, and ethical practices throughout the agent lifecycle,
including bias mitigation, fairness checks, and compliance with healthcare regulations like HIPAA.
• Proof of concept and scaling: Lead proof-of-concept (PoC) initiatives to validate new agentic capabilities, then develop
strategies to scale successful prototypes into production-ready systems.
• Technology evaluation: Evaluate and integrate a wide range of open-source and proprietary AI tools and technologies,
including vector databases, orchestration frameworks (e.g., LangChain, CrewAI), and cloud-native AI services.
• Thought leadership: Stay current with the latest advancements in agentic AI, generative models, and multi-agent frameworks,
driving innovation within the company and potentially presenting at industry conferences.
2,021 matching similar jobs near New York, NY
- Principal Software Engineer (Python, KDB, Shell Scripting, Java)
- Principal Software Engineer (Python, KDB, Shell Scripting, Java)
- Senior AI Enablement Architect
- AI Architect
- Senior Lead AI Engineer (GenAI Platform)
- Lead AI Engineer (MLX)
- Sr. Distinguished AI Engineer
- Senior Lead AI Engineer (FM Hosting)
- Senior Distinguished AI Engineer
- Senior Lead AI Engineer
- Senior Lead AI Engineer (AI Foundations, LLM Customization and Finetuning)
- Senior Lead AI Engineer (Remote-Eligible)Brooklyn, NYApril 1st, 2026
- Lead Machine Learning Engineer (Gen AI, Python, Go, AWS)
- Distinguished AI Engineer
- Lead AI Engineer (AI Foundations, LLM Customization and Finetuning)
- Lead AI Engineer
- Principal Software Engineer (Python, KDB, Shell Scripting, Java)
- Agentic AI Solutions Engineer
- Mainframe Architect // New Jersey, NJ Onsite // Contract
- AI Architect
- Senior Lead AI Engineer (LLM Customization and Finetuning)
- Senior Lead AI Engineer (FM Hosting, LLM Inference)
- AI Solutions Lead/ Architect - Spanish fluency
- Senior Data Engineer - AI-Driven Drug Discovery Platform
- Sr. Solution Architect, ITOM
- Sr Software Engineer
- Software Engineer
- Software Engineer III - Python / Testing Automation
- AI/ML Developer
- Go/Golang Developer - Ai Training
- AI Intern
- Software Engineer III - Machine Learning Platform
- Rust Developer - Ai Training
- Senior Software Engineer, AI
- AI Product Engineer - Agentic AI Platforms (Financial Services)
- AI Engineer
- Staff Software Engineer
- Senior Software Engineer (Architecture)
- Senior Elixir Engineer
- Platform Engineer - Generative AI & AI-Powered Tools