<Back to Search
Associate AI Engineer
New York, NYApril 6th, 2026
Job Type: Officer of AdministrationBargaining Unit:Regular/Temporary: RegularEnd Date if Temporary:Hours Per Week: 35Standard Work Schedule:Building:Salary Range: $127,000 - $143,100The salary of the finalist selected for this role will be set based on a variety of factors, including but not limited to departmental budgets, qualifications, experience, education, licenses, specialty, and training. The above hiring range represents the University's good faith and reasonable estimate of the range of possible compensation at the time of posting.Position SummaryThe Associate Applied AI Engineer supports the development, deployment, and maintenance of artificial intelligence applications for the Columbia University Irving Medical Center (CUIMC). This role contributes to the design and implementation of AI-enabled solutions that support administrative, research, clinical, and educational operations across the institution.Working closely with senior engineers and cross-functional teams, the Junior Engineer assists in building applications that leverage large language models (LLMs), retrieval-augmented generation (RAG), automation frameworks, and machine learning techniques. This role focuses on implementing AI solutions, supporting application deployment, and ensuring systems operate securely, efficiently, and in alignment with institutional policies and governance standards.ResponsibilitiesEssential Duties:AI Development and ImplementationDesign, develop, and maintain AI-enabled applications utilizing retrieval-augmented generation (RAG) techniques to enhance knowledge discovery, automate workflows, and support decision-making across CUIMC operations.Build scalable AI tools and services that integrate with CUIMC administrative, clinical, research, and educational systems.Develop rapid proof-of-concept prototypes to evaluate new technologies and demonstrate solution feasibility to stakeholders.Assist with optimization of prompts, pipelines, and model workflows to improve application performance and reliability.Technical Support and DocumentationTroubleshoot AI applications and assist with diagnosing and resolving technical or performance issues in development or production environments.Maintain clear technical documentation, including architecture diagrams, workflows, and implementation notes to support system sustainability and team knowledge sharing.Operations & Continuous ImprovementMonitor emerging developments in artificial intelligence, machine learning frameworks, and generative AI technologies relevant to healthcare and higher education.Prototype solutions using open-source tools and AI platforms present demonstrations or findings to internal stakeholders.Participate in exploratory initiatives assessing new AI capabilities and their potential institutional impact.Responsible AI and ComplianceSupport the design and deployment of AI solutions that prioritize privacy, transparency, security, and ethical use of data.Adhere to CUIMC policies related to data governance, compliance, and institutional review requirements.Contribute to the development of internal best practices and governance frameworks for the safe and responsible use of generative and predictive AI technologies.PeoplePartner with engineers, analysts, data scientists, and institutional stakeholders to design and implement AI-enabled solutions.Participate in stakeholder discussions to assess needs and recommend AI tools aligned with institutional priorities.OtherPerform other related duties and responsibilities as assigned/requested.Minimum QualificationsBachelor's degree or equivalent in education and experience, plus four years of experience.Preferred QualificationsBachelor's degree in Computer Science, Engineering, Artificial Intelligence, Statistics, or equivalent combination of education and experience.Minimum 4 years of professional experience in software engineering, artificial intelligence, machine learning, data engineering, or a related technical field.Experience with at least one programming language commonly used for AI or application development (e.g., Python, JavaScript, TypeScript, Java, or C#).Experience developing, testing, and maintaining software applications, data pipelines, or AI-enabled solutions.Strong analytical and problem-solving skills with the ability to translate technical concepts into practical solutions.Master's degree in Computer Science, Artificial Intelligence, Data Science, Engineering, Statistics, or a related discipline.Experience developing applications that leverage large language models (LLMs), generative AI tools, or retrieval-augmented generation (RAG).Familiarity with AI development frameworks or orchestration tools such as LangChain, LlamaIndex, or similar technologies.Experience deploying applications or machine learning workflows in cloud environments such as AWS, Google Cloud Platform, or Microsoft Azure.Exposure to AI platforms such as Amazon Bedrock, Google Vertex AI, or Azure AI Studio.Experience working with natural language processing (NLP), data extraction, or analytics involving structured and unstructured data.Familiarity with Agile development practices, Git-based version control, and collaborative software development workflows.Equal Opportunity Employer / Disability / VeteranColumbia University is committed to the hiring of qualified local residents.
1,954 matching similar jobs near New York, NY
- Senior Full-Stack Engineer for Scientific Web Apps
- Hyperscale AI Lead: Architect at Scale
- Senior Salesforce Tech Architect - Cloud, AI & Apex Expert
- Senior Data Platform Engineer - Real-Time Pipelines
- AI-Driven Embedded Firmware Engineer Intern
- Lead Java Trading System Engineer
- R&D Software Engineering Intern - Testing & Automation
- Senior Staff Engineer - Global Commercial Services
- Front-End Engineer for Empathetic AI Platform (Remote)New York, NYMarch 28th, 2026
- Lead Backend Engineer, AI Agent Marketplace
- AI Adoption Leader - Enablement & Lightweight Automation
- Lead SharePoint Admin/Developer - .NET & SQL
- Remote Principal Data Scientist - ML for Churn & LTV
- GenAI-Driven ML Engineer for Tax Document Intelligence
- Robotics ML Engineer: Sim-to-Real Perception & Control
- Hybris Tech Lead / Hybris Developer - SAP CPQ
- Principal Software Engineer, Money Group Denver, CO;San Francisco, CA;New York, NY
- DevOps Engineer - Cloud, CI/CD & SRE Expert
- Finance Operations AssociateNew York, NYApril 4th, 2026
- Data Platform Engineer (Member of Technical Staff)
- AI Product Owner
- Staff Backend Engineer - Scalable Data Platform
- Scientific Data Engineer
- Sr Manager of Software Engineering
- Lead Data Integration Specialist / Senior Full Stack Engineer - New York - Competitive Salary + Comp
- Data Science Manager - AI Trainer
- Mission Software Engineering Manager, Public Sector
- Remote ML Scientist - AI Model Trainer & EvaluatorNew York, NYApril 5th, 2026
- Senior Java Architect - Microservices & Cloud (NYC Onsite)
- Hybrid Software Engineer Intern - Summer, 10 Weeks, Hands-On
- Full-Stack Engineer - FinTech AI & Scalable Systems (NYC)
- Mobile Developer with Hybrid Mobile Apps
- Frontend Engineer: Data-Driven UI for Engineering Tools
- NLP Engineer for Capital Markets ML Platform
- Deep Research Agent Tech Lead
- Machine Learning Research Engineer, GenAI Applied ML
- Product Manager, Gen AI PlatformNew York, NYApril 6th, 2026
- Senior Platform Engineer - Build Scalable, Secure Backend
- Senior Data Engineer
- Integration Consultant