Generative AI Application Engineer
About the Company:
Purple Squirrel Enterprises provides recruiting and HR solutions to startups and global organizations, helping businesses manage hiring and people operations. For this search, Purple Squirrel Enterprises is working exclusively with an established SaaS analytics company serving the banking industry. The client provides data analytics software that helps banks and credit unions turn operational and customer data into useful business insights. Its internal Modeling and AI team develops advanced analytics capabilities and is expanding its work on production-ready generative AI features for its platform.
About the Role:
The client is seeking a Generative AI Application Engineer to design, develop, deploy, and maintain production generative AI applications. This is a hands-on, mid-level software engineering role focused on building applications directly with large language model (LLM) APIs, developing API-based services and AI agents, and supporting the application and data layers behind these features. The role emphasizes strong Python and SQL skills, practical generative AI development, production deployment, evaluation, and monitoring. The engineer will work with product management, data engineering, and the internal AI/Modeling team to turn requirements into production features and identify opportunities to improve organizational efficiency through AI and model-based solutions. Candidates must have generative AI applications running in production and be able to explain their individual contributions, technical decisions, and application performance. Professional references will be required to verify this experience.
Key Responsibilities:
Design, build, and deploy production generative AI features using LLM APIs, including prompt construction, structured outputs, tool and function calling, retrieval, context management, and failure handling.
Develop and maintain evaluation and regression frameworks to assess AI behavior as models, prompts, and data change.
Integrate generative AI components with existing product services, APIs, and data models.
Work with Hugging Face models and internally hosted inference engines, including configuring and deploying model-serving infrastructure.
Design, build, and maintain API-based applications and services throughout the software development life cycle.
Write and optimize SQL queries against relational data models supporting application state, feature data, evaluation datasets, and product analytics.
Deploy and operate application components across cloud resources, including virtual machines, containers, object storage, and relational database services, primarily in Microsoft Azure.
Contribute to analytics product development outside AI and modeling when required.
Support model-based analytics initiatives, including customer segmentation, churn forecasting, and lifetime value forecasting, in collaboration with senior AI/Modeling team members.
Identify opportunities to improve internal efficiency using generative AI, models, and heuristics.
Collaborate with product management, data engineering, and AI/Modeling colleagues to translate requirements into delivered features.
Participate in code reviews, provide constructive feedback, and incorporate feedback from teammates.
Communicate progress, technical trade-offs, and blockers clearly to team members and stakeholders.
Write automated tests for application functionality, generative AI evaluations, and machine learning model assessments.
Monitor production AI applications for accuracy, latency, token consumption, and cost, and participate in production support as needed.
Follow security, data-handling, and change-management practices when working with sensitive financial information.
Required Qualifications:
At least 5 years of professional software development experience, ideally within a software product organization, including hands-on development of API-based applications and services deployed in production.
At least 4 years of hands-on Python development experience, with the ability to explain and justify technical and design decisions.
At least 2 years of substantial generative AI development at the LLM API level, including prompt design, structured outputs, tool and function calling, retrieval, and evaluation.
Experience helping build at least two non-trivial generative AI applications that are currently in production.
Ability to explain the business problem, architecture, personal contribution, and evaluation and monitoring approach for production AI applications.
Strong SQL skills, including joins, aggregation, window functions, and common table expressions (CTEs).Working knowledge of relational database performance and role-based access controls.
At least 4 years of experience working with multiple resource types in a hyperscaler environment, including virtual machines, containers, object storage, and relational database services.
Microsoft Azure experience is preferred; equivalent experience with AWS or Google Cloud Platform (GCP) is acceptable.
Proficiency with version control practices and tools such as Git and/or Azure DevOps.
Reachable professional references who can verify the experience described in the posting, including production generative AI development.
Highly Desirable Qualifications:
Hands-on experience selecting and working with Hugging Face models, including serving formats, quantization choices, and evaluation. Direct involvement in deploying models for self-hosted LLM inference using technologies such as LightLLM, vLLM, SGLang, TensorRT-LLM, TGI, Ray Serve, Triton, Ollama, llama.cpp, or similar platforms. Experience with inference gateway and routing layers such as LiteLLM.Experience operating self-hosted inference deployments for production applications, including capacity planning, batching, concurrency, versioning, and monitoring. Experience building applications or user interfaces that interact with self-hosted, open-source LLMs through APIs.
Additional Preferred Qualifications:
Experience with Amazon Bedrock or Microsoft Foundry, formerly Azure AI Foundry.
Machine learning experience involving feature engineering, model training, and evaluation using Pandas, scikit-learn, or similar tools.
Familiarity with Python charting libraries such as Matplotlib, Seaborn, or Plotly.
Experience with Azure SQL and PySpark for large datasets.
Additional programming experience in C#, Java, or Scala.
Experience with React and TypeScript UI development; AI Elements or shadcn/ui experience is a plus.
Exposure to banking, financial services, or other regulated data environments.
Professional Reference Requirements:
Provide reachable professional references who can verify the experience claimed in the application.
Provide at least one reference from each organization where production generative AI applications were built and deployed.
Ensure references can discuss personal contributions, technical decisions, and production application performance.
Understand that references will be contacted and that an offer depends on verification of the production generative AI experience described.
Raise any former employer policy or NDA restrictions during the first interview so an acceptable alternative can be discussed.
Position Details
Job Title: Generative AI Application Engineer
Recruiting Partner: Purple Squirrel Enterprises
Industry:
Financial Technology / Data Analytics SaaSClient Industry: Banking Technology and Data Analytics
Employment Type: Full-Time, W-2Location: United States
Work Arrangement: Remote
Reports To: AI/Modeling Team Leadership
Base Salary:
$135,000–$150,000 annually, with potential consideration outside this range for candidates who clearly exceed the core requirements and can verify their production generative AI experience.
Working Hours:
Must be able to work remotely in the United States on an East Coast schedule. The workday begins at 8:30 a.m. Eastern Time. Pacific Time candidates may begin at 6:00 a.m. Pacific Time, corresponding to 9:00 a.m. Eastern Time, with availability for meetings at 8:30 a.m. Eastern Time when needed.
Compensation and Benefits:
The position offers an annual base salary of $135,000–$150,000, with potential flexibility for candidates who exceed the core requirements.
Benefits include:
- A company contribution of $1,100 per month toward eligible pre-tax benefits, including medical, dental, vision, and HSA options, allocated according to plan selection.
- Medical, dental, and vision coverage, including HSA-compatible plans.
- UHC Rewards program, with the opportunity to earn up to $300 annually for non-HSA plans or $1,000 annually for HSA plans through wellness activities.
- Employer-paid life and accidental death and dismemberment (AD&D) insurance equal to one times salary, up to $200,000.Employer-paid short-term and long-term disability coverage.
- Optional additional life and AD&D, critical illness, accident, and hospital indemnity coverage.
- Employee Assistance Program (EAP).401(k) plan with an employer match of up to 4.5% when employees contribute 6% of salary, with immediate vesting.
- Company holidays and a Flexible Time Off (FTO) policy without a fixed PTO cap, based on mutual trust and manager coordination.
- Working With Purple Squirrel Enterprises
- Purple Squirrel Enterprises is the client's exclusive recruiting partner for this search. Candidates will receive support throughout the hiring process, including:
- A dedicated point of contact throughout the recruitment process.
- Advocacy with the hiring team to help establish a mutually beneficial fit.
- Preparation for each interview stage.
- Timely, honest feedback throughout the process.
- Support during offer negotiations.
- Guidance through the hiring process, including coordination with the client.
Equal Employment Opportunity:
The client is an equal opportunity employer committed to building a diverse and inclusive team. Applicants from all backgrounds, experiences, and perspectives are welcome.