{"schemaVersion":"jobsearcher.job.v1","id":"4c25ad633f5bb3db1affbc43","url":"https://jobsearcher.com/jobs/4c25ad633f5bb3db1affbc43","canonicalUrl":"https://jobsearcher.com/jobs/4c25ad633f5bb3db1affbc43","title":"Lead - Python Developer (Only W2)","description":"Top Skills: • Proficiency in programming languages such as Python, SQL, R, and JavaScript. • Experience developing web applications in frameworks like Streamlit, Shiny, Vue, React, etc. • Proven experience with core AWS services, including but not limited to EC2, S3, and RDS. • BioPharma experience preferredPosition Summary: We are seeking a dedicated and skilled LLM Application Support Engineer to join our technical team responsible for providing L1, L2, and L3 specialized application support for Large Language Model (LLM)-based applications. The successful candidate will also be responsible for implementing automated testing frameworks for both applications and LLMs specifically. This role requires a solid understanding of LLMs, application support, and automated testing methodologies. Responsibilities include, but are not limited to, the following: Application Support: • Provide L1, L2, and L3 support for LLM-based applications, ensuring timely resolution of issues. • Ensure the scalability and performance of LLM-based applications to handle large datasets and complex queries. • Identify opportunities for process improvements and implement innovative solutions to enhance the efficiency and effectiveness of LLM deployments. • Monitor application performance and proactively identify potential issues. • Troubleshoot and resolve application issues, escalating to higher levels of support when necessary. • Collaborate with development teams to address and resolve complex technical issues. • Maintain detailed documentation of support activities, including issue resolution steps and best practices. • Ensure compliance with Client's data security and regulatory requirements during support activities. • Conduct root cause analysis for recurring issues and implement preventive measures. Automated Testing Frameworks: • Develop and implement automated testing frameworks for LLM-based applications. • Design and execute automated tests to validate the functionality, performance, and reliability of applications and LLMs. • Create and maintain test scripts for unit tests, integration tests, and end-to-end tests. • Collaborate with development teams to integrate automated testing into the CI/CD pipeline. • Monitor and analyze test results, identifying and reporting defects. • Continuously improve automated testing processes and frameworks to enhance test coverage and efficiency. • Ensure compliance with Client's data security and regulatory requirements during testing activities. • Stay updated with the latest trends and best practices in automated testing and LLM technologies. Basic Qualifications: • Bachelor's Degree with 2-4 years of academic/industry experience in application support or development. • Preference for candidates with experience in machine learning or LLM-based applications.","company":"Ml Outsourcing Services Private","rawCompany":"ml outsourcing services private","city":"Denver","state":"CO","isRemote":false,"isActive":false,"createdAt":"2026-08-14T11:39:20.661Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1251.00","title":"Computer Programmers","slug":"computer-programmers"},{"code":"15-1211.00","title":"Computer Systems Analysts","slug":"computer-systems-analysts"}],"industries":[{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Lead - Python Developer (Only W2)","description":"Top Skills: • Proficiency in programming languages such as Python, SQL, R, and JavaScript. • Experience developing web applications in frameworks like Streamlit, Shiny, Vue, React, etc. • Proven experience with core AWS services, including but not limited to EC2, S3, and RDS. • BioPharma experience preferredPosition Summary: We are seeking a dedicated and skilled LLM Application Support Engineer to join our technical team responsible for providing L1, L2, and L3 specialized application support for Large Language Model (LLM)-based applications. The successful candidate will also be responsible for implementing automated testing frameworks for both applications and LLMs specifically. This role requires a solid understanding of LLMs, application support, and automated testing methodologies. Responsibilities include, but are not limited to, the following: Application Support: • Provide L1, L2, and L3 support for LLM-based applications, ensuring timely resolution of issues. • Ensure the scalability and performance of LLM-based applications to handle large datasets and complex queries. • Identify opportunities for process improvements and implement innovative solutions to enhance the efficiency and effectiveness of LLM deployments. • Monitor application performance and proactively identify potential issues. • Troubleshoot and resolve application issues, escalating to higher levels of support when necessary. • Collaborate with development teams to address and resolve complex technical issues. • Maintain detailed documentation of support activities, including issue resolution steps and best practices. • Ensure compliance with Client's data security and regulatory requirements during support activities. • Conduct root cause analysis for recurring issues and implement preventive measures. Automated Testing Frameworks: • Develop and implement automated testing frameworks for LLM-based applications. • Design and execute automated tests to validate the functionality, performance, and reliability of applications and LLMs. • Create and maintain test scripts for unit tests, integration tests, and end-to-end tests. • Collaborate with development teams to integrate automated testing into the CI/CD pipeline. • Monitor and analyze test results, identifying and reporting defects. • Continuously improve automated testing processes and frameworks to enhance test coverage and efficiency. • Ensure compliance with Client's data security and regulatory requirements during testing activities. • Stay updated with the latest trends and best practices in automated testing and LLM technologies. Basic Qualifications: • Bachelor's Degree with 2-4 years of academic/industry experience in application support or development. • Preference for candidates with experience in machine learning or LLM-based applications.","datePosted":"2026-08-14T11:39:20.661Z","dateModified":"2026-08-14T11:39:20.661Z","hiringOrganization":{"@type":"Organization","name":"Ml Outsourcing Services Private","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Denver","addressRegion":"CO","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"4c25ad633f5bb3db1affbc43"},"url":"https://jobsearcher.com/jobs/4c25ad633f5bb3db1affbc43"}}