Lead - Python Developer (Only W2)

Top Skills: • Proficiency in programming languages such as Python, SQL, R, and JavaScript. • Experience developing web applications in frameworks like Streamlit, Shiny, Vue, React, etc. • Proven experience with core AWS services, including but not limited to EC2, S3, and RDS. • BioPharma experience preferredPosition Summary: We are seeking a dedicated and skilled LLM Application Support Engineer to join our technical team responsible for providing L1, L2, and L3 specialized application support for Large Language Model (LLM)-based applications. The successful candidate will also be responsible for implementing automated testing frameworks for both applications and LLMs specifically. This role requires a solid understanding of LLMs, application support, and automated testing methodologies. Responsibilities include, but are not limited to, the following: Application Support: • Provide L1, L2, and L3 support for LLM-based applications, ensuring timely resolution of issues. • Ensure the scalability and performance of LLM-based applications to handle large datasets and complex queries. • Identify opportunities for process improvements and implement innovative solutions to enhance the efficiency and effectiveness of LLM deployments. • Monitor application performance and proactively identify potential issues. • Troubleshoot and resolve application issues, escalating to higher levels of support when necessary. • Collaborate with development teams to address and resolve complex technical issues. • Maintain detailed documentation of support activities, including issue resolution steps and best practices. • Ensure compliance with Client's data security and regulatory requirements during support activities. • Conduct root cause analysis for recurring issues and implement preventive measures. Automated Testing Frameworks: • Develop and implement automated testing frameworks for LLM-based applications. • Design and execute automated tests to validate the functionality, performance, and reliability of applications and LLMs. • Create and maintain test scripts for unit tests, integration tests, and end-to-end tests. • Collaborate with development teams to integrate automated testing into the CI/CD pipeline. • Monitor and analyze test results, identifying and reporting defects. • Continuously improve automated testing processes and frameworks to enhance test coverage and efficiency. • Ensure compliance with Client's data security and regulatory requirements during testing activities. • Stay updated with the latest trends and best practices in automated testing and LLM technologies. Basic Qualifications: • Bachelor's Degree with 2-4 years of academic/industry experience in application support or development. • Preference for candidates with experience in machine learning or LLM-based applications.