Lead - Python Developer (Only W2)
Top Skills:
- Proficiency in programming languages such as Python, SQL, R, and JavaScript.
- Experience developing web applications in frameworks like Streamlit, Shiny, Vue, React, etc.
- Proven experience with core AWS services, including but not limited to EC2, S3, and RDS.
- BioPharma experience preferredPosition Summary: We are seeking a dedicated and skilled LLM Application Support Engineer to join our technical team responsible for providing L1, L2, and L3 specialized application support for Large Language Model (LLM)-based applications. The successful candidate will also be responsible for implementing automated testing frameworks for both applications and LLMs specifically. This role requires a solid understanding of LLMs, application support, and automated testing methodologies. Responsibilities include, but are not limited to, the following: Application Support:
- Provide L1, L2, and L3 support for LLM-based applications, ensuring timely resolution of issues.
- Ensure the scalability and performance of LLM-based applications to handle large datasets and complex queries.
- Identify opportunities for process improvements and implement innovative solutions to enhance the efficiency and effectiveness of LLM deployments.
- Monitor application performance and proactively identify potential issues.
- Troubleshoot and resolve application issues, escalating to higher levels of support when necessary.
- Collaborate with development teams to address and resolve complex technical issues.
- Maintain detailed documentation of support activities, including issue resolution steps and best practices.
- Ensure compliance with Client's data security and regulatory requirements during support activities.
- Conduct root cause analysis for recurring issues and implement preventive measures. Automated Testing Frameworks:
- Develop and implement automated testing frameworks for LLM-based applications.
- Design and execute automated tests to validate the functionality, performance, and reliability of applications and LLMs.
- Create and maintain test scripts for unit tests, integration tests, and end-to-end tests.
- Collaborate with development teams to integrate automated testing into the CI/CD pipeline.
- Monitor and analyze test results, identifying and reporting defects.
- Continuously improve automated testing processes and frameworks to enhance test coverage and efficiency.
- Ensure compliance with Client's data security and regulatory requirements during testing activities.
- Stay updated with the latest trends and best practices in automated testing and LLM technologies.
Basic Qualifications:
- Bachelor's Degree with 2-4 years of academic/industry experience in application support or development.
- Preference for candidates with experience in machine learning or LLM-based applications.