JOBSEARCHER

Full Stack Python Software Engineer (Remote)

HiredRemoteJune 6th, 2026
Role: Full Stack Python Software Engineer (Remote)Location: Remote (Work from Anywhere)Payout: CompetitiveRole Overview:We are hiring for one of our clients, seeking a Senior Software Engineer – Python (LLM Evaluation & Repository Validation) to work on a part-time basis. This person will contribute to the development of LLM evaluation and training datasets, focusing on building verifiable software engineering tasks based on public repository histories. The ideal candidate will have experience with high-quality public GitHub repositories and will be working at the forefront of evaluating how LLMs interact with real code, influencing the future of AI-assisted software development in the technology industry.Key Responsibilities:• Analyze and triage GitHub issues across trending open-source libraries to identify areas for improvement and potential integration with LLM evaluation datasets.• Set up and configure code repositories, including dockerization and environment automation, to support the development of LLM evaluation and training datasets.• Evaluate test coverage and quality to ensure the reliability and effectiveness of the LLM evaluation datasets.• Contribute to the expansion of dataset coverage to different types of tasks in terms of programming language, difficulty level, and other relevant factors.• Collaborate with the development team to integrate LLM evaluation datasets with existing software engineering workflows and tools.Required Skills & Qualifications:• Proficiency in Python programming language, with a strong focus on software engineering principles and best practices.• Experience with high-quality public GitHub repositories, including knowledge of repository structures, issue tracking, and pull request management.• Strong understanding of software development life cycles, including testing, validation, and deployment.• Familiarity with Docker and environment automation tools, such as containerization and orchestration.• Excellent analytical and problem-solving skills, with the ability to work independently and collaboratively as part of a distributed team.More About the Opportunity:This role offers a unique opportunity to work with a global leader in the technology industry, contributing to the development of cutting-edge LLM evaluation and training datasets. The successful candidate will have the chance to blend practical software engineering with AI research, influencing the future of AI-assisted software development and working on realistic software engineering problems.Equal Opportunity Employer:We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.Apply Now!