Responsibilities: - Analyze and triage GitHub issues across trending open-source libraries. - Set up and configure code repositories, including Dockerization and environment setup. - Evaluate unit test coverage and quality. - Modify and run codebases locally to assess LLM performance in bug-fixing scenarios. - Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs. Requirements: - Minimum 3+ years of overall experience. - Strong experience with at least one of the following languages: C++ / C#. - Proficiency with Git, Docker, and basic software pipeline setup. - Ability to understand and navigate complex codebases. - Comfortable running, modifying, and testing real-world projects locally. - Experience contributing to or evaluating open-source projects is a plus. Nice to Have: - Previous participation in LLM research or evaluation projects. - Experience building or testing developer tools or automation agents. Benefits: - Work in a fully remote environment. - Opportunity to work on cutting-edge AI projects with leading LLM companies. Offer Details: - Commitments Required: Minimum 40 hours per week with overlap of 4 hours with PST. - Employment type : Contractor assignment (no medical/paid leave). - Duration of contract : 2-3 weeks; expected start date is next week. - Payment: $25 per approved task. - Location : LATAM. Evaluation Process (approximately 75 mins): - Assessment based review.
Загружаем…