LLM Evaluation & Repository Validation (Rust or Ruby or Golang or C#)
EasyRecruitGlobal
India
•
Remote
Remote
Temporary
India
About the Role
Senior SW Engineer – Rust (LLM Evaluation & Repository Validation)
What does day-to-day look like:
Analyze and triage GitHub issues across trending open-source libraries.
Set up and configure code repositories, including Dockerization and environment setup.
Evaluating unit test coverage and quality.
Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
Opportunities to lead a team of junior engineers to collaborate on projects.
Required Skills:
Minimum 5+ years of overall experience
Strong experience with at least one of the following languages: Rust or Ruby or Golang
Proficiency with Git, Docker, and basic software pipeline setup.
Ability to understand and navigate complex codebases.
Comfortable running, modifying, and testing real-world projects locally.
Experience contributing to or evaluating open-source projects is a plus.
Nice to Have:
Previous participation in LLM research or evaluation projects.
Experience building or testing developer tools or automation agents.
Perks of Freelancing:
Work in a fully remote environment.
Opportunity to work on cutting-edge AI projects with leading LLM companies.
Offer details:
Commitment required: 20 hours per week with some overlap with PST
Employment type: Contractor assignment (no medical/paid leave)
Duration of contract: 3 months with expected start date as next week
What does day-to-day look like:
Analyze and triage GitHub issues across trending open-source libraries.
Set up and configure code repositories, including Dockerization and environment setup.
Evaluating unit test coverage and quality.
Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
Opportunities to lead a team of junior engineers to collaborate on projects.
Required Skills:
Minimum 5+ years of overall experience
Strong experience with at least one of the following languages: Rust or Ruby or Golang
Proficiency with Git, Docker, and basic software pipeline setup.
Ability to understand and navigate complex codebases.
Comfortable running, modifying, and testing real-world projects locally.
Experience contributing to or evaluating open-source projects is a plus.
Nice to Have:
Previous participation in LLM research or evaluation projects.
Experience building or testing developer tools or automation agents.
Perks of Freelancing:
Work in a fully remote environment.
Opportunity to work on cutting-edge AI projects with leading LLM companies.
Offer details:
Commitment required: 20 hours per week with some overlap with PST
Employment type: Contractor assignment (no medical/paid leave)
Duration of contract: 3 months with expected start date as next week