SWE Bench Engineer - C# at Turing
posted 1 hour agoSWE Bench Engineer (C#) | $15/task | Contractor, 2-3 weeks | Remote (India, Pakistan, Nigeria, Egypt, Ghana, Bangladesh, Turkey, LATAM)
About the role
Turing works with frontier AI labs on training data, evaluations and engineering talent. They are hiring experienced software engineers (tech lead level) for hands-on engineering work on an LLM evaluation project, covering development environment automation, issue triaging, and evaluating test coverage and quality.
Day-to-day work
- Analyze and triage GitHub issues across trending open-source libraries.
- Set up and configure code repositories, including Dockerization and environment setup.
- Evaluate unit test coverage and quality.
- Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
- Collaborate with researchers to identify repositories and issues that are challenging for LLMs.
Requirements
- Minimum 3+ years of overall software engineering experience.
- Strong experience with C#.
- Proficiency with Git, Docker, and basic software pipeline setup.
- Ability to understand and navigate complex codebases.
- Comfortable running, modifying, and testing real-world projects locally.
- Experience contributing to or evaluating open-source projects is a plus.
Nice to have: previous participation in LLM research or evaluation projects, and experience building or testing developer tools or automation agents.
Pay and schedule
- Payment: $15 per approved task.
- At least 4 hours per day and a minimum of 40 hours per week, with 4 hours of overlap with PST.
- Contractor assignment; no medical or paid leave.
- Duration: 2-3 weeks; the expected start date is next week.
Location
Fully remote. Applicants must be based in India, Pakistan, Nigeria, Egypt, Ghana, Bangladesh, Turkey, or LATAM.
Hiring process
An assessment-based review, approximately 75 minutes.