Senior Software Engineer – Go at Turing

Senior Software Engineer – Go (LLM Evaluation) | Contractor | Remote – India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Mexico

Join Turing, one of the world's fastest-growing AI companies, to help build LLM evaluation and training datasets for realistic software engineering problems. This hands-on role blends practical software engineering with cutting-edge AI research, focusing on verifiable SWE tasks derived from public repository histories.

About the Project

We are constructing LLM evaluation and training datasets using a synthetic, human-in-the-loop approach based on public GitHub repository histories. The goal is to expand dataset coverage across programming languages, difficulty levels, and task types to better train LLMs on real-world software engineering challenges.

What You'll Do

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment automation.
• Evaluate unit test coverage and overall test quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to identify repositories and issues that challenge LLMs.
• Optionally lead a team of junior engineers on collaborative projects.

Required Skills

• 3+ years of overall software engineering experience.
• Strong proficiency in Go.
• Solid experience with Git, Docker, and software pipeline setup.
• Ability to navigate and understand complex, real-world codebases.
• Comfortable running, modifying, and testing projects in local environments.

Nice to Have

• Prior involvement in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.
• History of contributing to or evaluating open-source projects.

Engagement Details

• Commitment: Minimum 20 hrs/week (options: 20, 30, or 40 hrs/week); at least 4 hrs/day with 4-hour PST overlap.
• Type: Contractor assignment (no medical/paid leave benefits).
• Location: Remote – open to candidates in India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, and Mexico.

Evaluation Process (~75 minutes)

• Round 1: 60-minute technical interview.
• Round 2: 30-minute technical and cultural discussion.