Senior Software Engineer – C# at Turing

Senior Software Engineer – C# (LLM Evaluation) | Contractor | Remote (India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Mexico)

Join Turing — one of the world's fastest-growing AI companies — to help build LLM evaluation and training datasets for realistic software engineering tasks. You'll work at the intersection of practical software engineering and AI research, helping shape how large language models interact with real-world code.

About the Project

This project focuses on building verifiable software engineering tasks derived from public GitHub repository histories using a synthetic approach with human-in-the-loop. The goal is to expand dataset coverage across programming languages, difficulty levels, and task types to improve LLM training and evaluation.

What You'll Do

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment automation.
• Evaluate unit test coverage and overall test quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to identify repositories and issues that challenge LLMs.
• Optionally lead a team of junior engineers on collaborative project tasks.

Required Skills

• 3+ years of overall software engineering experience.
• Strong proficiency in C#.
• Solid experience with Git, Docker, and software pipeline setup.
• Ability to navigate and understand complex, real-world codebases.
• Comfortable running, modifying, and testing projects in local environments.

Nice to Have

• Prior experience in LLM research or evaluation projects.
• Background in building or testing developer tools or automation agents.
• Experience contributing to or evaluating open-source projects.

Offer Details

• Commitment: Minimum 20 hrs/week (options: 20, 30, or 40 hrs/week); at least 4 hrs/day with 4-hour overlap with PST.
• Employment Type: Contractor assignment (no medical/paid leave benefits).
• Location: India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Mexico.

Evaluation Process (~75 minutes)

• Round 1: 60-minute technical interview.
• Round 2: 30-minute technical and cultural discussion.