Java Software Engineer (AI Evaluation) at Turing

Java Software Engineer (AI Evaluation) | $25 per approved task | Contract, 3 months | Remote (India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, LATAM)

About the Role

Turing, an AGI infrastructure company working with frontier AI labs, is hiring experienced software engineers (tech lead level) to contribute to an AI evaluation project. The work is hands-on software engineering: development environment automation, issue triaging, and evaluating test coverage and quality.

Day-to-Day Work

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluate unit test coverage and quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to identify repositories and issues that are challenging for LLMs.
• Opportunities to lead a team of junior engineers on project work.

Requirements

• Minimum 3+ years of overall software engineering experience.
• Strong experience with Java.
• Proficiency with Git, Docker, and basic software pipeline setup.
• Ability to understand and navigate complex codebases.
• Comfortable running, modifying, and testing real-world projects locally.
• Experience contributing to or evaluating open-source projects is a plus.

Nice to Have

• Previous participation in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Pay, Schedule and Contract Details

• Commitment: At least 4 hours per day and a minimum of 40 hours per week, with 4 hours of overlap with PST.
• Employment type: Contractor assignment (no medical/paid leave).
• Duration: 3-month contract; expected start date is next week.
• Payment: $25 per approved task.
• Location: India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, LATAM.

Evaluation Process

Assessment-based review, approximately 75 minutes.