Automation Test Engineer at Turing

Automation Test Engineer | Contractor | 40 hrs/week | Remote (India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Mexico)

Turing is one of the world's fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. We partner with leading AI labs to push frontier model capabilities and build real-world AI solutions for mission-critical enterprise needs.

We are looking for a detail-oriented Automation Test Engineer to serve as the final quality checkpoint before tasks are marked ready to ship. In this role, you will execute reference solutions inside Docker containers, run automated test suites, and diagnose failures to ensure every task meets the required quality standard.

What You'll Do

• Execute reference solutions inside Docker containers and capture output
• Run pytest-based test suites against solution output and validate scores
• Diagnose failures — distinguishing between broken solutions, misconfigured verifiers, environment issues, or task design flaws
• Report failures clearly to the Pod Lead or Annotator with sufficient detail to reproduce issues
• Track test results in the shared tracker and flag consistently failing tasks or those requiring environment changes

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical field
• 5+ years of experience in software QA, DevOps, backend development, or automated testing
• Comfortable working in a Linux command-line environment
• Hands-on experience with Docker (building images, running containers, reading logs)
• Ability to read and understand Python code and basic pytest output
• Systematic debugging mindset — ability to isolate failures in code, config, or environment

Nice to Have

• Familiarity with CI/CD pipelines and containerized test environments
• Experience with domain-specific libraries such as pandas, openpyxl, pdfplumber, librosa, or astropy
• Understanding of how LLM evaluation pipelines work

Engagement Details

• Commitment: 40 hours/week with 4-hour overlap with PST
• Type: Contractor assignment (no medical/paid leave benefits)
• Duration: 2-month contract, starting next week
• Locations: India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Mexico

Evaluation Process

• 1 round of interviews — 60-minute technical interview