Posted over 30 days ago. Roles like this often stay open for a while, so it's still worth applying.
Diagnostics & Troubleshooting Expert at Turing
posted 6 months agoDiagnostics & Troubleshooting Domain Expert | Contractor | Worldwide Remote | Min. 30 hrs/week
Turing is looking for a detail-oriented Diagnostics and Troubleshooting Specialist to help train and evaluate large language models (LLMs) for technical support scenarios. This short-term contract role (4 weeks) focuses on Windows system diagnostics, and is ideal for experienced IT or help desk professionals looking to contribute to cutting-edge AI development.
About Turing
Based in San Francisco, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing helps accelerate frontier research with high-quality data, advanced training pipelines, and top AI researchers — and applies that expertise to help enterprises transform AI from proof of concept into measurable business impact.
Key Responsibilities
- Train and evaluate LLMs for technical support scenarios involving Windows performance, startup issues, driver problems, update failures, and system errors.
- Create, review, and annotate troubleshooting datasets including incident logs, support chats, diagnostic steps, and resolution workflows.
- Use Task Manager to model troubleshooting for CPU, memory, disk, and process-related performance issues.
- Analyze system and application logs using Event Viewer to identify error patterns and root causes for AI training tasks.
- Apply msconfig knowledge to guide LLM training on startup behavior, boot issues, and service conflicts.
- Use Device Manager workflows to train models on hardware, driver, and device-related issue resolution.
- Incorporate Windows Update Troubleshooter use cases into model training for patching and update failure scenarios.
- Develop prompts and response guidelines for diagnostic assistants, virtual support agents, and troubleshooting copilots.
- Evaluate AI outputs for technical accuracy, step-by-step clarity, safety, and troubleshooting effectiveness.
- Collaborate with AI, QA, and technical support teams to improve model performance and response quality.
- Maintain documentation, annotation guidelines, and quality standards for troubleshooting-related LLM projects.
Required Qualifications
- Background in IT support, desktop support, technical troubleshooting, or help desk operations.
- Strong hands-on experience with: Task Manager, Event Viewer, msconfig, Device Manager, and Windows Update Troubleshooter.
- Solid understanding of Windows system diagnostics, performance monitoring, startup troubleshooting, and device management.
- Familiarity with LLMs, AI tools, prompt writing, or annotation/review workflows.
- Excellent written communication skills, particularly in explaining technical steps clearly and concisely.
- Strong analytical thinking and attention to detail.
Preferred Qualifications
- Experience in AI training, data annotation, technical content review, or model evaluation.
- Knowledge of Windows administration, system logs, driver management, and update troubleshooting.
- Experience creating SOPs, troubleshooting playbooks, or knowledge base content.
- Familiarity with support automation, virtual agents, or AI-assisted help desk tools.
Engagement Details
- Type: Contractor
- Duration: 4 weeks
- Commitment: Minimum 30 hours/week, at least 4 hours/day with 4-hour overlap with PST
Evaluation Process
- Shortlisted candidates will receive a Job Interest Form.
- An assessment will be shared after profile review — must be completed within 48 hours.
- Candidates who pass the assessment will be contacted to discuss pre-onboarding requirements.