Welsh Audio AI Evaluation Specialist at Invisible Tech

Welsh Audio AI Evaluation Specialist | $6–$65/hr | Worldwide Remote | Freelance Contract

Join a cutting-edge AI benchmark evaluation project as a freelance Welsh Audio Specialist. You'll help shape the next generation of agentic audio models by designing evaluation scenarios, auditing conversational AI outputs, and generating high-quality training datasets — all from a fully remote setup.

Project Overview

We are sourcing independent Audio Evaluation Specialists to assess advanced AI audio models in real-world customer support contexts — including flight bookings, financial services, and telecommunications. Your expert-crafted evaluations will directly improve model accuracy, conversational naturalness, and task completion performance.

Key Deliverables

• Role-Play Scenario Execution: Design and perform complex, realistic customer service simulations across travel, finance, and technical support domains.
• Model Performance Auditing: Evaluate AI outputs using standardized qualitative and quantitative metrics, focusing on task accuracy, audio comprehension, and conversational flow.
• Technical Metric Evaluation: Assess the model's understanding of JSON structures, functions, methods, and structured data reasoning within support contexts.
• Dataset Generation: Contribute to diverse, high-quality Welsh audio datasets that reflect authentic customer interaction expectations.

Required Expertise

• Demonstrated professional experience in customer support, technical troubleshooting, or conversational AI evaluation.
• Native or bilingual Welsh proficiency with strong fluency across reading, listening, writing, and speaking.
• Basic programming literacy — comfortable working with JSON structures, functions, and simple logic.
• Detail-oriented approach to structured prompts, evaluation rubrics, and technical guidelines.
• Equipment Required: Access to a high-quality microphone for clean audio input during voice evaluations.

Engagement Details

• Type: Freelance / Independent Contractor
• Location: Fully Remote
• Seniority: Mid–Senior Level
• Pay Range: $6–$65/hr (based on experience, expertise, and location)
• Note: As a contractor, you supply your own secure computer and high-speed internet. Company-sponsored benefits such as health insurance and PTO do not apply.