Posted over 30 days ago. Roles like this often stay open for a while, so it's still worth applying.
Italian Audio Evaluation Specialist at Invisible Tech
posted 4 months agoItalian Audio Evaluation Specialist | $6–$65/hr | Worldwide Remote | Freelance AI Trainer Project
Join a cutting-edge AI benchmark evaluation project as a freelance Audio Evaluation Specialist. You'll assess advanced agentic audio models used in real-world customer support scenarios—helping shape the next generation of conversational AI through expert-crafted training data and structured evaluations.
Project Deliverables
- Role-Play Scenario Execution: Design and execute complex, realistic customer service simulations across travel, finance, and technical support domains.
- Model Performance Auditing: Evaluate AI outputs using standardized qualitative and quantitative metrics, focusing on task completion accuracy, conversational naturalness, and audio comprehension.
- Technical Metric Evaluation: Assess the model's understanding of JSON structures, functions, methods, and structured data reasoning within support contexts.
- Dataset Generation: Contribute to diverse, high-quality audio datasets that reflect real customer expectations for clarity, efficiency, and natural conversational flow.
Required Skills & Qualifications
- Demonstrated professional experience in complex customer support, technical troubleshooting, or conversational AI evaluation.
- Native or bilingual proficiency in Italian, with strong fluency across reading, listening, writing, and speaking.
- Basic programming literacy, including a working understanding of JSON structures, functions, methods, and simple logic.
- Detail-oriented approach to structured prompts, evaluation rubrics, and technical guidelines.
- Required Equipment: Access to a high-quality microphone for clean, reliable audio input during voice evaluations.
Engagement Details
- Type: Freelance / Independent Contractor
- Location: Fully Remote
- Seniority: Mid–Senior Level
- Pay Range: $6–$65/hr, determined by experience, expertise, and location
Note: As an independent contractor, you are responsible for providing your own secure computer and high-speed internet. Company-sponsored benefits such as health insurance and PTO do not apply.
