Italian Audio Evaluation Specialist at Invisible Tech

Italian Audio Evaluation Specialist | $6–$65/hr | Worldwide Remote | Freelance AI Trainer Project

Join a cutting-edge AI benchmark evaluation project as a freelance Audio Evaluation Specialist. You'll assess advanced agentic audio models used in real-world customer support scenarios—helping shape the next generation of conversational AI through expert-crafted training data and structured evaluations.

Project Deliverables

• Role-Play Scenario Execution: Design and execute complex, realistic customer service simulations across travel, finance, and technical support domains.
• Model Performance Auditing: Evaluate AI outputs using standardized qualitative and quantitative metrics, focusing on task completion accuracy, conversational naturalness, and audio comprehension.
• Technical Metric Evaluation: Assess the model's understanding of JSON structures, functions, methods, and structured data reasoning within support contexts.
• Dataset Generation: Contribute to diverse, high-quality audio datasets that reflect real customer expectations for clarity, efficiency, and natural conversational flow.

Required Skills & Qualifications

• Demonstrated professional experience in complex customer support, technical troubleshooting, or conversational AI evaluation.
• Native or bilingual proficiency in Italian, with strong fluency across reading, listening, writing, and speaking.
• Basic programming literacy, including a working understanding of JSON structures, functions, methods, and simple logic.
• Detail-oriented approach to structured prompts, evaluation rubrics, and technical guidelines.
• Required Equipment: Access to a high-quality microphone for clean, reliable audio input during voice evaluations.

Engagement Details

• Type: Freelance / Independent Contractor
• Location: Fully Remote
• Seniority: Mid–Senior Level
• Pay Range: $6–$65/hr, determined by experience, expertise, and location

Note: As an independent contractor, you are responsible for providing your own secure computer and high-speed internet. Company-sponsored benefits such as health insurance and PTO do not apply.