Posted over 30 days ago. Roles like this often stay open for a while, so it's still worth applying.
Agentic Audio AI Specialist at Invisible Tech
posted 5 months agoAgentic Audio AI Specialist | $11–$30.65/hr | Worldwide Remote | Contract
Join a cutting-edge project focused on evaluating and benchmarking advanced agentic audio AI models for real-world customer support applications. As a freelance AI Trainer, you'll design evaluation scenarios, contribute to dataset development, and help optimize conversational audio agents across a range of industries.
Key Responsibilities
- Create and execute role-play–based evaluation scenarios simulating realistic customer service interactions across domains including:
- Flight bookings and travel support
- Financial services
- Telecommunications and technical support
- Contribute to building diverse, representative datasets used to assess conversational audio agents
- Evaluate model performance using standardized qualitative and quantitative metrics
- Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow
Evaluation Metrics
Model performance is assessed across conversational, technical, and audio-specific criteria, including:
- Task completion accuracy and efficiency
- Conversational naturalness — tone, flow, and coherence
- Audio comprehension and response quality
- Instruction adherence and contextual understanding
- Basic programming literacy, including JSON structures, functions/methods, and structured data reasoning
- Technical communication clarity in support-style problem-solving scenarios
Requirements
- Strong verbal communication skills in a simulated customer support context
- Full English proficiency across reading, listening, writing, and speaking
- Access to a high-quality microphone for clean audio input
- Comfort working with structured prompts, evaluation rubrics, and technical guidelines
- Device capable of running audio recording software and handling large technical documents
As a contractor, you will supply your own secure computer and high-speed internet. Company-sponsored benefits such as health insurance and PTO do not apply.
