Agentic Audio AI Specialist at Invisible Tech

Agentic Audio AI Specialist | $11–$30.65/hr | Worldwide Remote | Contract

Join a cutting-edge project focused on evaluating and benchmarking advanced agentic audio AI models for real-world customer support applications. As a freelance AI Trainer, you'll design evaluation scenarios, contribute to dataset development, and help optimize conversational audio agents across a range of industries.

Key Responsibilities

• Create and execute role-play–based evaluation scenarios simulating realistic customer service interactions across domains including:
  • Flight bookings and travel support
  • Financial services
  • Telecommunications and technical support
• Contribute to building diverse, representative datasets used to assess conversational audio agents
• Evaluate model performance using standardized qualitative and quantitative metrics
• Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow

Evaluation Metrics

Model performance is assessed across conversational, technical, and audio-specific criteria, including:

• Task completion accuracy and efficiency
• Conversational naturalness — tone, flow, and coherence
• Audio comprehension and response quality
• Instruction adherence and contextual understanding
• Basic programming literacy, including JSON structures, functions/methods, and structured data reasoning
• Technical communication clarity in support-style problem-solving scenarios

Requirements

• Strong verbal communication skills in a simulated customer support context
• Full English proficiency across reading, listening, writing, and speaking
• Access to a high-quality microphone for clean audio input
• Comfort working with structured prompts, evaluation rubrics, and technical guidelines
• Device capable of running audio recording software and handling large technical documents

As a contractor, you will supply your own secure computer and high-speed internet. Company-sponsored benefits such as health insurance and PTO do not apply.