German Audio Evaluation Specialist at Invisible Tech

German Audio Evaluation Specialist | $6–$65/hr | Worldwide Remote | Freelance AI Trainer Project

Join a cutting-edge AI benchmark evaluation project as a freelance Audio Evaluation Specialist. You'll assess and help improve advanced agentic audio models by simulating real-world customer support interactions, auditing AI outputs, and generating high-quality training datasets — all in German.

Project Overview

As AI models take on increasingly complex workflows in customer support — spanning flight bookings, financial services, and telecommunications — the quality of their training data is critical. This project focuses on producing expert-crafted evaluation tasks through simulated interactions, auditing conversational AI outputs, and building clean, reliable datasets to optimize model performance.

Key Deliverables

• Role-Play Scenario Execution: Design and execute realistic, complex customer service role-play scenarios across travel, finance, and technical support domains.
• Model Performance Auditing: Evaluate AI outputs using standardized qualitative and quantitative metrics, focusing on task completion accuracy, conversational naturalness, and audio comprehension.
• Technical Metric Evaluation: Assess the model's understanding of JSON structures, functions, methods, and structured data reasoning within a support context.
• Dataset Generation: Contribute to diverse, high-quality audio datasets that reflect real customer expectations for clarity, efficiency, and natural conversational flow.

Required Skills & Expertise

• Demonstrated professional experience in complex customer support, technical troubleshooting, or conversational AI evaluation.
• Native or bilingual German proficiency, with strong fluency across reading, listening, writing, and speaking.
• Basic programming literacy — comfortable working with JSON structures, functions, methods, and simple logic.
• Detail-oriented approach to structured prompts, evaluation rubrics, and technical guidelines.
• Required Equipment: Access to a high-quality microphone for clean audio input during voice evaluations.

Engagement Details

• Type: Freelance / Independent Contractor
• Workplace: Fully Remote
• Seniority: Mid–Senior Level
• Pay Range: $6–$65/hr (based on experience, expertise, and location)

Note: As an independent contractor, you will supply your own secure computer and high-speed internet. Company-sponsored benefits such as health insurance and PTO do not apply.