Posted over 30 days ago. Roles like this often stay open for a while, so it's still worth applying.
Portuguese Audio Evaluation Specialist at Invisible Tech
posted 4 months agoPortuguese Audio Evaluation Specialist | $6–$65/hr | Worldwide Remote | Freelance AI Trainer Project
Join a cutting-edge AI benchmarking initiative as a freelance Audio Evaluation Specialist, helping shape the next generation of agentic audio models. This project focuses on evaluating advanced conversational AI systems in real-world customer support scenarios — including flight bookings, financial services, and telecommunications — by producing high-quality training data and structured evaluation tasks.
Project Deliverables
- Role-Play Scenario Execution: Design and perform complex, realistic customer service simulations across travel, finance, and technical support domains to stress-test AI model behavior.
- Model Performance Auditing: Evaluate AI outputs against standardized qualitative and quantitative metrics, including task completion accuracy, conversational naturalness, and audio comprehension.
- Technical Metric Evaluation: Assess the model's understanding of JSON structures, functions, methods, and structured data reasoning within support contexts.
- Dataset Generation: Contribute to diverse, high-quality audio datasets that reflect real customer expectations for clarity, efficiency, and natural conversational flow.
Required Expertise
- Demonstrated professional experience in customer support, technical troubleshooting, or conversational AI evaluation.
- Native or bilingual proficiency in Portuguese, with strong skills across reading, listening, writing, and speaking.
- Basic programming literacy, including a working understanding of JSON structures, functions, and simple logic.
- Detail-oriented approach to structured prompts, evaluation rubrics, and technical guidelines.
- Equipment Required: Access to a high-quality microphone for clean audio input during voice evaluations. Contractors must also supply their own secure computer and high-speed internet connection.
Engagement Details
- Type: Freelance / Independent Contractor
- Workplace: Fully Remote
- Seniority: Mid–Senior Level
- Pay Range: $6–$65/hr, determined by experience, expertise, and geographic location
Note: As an independent contractor, company-sponsored benefits such as health insurance and paid time off do not apply. Final compensation may vary based on qualifications and location.
