AI Task Auditor – Developer Workflows | $70–$100/hr | Worldwide Remote | Freelance Contract
We are seeking experienced technical specialists in AI-assisted developer workflows to audit and evaluate tasks used to train and assess AI systems. Your work will directly shape the quality and accuracy of AI training pipelines by ensuring tasks are technically rigorous, realistic, and well-structured.
Task Evaluation: Assess developer workflow tasks for technical accuracy, realism, solvability, reproducibility, and the quality of supporting tests and evaluation criteria.
Technical Auditing & Feedback: Identify and report on IDE integration faults, AI-assisted coding inefficiencies, and logic errors — providing clear, actionable feedback to improve task quality.
Demonstrable professional experience and deep knowledge in modern developer tooling, including AI coding assistants, telemetry/trace analysis, and developer workflow ecosystems. (Candidates will be considered for one specialty based on their background; cross-domain expertise is not required.)
Strong analytical and problem-solving skills with the ability to rigorously test, troubleshoot, and evaluate complex technical scenarios.
Pay Rate: $70–$100/hr, determined based on experience, expertise, and geographic location.
Employment Type: Freelance Contract
Workplace: Fully Remote
Requirements: Contractors must supply their own secure computer and high-speed internet. Company-sponsored benefits such as health insurance and PTO do not apply.
