R Language Software Engineering Expert at Mercor

R Language Software Engineering Expert | $60–100/hr | Worldwide Remote

Mercor is seeking experienced software engineers and data scientists with deep expertise in the R programming language to evaluate and improve AI-generated code responses. This is a flexible contract role (full-time or part-time) open to candidates globally, requiring fluent English communication skills.

Why This Role Exists

Mercor partners with leading AI teams to enhance the quality, accuracy, and reliability of conversational AI systems. This project focuses specifically on evaluating how AI models reason about code, generate solutions, and explain technical concepts — ensuring outputs meet real-world engineering standards.

What You'll Do

• Evaluate LLM-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness
• Conduct fact-checking using trusted public sources and authoritative references
• Execute code and validate outputs using appropriate tools
• Annotate model responses by identifying strengths, weaknesses, and factual or conceptual inaccuracies
• Assess code quality, readability, algorithmic soundness, and explanation quality
• Ensure model responses align with expected conversational behavior and system guidelines
• Apply consistent evaluation standards using clear taxonomies, benchmarks, and detailed guidelines

Who You Are

• Holds a BS, MS, or PhD in Computer Science or a closely related field
• 5+ years of real-world experience in software engineering or related technical roles
• Expert-level proficiency in the R programming language
• Capable of independently solving HackerRank or LeetCode Medium and Hard-level problems
• Experience contributing to well-known open-source projects with merged pull requests
• Significant experience using LLMs in coding workflows, with an understanding of their strengths and failure modes
• Strong attention to detail and comfort evaluating complex technical reasoning

Nice-to-Have Skills

• Prior experience with RLHF, model evaluation, or data annotation
• Competitive programming background
• Experience reviewing code in production environments
• Familiarity with multiple programming paradigms or ecosystems
• Ability to explain complex technical concepts to non-expert audiences

Why Join Mercor

This remote role lets experienced engineers directly shape how AI systems reason about and generate code — contributing to tools used by developers worldwide. Apply your expertise to meaningful, high-impact AI development work on a flexible schedule.