Grafana Task Design Engineer at Mercor

Grafana Task Design Engineer | $90–150/hr | Worldwide Remote | Part-Time Contract (10–15 hrs/week)

Mercor is seeking experienced Grafana professionals to design expert-level evaluation tasks that test AI agents on real-world Grafana workflows. If you live and breathe observability, dashboards, and alerting pipelines, this is a unique opportunity to shape how AI systems are benchmarked against professional-grade tooling.

What You'll Do

• Design realistic, multi-step Grafana workflows covering dashboards, alerting rules, data source configuration, panel setup, and cross-module operations
• Execute each workflow yourself on a hosted Grafana instance to produce a reference trajectory
• Write clear, specific task prompts with measurable, programmatically verifiable outcomes
• Implement grading scripts (Python) that validate whether each task was completed correctly
• Review AI agent attempts, identify failure points, and tag root causes
• Calibrate task difficulty to ensure tasks are challenging yet solvable, iterating based on model performance

Requirements

• 2+ years of daily, professional Grafana experience in SRE, Platform Engineering, Observability, or a similar role
• Deep familiarity with PromQL, dashboard templating, alerting pipelines, and data source configuration (Prometheus, InfluxDB, etc.)
• Ability to articulate workflows clearly enough for programmatic verification
• Comfort writing basic grading scripts in Python (engineering support available as needed)

Nice to Have

• Experience with Grafana API automation
• Kubernetes or infrastructure monitoring background
• Familiarity with AI evaluation or benchmarking methodologies

Time Commitment

This role requires a minimum of 10–15 hours per week during the project. Fast turnaround and strong responsiveness are expected.