This job post has expired on April 27, 2026. It is likely that the position has already been filled.
Grafana Task Design Engineer at Mercor
posted 6 months agoGrafana Task Design Engineer | $90–150/hr | Worldwide Remote | Part-Time Contract (10–15 hrs/week)
Mercor is seeking experienced Grafana professionals to design expert-level evaluation tasks that test AI agents on real-world Grafana workflows. If you live and breathe observability, dashboards, and alerting pipelines, this is a unique opportunity to shape how AI systems are benchmarked against professional-grade tooling.
What You'll Do
- Design realistic, multi-step Grafana workflows covering dashboards, alerting rules, data source configuration, panel setup, and cross-module operations
- Execute each workflow yourself on a hosted Grafana instance to produce a reference trajectory
- Write clear, specific task prompts with measurable, programmatically verifiable outcomes
- Implement grading scripts (Python) that validate whether each task was completed correctly
- Review AI agent attempts, identify failure points, and tag root causes
- Calibrate task difficulty to ensure tasks are challenging yet solvable, iterating based on model performance
Requirements
- 2+ years of daily, professional Grafana experience in SRE, Platform Engineering, Observability, or a similar role
- Deep familiarity with PromQL, dashboard templating, alerting pipelines, and data source configuration (Prometheus, InfluxDB, etc.)
- Ability to articulate workflows clearly enough for programmatic verification
- Comfort writing basic grading scripts in Python (engineering support available as needed)
Nice to Have
- Experience with Grafana API automation
- Kubernetes or infrastructure monitoring background
- Familiarity with AI evaluation or benchmarking methodologies
Time Commitment
This role requires a minimum of 10–15 hours per week during the project. Fast turnaround and strong responsiveness are expected.
How to apply for this role
- Upload your resume — keep it up-to-date and in English. Mercor will auto-fill your profile from it.
- Complete the AI interview — a 15-minute conversation about your experience. Be ready to discuss specific projects and challenges you've solved.
- Submit your application — only about 20% of applicants finish all the steps, so completing yours puts you well ahead.