Benture logo
next job
Invisible Tech logo

SMB AI Power User — Competitive Eval at Invisible Tech

posted 1 hour ago
invisible.co Contractor remote in US 40-50/hr 30 views

SMB AI Power User — Competitive Evaluations | $40–50/hr | Remote (US Only)

Meridial is seeking a hands-on small business owner or operator to join a Competitive Evaluations team supporting a major consumer technology company. In this role, you'll use your real business operations as a test bed to evaluate an AI assistant subscription against leading standalone competitors — surfacing the gaps that actual paying subscribers will encounter.

About Meridial

Meridial places skilled, remote-first professionals into high-trust, high-precision operational roles for leading technology companies. Our teams operate as an embedded extension of our clients' product and operations organizations, holding the same quality bar and deadlines.

What You'll Do

  • Run head-to-head prompts and multi-turn workflows across competing AI assistants using real small-business tasks — ad copy, content planning, customer messaging, supplier research, and light bookkeeping.
  • Build and maintain a library of realistic SMB test cases spanning creative, organic content, customer communications, competitor research, pricing, scheduling, and more.
  • Identify and document failure modes: wrong answers, unnecessary refusals, poor instruction-following, tone misses, brand-unsafe output, broken formatting, and lost context across turns.
  • Write clear, reproducible evaluation reports including the prompt used, model and surface, expected vs. actual output, severity rating, and business impact.
  • Assess the bundled AI subscription on value terms relative to standalone competitor offerings at comparable price points.
  • Stress-test assistant features within social and commerce surfaces where business owners actually encounter them — not just standalone chat.

What We're Looking For

  • Owner or operator of a small or medium business (sole proprietor, founder, or day-to-day operator at a 1–200 person company).
  • Daily, habitual use of generative AI tools for both business operations and marketing — occasional or experimental use is not a fit.
  • Active organic presence on Instagram and Facebook, personally managed: posting, Stories, Reels, and community engagement.
  • Hands-on Meta paid advertising experience — has personally built, launched, and optimized campaigns with real budget.
  • Based in the United States and authorized to work here.
  • Availability of up to 40 hours per week to meet agreed deliverables and timelines.
  • Exceptional written English — able to describe failures clearly enough for an engineer to reproduce without follow-up.
  • Comfortable working independently against a rubric with a consistent weekly output cadence.

Nice to Have

  • At least one active paid AI subscription (ChatGPT Plus/Pro, Claude Pro/Max, Gemini Advanced, or similar).
  • Runs a side business or second venture alongside a primary role.
  • Heavy personal and commercial Instagram use — fluent in Reels, Stories, trends, and creator tooling.
  • Subscribes to two or more AI assistants simultaneously with an informed view on where each excels.
  • Uses AI beyond chat: automations, agents, API or no-code integrations, custom GPTs or Projects.
  • Prior experience with model evaluation, red teaming, data annotation, QA, or structured user research.
  • Familiarity with SMB tools such as Shopify, Square, QuickBooks, Klaviyo, Canva, CapCut, or Later.

Compensation & Details

This is an independent contractor engagement paying $40–$50 per hour, with the exact rate determined based on experience, expertise, and location. Contractors must supply their own secure computer and high-speed internet. Company-sponsored benefits such as health insurance and PTO do not apply.

Go back

Related Jobs

Benture logo
See All Jobs
Back