Back to all jobs
I

Domain Advisor Consultant (Subject Matter Expert)

Invisible Agency
WorldwideRemote3mo ago

About the role

<p><strong>Engagement Type:</strong> Business-to-Business (B2B) / Independent Contractor&nbsp;</p> <p><strong>Location:</strong> Remote</p> <p><strong>The Opportunity: Define the "Ground Truth" for Generative AI</strong></p> <p>We are looking to engage elite Subject Matter Experts (SMEs) to partner with us on high-impact AI evaluation and training projects. We are not looking for generalists; we are seeking established authorities—the top 1% in their respective fields—who are eager to apply their deep domain knowledge to shape the reasoning, accuracy, and safety of next-generation Large Language Models (LLMs).</p> <p>This is a consulting engagement for independent professionals who want to help define what "perfection" looks like in their industry. You will not just be grading AI; you will be architecting the <strong>"Gold Standard"</strong> rubrics that teach models how to think like an expert.</p> <h3><strong>Scope of Services &amp; Deliverables</strong></h3> <p>This engagement focuses on high-level advisory and specialized analysis. Consultants will operate under a Statement of Work (SOW) to provide the following deliverables:</p> <ul> <li><strong>Rubric Architecture:</strong> Review and advise on the quality criteria used to evaluate AI outputs. You will determine if the AI’s logic holds up to professional scrutiny in your field.</li> <li><strong>"Golden" Data Curation:</strong> Create, edit, or certify "Golden Tasks"—benchmark examples of perfect prompts and responses that serve as the ground truth for model training.</li> <li><strong>Expert Gap Analysis:</strong> Analyze model failures (hallucinations, logical fallacies) and provide technical breakdowns of <em>why</em> the model failed and how a human expert would have approached the problem.</li> <li><strong>Advisory on Complexity:</strong> Consult on the difficulty and nuance of specific prompts to ensure the AI is being tested against sufficiently rigorous scenarios.</li> </ul> <h3><strong>Consultant Profile: Who We Are Looking To Partner With</strong></h3> <p>We are seeking independent business owners, freelancers, and academic leaders who possess:</p> <ul> <li><strong>Elite Domain Mastery:</strong> Advanced degrees (PhD, MD, JD) or equivalent industry-recognized status (e.g., Senior Principal Engineer, Published Author, Award-Winning Creative).</li> <li><strong>Professional Autonomy:</strong> You currently operate as an independent consultant or freelancer and have your own workflows, equipment, and professional methodology.</li> <li><strong>Interest in Shaping Technology:</strong> While prior experience in AI evaluation is a bonus, it is absolutely not required. We want industry veterans who are eager to set the "gold standard" for how AI should operate within their specific profession.</li> <li><strong>Articulate Reasoning:</strong> The ability to not just know the right answer, but to articulate the <em>reasoning process</em> clearly in writing.</li> </ul> <h3><strong>Engagement Structure &amp; Compliance</strong></h3> <p>This is a strictly non-employee, independent contractor opportunity designed for professionals who manage their own business operations.</p> <ul> <li>Engagements are <strong>project-based and non-exclusive</strong>, allowing you to continue working with other clients</li> <li>You have flexibility in <strong>how you complete deliverables</strong>, in alignment with project requirements</li> <li>Scope, timelines, and compensation are <strong>defined in advance</strong> for each assignment</li> <li><strong>Remote &amp; Independent:</strong> You provide your own workspace and equipment.</li> <li><strong>Global Compliance:</strong> Candidates must be properly registered to operate as independent contractors in their country of residence.</li> </ul> <h3><strong>Why Top-Tier Consultants Partner With Us</strong></h3> <ul> <li><strong>Intellectual Challenge:</strong> This is rare, cerebral work that challenges you to deconstruct your own expertise to train a machine.</li> <li><strong>High-Value Impact:</strong> Your input directly influences the safety and capability of models used by millions.</li> <li><strong>Flexible Revenue Stream:</strong> Supplement your primary consulting business with flexible, high-value project work.</li> </ul> <p>&nbsp;</p>

755,000+ hidden jobs like this

Invisible Agency and thousands of companies post here first — often days before LinkedIn or Indeed. Your first 5 applications are free; go Pro to apply without limits.

Everything Pro unlocks:

  • Unlimited applications — free stops at 5
  • Track every application in one place
  • Apply straight to the source, one click
  • Save & organize roles you love
  • Roles pulled from company boards before the big sites

Weekly

$9.99
$4.99/week

For an active search. Cancel anytime.

Most popular

Monthly

$24.99
$12.99/month

The smart pick. Save 35% vs weekly.

Lifetime

$99
$49.99once

Pay once. Every future feature, forever.