Tooling Engineer
- Pay
- Pay not listed
- Where
- Remote
- Eligibility
- Country eligibility not stated. Check with the provider before applying.
- Listing
- Last verified Oct 20, 2026
Apply opens the provider’s application page. You apply there yourself: we never submit applications, and opening the page doesn’t mean you’ve applied. Nobody can promise you’ll be hired.
Some Apply links are referral links. If you apply through them, the provider may pay us a commission. Referral disclosure
Overview
Support the evaluation, testing, and improvement of advanced Large Language Models (LLMs) as a domain expert (SME).
Apply your subject-matter expertise to assess AI-generated responses, identify knowledge gaps, design challenging prompts, and improve model accuracy, reliability, and reasoning.
Responsibilities
- Create complex, domain-specific prompts to test LLM capabilities.
- Evaluate AI-generated responses for factual accuracy, reasoning, relevance, and overall quality.
- Identify factual errors, logical inconsistencies, knowledge gaps, and model weaknesses.
- Develop challenging test cases and edge cases that expose model limitations.
- Provide clear, detailed, and evidence-based feedback to improve model performance.
Requirements
- Master's degree or higher in a relevant field.
- At least three years of professional, research, or teaching experience.
- Excellent written English communication skills.
- Strong analytical and critical-thinking abilities.
- Exceptional attention to detail.
Preferred
- Experience working with LLMs or Generative AI.
- Familiarity with prompt engineering, AI evaluation, or model testing.
- Experience designing challenging prompts, identifying edge cases, or stress-testing AI models.
Engagement and pay
- Listed as full-time and remote on the source.
- The source listing does not state pay.
Eligibility
- Country eligibility not stated. Check with the provider before applying.
Skills
- business analysis