AI Agent Oversight Intern

About CARV

CARV is building the infrastructure that powers AI-driven recruiting and talent operations. As AI becomes increasingly embedded in hiring workflows, ensuring quality, reliability, and exceptional customer experiences is critical.

We're looking for a curious, detail-oriented individual to join our AI Oversight Team as an intern. This role offers hands-on exposure to AI systems, context engineering, product development, quality assurance, and customer operations. You'll work directly with cutting-edge AI products while helping ensure they perform accurately and reliably for customers.

What You'll Do

AI Quality Assurance & Testing

• Perform end-to-end testing of AI products, workflows, and agent experiences.

• Identify, document, and report bugs, errors, and unexpected AI behaviors.

• Validate fixes and ensure product quality before new features are released.

• Execute structured test plans and exploratory testing scenarios.

AI Chat Monitoring & Oversight

• Review AI conversations to identify performance issues, hallucinations, and workflow failures.

• Monitor customer interactions and proactively surface product improvement opportunities.

• Help improve AI behavior through feedback collection and quality analysis.

• Assist with maintaining high standards for AI accuracy and reliability.

Customer Hypercare & Support

• Support customers by investigating and triaging support tickets.

• Reproduce reported issues and collaborate with product and engineering teams on resolutions.

• Monitor customer health and help ensure successful adoption of new features.

• Provide timely feedback and insights from customer interactions.

Product Development Support

• Participate in early-stage testing of new product features and AI capabilities.

• Provide structured feedback on usability, workflows, and customer experience.

• Help evaluate AI outputs and benchmark performance across releases.

• Contribute to process improvements for testing and oversight operations.

What You'll Gain

• Direct exposure to cutting-edge AI systems and agent workflows.

• Experience in AI quality assurance, context engineering, and AI operations.

• Close collaboration with product, engineering, and AI teams.

• Hands-on experience at one of the fastest-growing AI companies in recruiting.

• A unique opportunity to help shape how AI products are built, tested, and deployed at scale.

If you're excited about AI and want to help ensure the next generation of AI products performs at the highest level, we'd love to hear from you.

• Strong attention to detail and an ability to spot inconsistencies.

• Interest in AI, large language models, agents, prompt engineering, or context engineering.

• Excellent written communication skills.

• An analytical mindset and comfort in investigating issues independently.

• Ability to follow structured processes while also thinking critically.

• Comfortable working in a fast-paced startup environment.

Nice to Have

• Experience using ChatGPT, Claude, Gemini, or other AI tools.

• Basic understanding of software testing, QA, or customer support.

• Interest in recruiting technology, SaaS, or AI product development.

• Experience documenting bugs or providing product feedback.