Mercor

Generalist Language Model Evaluator: Remote Role

📍 Location
quebec, capitale nationale
⏰ Job Type
Full-time
📅 Posted
June 16, 2026
Apply Now

Job Description

Become a Language Model Evaluator with Mercor, engaging with remote work as a contract Generalist. Focus on English and Punjabi to enhance AI language capabilities.
Mercor is looking for a detail-oriented evaluator for its language models. This role requires expertise in both Punjabi and English, bringing valuable experience with large language models. Your task will include generating and analyzing evaluation data to ensure the quality and factual accuracy of AI model responses, conducted independently and asynchronously.
Key Responsibilities:
• Conduct thorough fact-checking using vetted sources
• Assess strengths and weaknesses in AI responses
• Monitor clarity, reason quality, and tone of outputs
• Ensure responses meet set guidelines for conversation
• Collaborate asynchronously to refine AI performance
Requirements:
• Bachelor's degree in a relevant discipline
• Native proficiency in Punjabi and strong English skills
• Significant experience with ...

Start Your Week Right!

Apply now and make every Monday exciting with Mercor

Apply for this Position