Job Description
Responsibilities
- Write and refine prompts to guide model behavior in engineering scenarios
- Evaluate LLM-generated responses to engineering-related queries for technical accuracy, applied reasoning, and completeness
- Conduct fact-checking and verify any technical claims using authoritative public sources and domain knowledge
- Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies
- Assess clarity, structure, and appropriateness of explanations for different audiences
- Ensure model responses align with expected conversational behavior and system guidelines
- Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines
Good Candidature
- PhD in Engineering or a closely r...