Step into a lead evaluator position focused on enhancing code quality in a multi-language landscape. Utilize your extensive software engineering experience to assess LLM-generated responses with precision and clarity.In this role, you will leverage your 5+ years of experience in software engineering and expertise in languages such as C++ and Ruby. You will be responsible for validating code outputs, fact-checking, and providing quality annotations of responses, ensuring they meet desired evaluation standards.Key Responsibilities:• Evaluate coding responses for clarity and logic• Conduct fact-checking using reliable references• Execute code to validate and test outputs• Annotate areas of improvement in model responses• Uphold evaluation standards through clear guidelinesRequirements:• BS, MS, or PhD in Computer Science or equivalent• 5+ years of experience in technical roles• Proficient in multiple programming languages• Experience using LLMs for coding tasks• Strong detail orientation for complex evaluationsLeverage your technical expertise to enhance code evaluation standards and contribute significantly to software engineering insights.#J-18808-Ljbffr
Lead Evaluator For Software Engineering Responses In Multiple Languages
MERCOR AI
, , canada, , , canada
Published 27 days ago
Report job