Lead the charge in building next-gen AI systems as a Senior Quality Engineer. Design evaluation frameworks and ensure high-quality responses with a focus on automation and testing efficiency.This role requires 6+ years of experience in software engineering, emphasizing testing infrastructure and ML evaluation. Shape evaluation standards while collaborating with product teams to translate quality criteria into measurable tests. Your contributions ensure that generative AI delivers accurate, relevant, and grounded responses in a groundbreaking technology environment.Key Responsibilities:• Design and build evaluation infrastructure for AI systems• Create automated test suites for validating answer quality• Develop systems for regression detection of quality issues• Establish frameworks measuring response accuracy and citation correctness• Monitor operational efficiency of AI execution processesRequirements:• 6+ years in software engineering with focus on ML or quality systems• Proficiency in Python and evaluation framework experience• Capability to define roadmap independently• Understanding of generative AI response quality metrics• Background in statistical methods and A/B testingShape the future of AI quality assurance by leveraging your expertise in evaluation frameworks and testing methodologies.#J-18808-Ljbffr
Innovative Ai Quality Engineer Driving Evaluation Infrastructure Development
IDC
toronto, toronto
Published 27 days ago
Report job