Note: The job is a remote job and is open to candidates in USA. Straive is a global leader in enterprise-grade data analytics and AI solutions, committed to empowering businesses across various industries with cutting-edge technology and expert insights. The Evaluator - Biotechnology role involves reviewing and validating AI responses to ensure their usefulness and quality, while maintaining confidentiality and staying current with advancements in the biotechnology domain.
Responsibilities
• Review and Validate AI Responses: Evaluators will work via our online platform.
• All decisions of the Evaluators must be guided towards evaluating this central theme: usefulness of the AI response. This is the primary metric for measuring AI response quality: Is the AI response useful in addressing the question posed in the user prompt
• The goal is to assess the quality, safety, and utility of AI-generated content- particularly in use cases like literature summarization, clinical question answering, and decision support. Each AI generated response should be scored across 10 key criteria.
• Evaluators must use a Likert scale (4=Great, 3=Good, 2=Fair, 1=Poor) on the first six criterion, and pass’ or ‘fail’ on the remaining four.
• A commentary must be provided on the AI response, and flag critical issues (e.g., hallucinations, or, ethical/safety concerns).
• Commentaries must be error-free, concise and consistent with established medical guidelines, evidence-based practices, and current clinical standards. Rewriting the commentary and revisiting the evaluation may also be within scope based on feedback from quality checks.
• Stay Current with latest in their domain: Stay up-to-date with the latest research, guidelines, and advancements in your area of expertise, ensuring that their validation and feedback are informed by the most current and accurate information.
• Maintain Confidentiality: Adhere to strict confidentiality of the data received for processing and comply with data protection protocols and other relevant laws and guidelines.
Skills
• Have a minimum of 2 years of research experience in a reputed institution or laboratory.
• Strong subject matter expertise.
• Possess excellent written skills, with the ability to clearly articulate complex clinical concepts and provide concise commentaries on shortcomings of AI response.
• Have a basic understanding of Generative AI usage pertaining to healthcare information processing.
Education Requirements
• PhD or Masters in Biotechnology.
Company Overview
• Straive is a global provider of technology-driven content and data services. It was founded in 2010, and is headquartered in Nino, Iloilo, PHL, with a workforce of 10001+ employees. Its website is https://www.straive.com/.
Apply Now
Apply Now