Role description
CareerflowCareerflow Human Data Labs partners with AI companies to bring real-world professional expertise into their products.
About the role
We are seeking an experienced Dermatologist to help evaluate and enhance large language model (LLM) outputs in the medical domain. You’ll assess AI-generated clinical content for dermatological accuracy, safety, and relevance — contributing to the development of responsible AI in healthcare. We are seeking India-based dermatologists to review dermatology images using a structured online evaluation tool. The work involves assessing image quality and diagnostic usability; identifying concerns such as blur, lighting, exposure, colour, and framing; and, where applicable, identifying likely skin conditions, assigning confidence ratings, and documenting rationale.
What You'll Do Day-to-Day:
Review AI-generated medical text for accuracy, harmfulness, and completeness, with focus on dermatology.
Evaluate diagnoses, treatment plans, and summaries for dermatologic cases.
Provide expert feedback to improve medical integrity and safety of LLM outputs.
Collaborate with AI researchers and clinicians to align model performance with evidence-based dermatology standards.
Requirements:
MBBS with completed Dermatology residency.
Minimum 5 years of post-residency experience in dermatology.
Based in India (mandatory).
Strong visual attention to detail
Comfortable reviewing sensitive or graphic medical images
Technically savvy—able to navigate web-based annotation platforms, use image zoom/tools, follow detailed guidelines, and accurately complete structured questionnaires.
Experience in medical content review, clinical research, annotation or AI/ML evaluation preferred.
5 years of professional experience
Total number of positions: 75
Engagement Length: 4 weeks, Full-time (8 hours/day) 40 hours per week. Overlap 4 hours with PST
Location - India
12-week project, with a preferred commitment of up to 40 hours per week.
Fully remote, with payment in USD.
Start as soon as you successfully pass the assessment.