- Experience
- 3+ yrs
- Location
- United States, Canada, United Kingdom, Ireland, Australia May Also Be Accepted
- Work mode
- Remote
- Job type
- Contract
- Duration
- 12 Weeks
- Weekly
- 10+ hours
- Salary
- $40–$120 / hour
- Posted
- today
About the role
The Life Sciences AI Evaluator – Experimental Biology will help assess how frontier AI models handle real-world laboratory work, including experimental design, assay QC, troubleshooting, raw instrument output interpretation, and data usability decisions. This fully remote, self-directed role is suited to hands-on bench scientists with at least two years of post-undergraduate research experience, depth in at least one experimental biology discipline, strong scientific reasoning, and excellent written communication.
Key Responsibilities
- Design challenging, realistic experimental biology tasks based on day-to-day laboratory workflows, including scenarios involving plate QC, cell-based assays, flow panel gating, cloning strategies, and Western blot interpretation.
- Assemble or curate the supporting files required for each task, such as plate maps, reader output, instrument exports, gel and blot images, flow summaries, protocols and SOPs, notebook entries, QC records, correspondence, and experimental data.
- Run experimental biology tasks through frontier AI agents and evaluate the resulting QC summaries, experimental plans, troubleshooting memos, and results workbooks against professional scientific standards.
- Compare outputs from two AI models using identical prompts and files, determine which performed better, and document the strengths, limitations, and errors in each response.
- Write detailed grading rubrics defining the controls, exclusions, diagnoses, analyses, and conclusions required for a correct deliverable.
- Flag concrete failures with evidence, including ignored or misread controls, missed edge effects and outliers, incorrect normalization to a reference, unsupported troubleshooting explanations, fabricated values, ignored files, and interpretations that do not address the requested task.
- Assess experimental design and troubleshooting quality by determining whether controls are appropriate, whether a run failed, and whether the proposed diagnosis is supported by the underlying data.
- Review and refine tasks created by other experts while contributing across molecular and cell biology, protein biochemistry, immunology and flow cytometry, imaging and histology, microbiology and virology, in vivo and preclinical work, laboratory operations, and analytical sciences.
- Apply independent scientific judgment to verify claims in protocols, reports, correspondence, and other documents against primary data and raw instrument output.
Required Qualifications
- At least 3 years designing and running experiments at a pharma or biotech lab, academic research lab, research institute, or similar laboratory environment, counted after undergraduate education.
- An in-progress Bachelor's degree or higher in Biology or a directly related field, completed in the United States, Canada, Europe, or the UK.
- Depth of experience in at least one of molecular biology and cloning; cell culture and cell-based assays; protein biochemistry; immunology and flow cytometry; imaging and histology; microbiology or virology; or in vivo and preclinical work.
- Working understanding of several additional experimental biology areas sufficient to assess adjacent workflows, including how a cell-based assay is set up and controlled and how a flow panel is designed and gated.
- Experience designing and troubleshooting experiments rather than only executing established SOPs, including explaining the purpose of controls and diagnosing why a run failed.
- Experience generating and QCing primary data, reviewing raw instrument output, and judging whether a run is usable before figure creation.
- Ability to draw on real-world experience and day-to-day workflows to craft scenarios that test whether an AI system can perform scientific work accurately.
- Current or recent hands-on bench or analysis experience at an individual contributor level, rather than experience solely in a managerial capacity.
- Full professional or native-level written and spoken English, strong written communication, and the ability to explain complex scientific reasoning clearly and concisely.
- Comfort with ambiguity, attention to detail, and the ability to build an accurate working picture of unfamiliar files and scientific material quickly.
- Ability to interpret feedback, determine which parts are correct, apply it independently, and seek answers when encountering uncertainty.
- Ability to ramp quickly on unfamiliar work from written material and incomplete instructions, including writing grading rubrics.
- General familiarity with AI and LLM tools, including professional use of models such as Claude or ChatGPT in life sciences work.
- Baseline technology literacy, including comfort with cloud file tools, browser profile management, desktop application installation, and everyday file handling.
- Availability of at least 10 hours per week, with no weekly maximum.
- Based in the United States, Canada, or the UK; Ireland and Australia may also be accepted.
Benefits and Perks
- Fully remote work environment.
- Flexible, self-directed, long-form work structure.
- Opportunity to apply professional experimental biology expertise to improve frontier AI systems.
- At least 10 hours per week of work availability, with no stated weekly maximum and the opportunity to contribute more hours.
- Opportunity to work with realistic professional scientific files and workflows across multiple life sciences disciplines.
Skills
- Experimental design
- Assay QC
- Troubleshooting failed experiments
- Raw instrument output interpretation
- Cell-based assays
- Flow cytometry
- Flow panel gating
- Cloning strategy
- Western blot interpretation
- Plate maps
- Reader output
- Instrument exports
- Gel and blot images
- Protocols and SOPs
- Notebook entries
- QC records
- Experimental data analysis
- Experimental planning
- Troubleshooting memos
- Results workbooks
- Grading rubrics
- Controls assessment
- Well exclusion
Education
Required
- Bachelor
Selection process
Step 1
Submitted
Someone who fits the role and has told you they are interested, with their resume.
Step 2
Client interviews
Step 3
Selected
If they qualify and are selected, your payout is due.