AI Labs
Science And Engineering AI Trainer
- Experience
- 2+ yrs
- Location
- United States, Canada, United Kingdom
- Work mode
- Remote
- Job type
- Contract
- Duration
- 12 Weeks
- Weekly
- 10+ hours
- Salary
- $40–$125 / hour
- Posted
- today
About the role
We are seeking practicing scientists, engineers, and data scientists to create and evaluate challenging technical tasks for frontier AI models. The role involves authoring realistic, domain-grounded scenarios, preparing professional files, comparing model outputs, writing grading rubrics, and identifying technical failures against professional standards. Candidates should have applied individual-contributor experience, strong written communication, statistical and experimental reasoning skills, and the ability to write and verify work in code for projects that require scientific computing.
Key Responsibilities
- Design challenging, realistic STEM and Data Science tasks grounded in day-to-day professional workflows and drawn from your own technical practice.
- Develop complete task scenarios, prompts, supporting files, expected failure points, and professional deliverables such as analyses, designs, test plans, protocols, or technical reports.
- Assemble and manage realistic practitioner files, including test data, drawings, schematics, specifications, simulation outputs, laboratory records, and reports.
- Run authored tasks through frontier AI models and evaluate the resulting calculations, analyses, designs, reviews, or reports against professional standards.
- Compare model outputs generated from identical prompts and files, determine which performed better, and document the strengths and deficiencies of each response.
- Write detailed grading rubrics that define correct assumptions, methods, magnitudes, units, failure modes, safety conditions, and other requirements for an acceptable deliverable.
- Identify and document concrete model failures, including unit and scaling errors, misread data, unsupported conclusions, fabricated or ignored source files, missed safety or boundary conditions, and off-brief interpretations.
- Apply statistical and experimental reasoning when evaluating experiment design, measurement error, uncertainty, analyses, and common statistical traps.
- Participate in expert review and revision by responding to feedback, refining completed tasks, and improving the quality and realism of submitted work.
- Review and refine tasks created by other experts and contribute domain judgment across adjacent scientific and engineering disciplines where appropriate.
Required Qualifications
- Applied experience in mathematics, physics, chemistry, biology, an engineering discipline, or data science.
- Hands-on individual-contributor experience performing technical work such as design, testing, analysis, research, or process work; candidates whose experience is solely managerial or teaching-focused are not the intended audience.
- Comfort with statistical and experimental reasoning, including experiment design, measurement error, uncertainty, and common statistical traps.
- Strong written communication and the ability to explain why a result is wrong, not only identify that it is wrong.
- Ability to work independently in a fully remote, self-directed environment.
- In-progress Bachelor's degree or higher.
- Hands-on familiarity with real data and field-specific materials such as instrument and test data, measurement files, simulation outputs, schematics, drawings, and professional analysis tools.
- Working understanding of adjacent sub-disciplines sufficient to assess work outside your primary specialty and identify what was done correctly or incorrectly.
- Full professional or native-level written and spoken English.
- General familiarity with AI and LLM tools and the ability to distinguish a well-reasoned answer from a plausible-sounding but incorrect one.
- Baseline technology literacy, including cloud file tools, browser profiles, desktop application installation, and everyday file handling.
- Availability for at least 10 hours per week; some projects prioritize 30–40 hours per week and full-time hours are available.
Benefits and Perks
- Fully remote, project-based work with flexible scheduling.
- Pay of $40-$125 per hour USD, paid via PayPal on a regular cadence.
- Minimum commitment of 10 hours per week, with no weekly maximum and full-time hours available.
- Multi-day task timers that allow work to be distributed across multiple days.
- Access to Claude and ChatGPT through the project; no personal subscription is required.
- Opportunities to work on challenging STEM, engineering, data science, and AI evaluation projects.
- Expert review, written feedback, onboarding, and a short training project for accepted contributors.
- Compensation for each completed step, subject to submission acceptance.
Skills
- Mathematics
- Physics
- Chemistry
- Biology
- Engineering
- Data science
- Coding
- Scientific computing
- Statistical reasoning
- Experimental reasoning
- Experiment design
- Measurement error and uncertainty
- Data analysis
- Design verification
- Test planning
- Failure investigation
- Design trade studies
- Experimental protocols
- Circuit design
- System design
- Technical reports
- Grading rubrics
- AI model evaluation
Education
Required
- In-progress Bachelor's degree or higher
Preferred
- Advanced degree
Certifications
Preferred
- PE license
- Chartered status
Selection process
Step 1
Submitted
Someone who fits the role and has told you they are interested, with their resume.
Step 2
HiringWiring Assessment
They take a short screening assessment.
Step 3
Client Assessemnts
Step 4
Selected
If they qualify and are selected, your payout is due.