About the role
About the Role We're looking for a Physics Specialist to contribute deep scientific expertise to AI model evaluation. You'll craft and assess challenging physics problems, probe model reasoning at the frontier, and help identify where models fail under rigorous scientific scrutiny. What You'll Do Develop and evaluate high-difficulty physics prompts spanning classical mechanics, quantum mechanics, electromagnetism, thermodynamics, and related areas Use adversarial prompting techniques to expose errors in model reasoning and problem-solving Provide expert critique of AI-generated responses, assessing both correctness and depth Work closely with project leads to uphold quality benchmarks What We're Looking For PhD in Physics or a closely related field Graduate-level expertise across multiple areas of physics Permanently based in the US Prior hands-on experience in AI data annotation or RLHF Excellent written communication and analytical skills Extra Credit Publications in peer-reviewed chemistry or physics journals. Experience with adversarial prompting, model evaluation, or AI red teaming strongly preferred Teaching, tutoring, or curriculum development experience in physical chemistry or theoretical sciences. Experience with computational chemistry tools (e.g., Gaussian, ORCA, MATLAB). Background in scientific annotation or technical quality assurance. Additional Information Location: Fully remote (no visa sponsorship available) Schedule: Flexible hours — contribute as much or as little as you’d like each week. (No minimum hours per week, capped at 40hrs/week.)