AI reasoning & evaluation
Generative AI research for Meta · Contract
Active research · Annotation repair is early-stage
Reasoning quality and the data used to judge it
How can we distinguish a model’s reasoning error from a flaw in the task, rubric, or reference solution?
- My contribution
- I evaluate mathematical and STEM reasoning, partner with researchers on research questions and vendor strategy, and lead early-stage work on annotated-dataset quality within a four-person leadership group advising three vendors.
Methods & approach
Proof checking, prompt and rubric review, reference-solution validation, and analysis of annotation workflows.
Questions I’m investigating
- Distinguishing an incorrect argument from a valid alternative solution.
- Diagnosing and repairing annotation issues while preserving task intent and identifying when human review is needed.