At a glance
- Employment
- Internship
- Workplace
- Onsite
- Location
- San Francisco
About Mercor
- Mercor's mission is to organize human intelligence to power the AI economy. We're a leading AI data company, building the layer between human expertise and frontier models. Millions of domain experts on the platform are paid over $4 million per day to train frontier AI models. Mercor's APEX benchmark family measures AI's real-world impact on professional work. Mercor Enterprise brings this same infrastructure to Fortune 500 companies: helping companies capture how their best people actually work, translating that expertise directly back into agents.
- Mercor is creating a new category of work where expertise powers AI advancement. Achieving this requires an ambitious, fast-paced and deeply committed team. You’ll work alongside researchers, operators, and AI companies at the forefront of shaping the systems that are redefining society. Mercor is a profitable Series C company valued at $10 billion. We work in-person five days a week in our San Francisco, NYC, or London offices.
About the role
- The Research Scientist Intern will work at the frontier of post-training, reinforcement learning with verifiable rewards (RLVR), data generation, and model evaluation.
- The role involves investigating how datasets, rewards, and training methods influence the capabilities and behavior of large language models.
- Interns will collaborate with research scientists and engineers to turn open-ended questions into rigorous experiments that contribute to Mercor's research agenda.
Responsibilities
- Develop and investigate research questions related to post-training, RLVR, data quality, and model evaluation.
- Design and run controlled experiments to understand how datasets, rewards, and training strategies affect model performance.
- Study reward-shaping and post-training methods, including approaches such as GRPO and DAPO.
- Develop methods for measuring data quality, usability, and performance uplift on key benchmarks.
- Design and evaluate datasets, rubrics, evaluators, and scoring frameworks for complex model capabilities.
- Conduct systematic error analysis to identify model failure modes and opportunities for improvement.
- Analyze experimental results and communicate findings through clear reports, research artifacts, and presentations.
- Build the research tooling and data pipelines needed to conduct experiments at scale.
- Collaborate with research scientists, research engineers, applied AI teams, and domain experts.
- Contribute to research publications, benchmark releases, and other public research outputs.
Requirements
- Currently pursuing a master’s or PhD in computer science, machine learning, statistics, mathematics, or another relevant field.
- Demonstrated ability to formulate research questions, design experiments, and draw sound conclusions from empirical results.
- Demonstrated experience in training, fine-tuning, or evaluating language models, agentic AI systems, RL environments, or developing benchmarks.
- At least one publication or open source project.
- Strong programming skills, particularly in Python.
- Familiarity with machine learning fundamentals, experimental design, and statistical analysis.
- Intellectual curiosity.
- Comfort operating in a fast-paced research environment with rapid iteration and a high degree of ownership.
Preferred qualifications
- Previous research experience in language models, reinforcement learning, model evaluation, or post-training.
- Experience training, fine-tuning, or evaluating language models.
- Familiarity with RLVR techniques, reward modeling, or agentic AI systems.
- Experience developing benchmarks, evaluation methodologies, or data-quality measures.
- Research publications or submissions at competitive CS conferences such as ACL, NeurIPS, ICML, ICLR, or EMNLP.
- Research papers, technical reports, open-source projects, or other work samples demonstrating relevant skills.
Benefits
- Mentorship from experienced researchers.
- $1.5K monthly stipend for meals
- $200 monthly laundry reimbursement
- $200 monthly personal wellness reimbursement
- Free Equinox membership
- Team events and offsites.
- Potential full-time return offer.
Skills
- Python
- Reinforcement Learning
- RLVR
- GRPO
- DAPO
- Large Language Models
- Machine Learning
- Statistical Analysis
- Experimental Design