Frontier Engagements Lead -- AI Research & Model Evaluations
Job Description
Job DescriptionAbout the Opportunity
We are partnering with a rapidly growing, well-funded AI company at the forefront of advancing large language models (LLMs) and autonomous AI agents.
The company develops sophisticated datasets, evaluation methodologies, and data infrastructure that help leading AI research laboratories improve model reasoning, behavior, and performance.
We are seeking a Frontier Engagements Lead to join a newly established, research-focused commercial function. This is a unique opportunity for an AI researcher or technical specialist who wants to expand their influence beyond a single model or research organization.
Rather than focusing exclusively on internal research, you'll help shape how leading AI laboratories think about model quality, evaluations, and the data required to build more capable AI systems.
This is not a traditional sales position. It is a research-driven role requiring deep technical expertise, intellectual curiosity, exceptional communication skills, and the ability to translate complex research into actionable recommendations.
What You'll Do
- Evaluate AI Model Behavior: Develop informed, research-backed perspectives on what makes LLMs and AI agents effective across different applications, users, and environments.
- Analyze Model Performance: Investigate model strengths, weaknesses, failure modes, reasoning capabilities, and answer quality across personal assistants, enterprise agents, and general-purpose chatbots.
- Develop Research-Driven Proposals: Translate technical insights into compelling proposals, analyses, presentations, and supporting materials for researchers at leading AI laboratories.
- Collaborate with Technical and Commercial Teams: Work closely with internal stakeholders to identify research opportunities, understand customer challenges, and develop solutions grounded in model evaluation and data quality.
- Engage Frontier AI Researchers: Progressively participate in technical discussions with researchers, helping establish the organization as a trusted research partner rather than simply a data provider.
- Influence AI Development: Contribute perspectives and recommendations that can inform model evaluation, training data strategies, and improvements across multiple frontier AI organizations.
- Build a New Function: Help establish research methodologies, technical communication standards, and scalable processes within a newly formed team.
What We're Looking ForRequired Qualifications
- Professional experience at a frontier AI laboratory, emerging AI research organization, or company specializing in AI evaluations, datasets, or model development.
- At least one year of hands-on experience studying model behavior, interpretability, post-training, LLM evaluations, or answer quality. Exceptional candidates with shorter, highly relevant frontier AI experience will also be considered.
- Demonstrated ability to investigate how and why AI models succeed or fail across different tasks and user scenarios.
- Strong technical foundation in machine learning, large language models, and experimental evaluation methodologies.
- Proficiency in Python and experience working with ML research or evaluation tools.
- Exceptional written communication skills, including the ability to translate sophisticated technical findings into clear, persuasive research proposals.
- Strong presentation and interpersonal skills, with the confidence to discuss complex technical concepts with experienced AI researchers.
- Independent, well-reasoned perspectives on model quality, reliability, usefulness, and performance.
- Ability to work onsite in San Francisco five days per week.
Preferred Qualifications
- Experience contributing to AI benchmarks, evaluation frameworks, datasets, or model assessment projects.
- Hands-on experience with model interpretability, alignment, reinforcement learning, reward modeling, or post-training methodologies.
- Experience evaluating agentic systems, complex reasoning capabilities, or model performance across different user populations.
- Familiarity with human annotation programs, expert evaluation pipelines, or data quality initiatives.
- Experience with AI-assisted development tools such as Claude Code or Codex.
- A degree in Computer Science, Machine Learning, Statistics, Mathematics, Economics, Data Analytics, or a related technical discipline. Equivalent hands-on experience will also be considered.
- Demonstrated experience communicating technical research findings to audiences outside an immediate research team.
Who Will Thrive in This Role
You may be an excellent fit if you:
- Have strong opinions about what makes an AI model genuinely useful, reliable, or effective—and can explain why.
- Enjoy investigating model behavior and developing creative ways to measure performance.
- Are equally comfortable conducting technical analysis and communicating its implications to others.
- Want your research perspectives to influence multiple leading AI laboratories rather than a single organization's models.
- Thrive in fast-moving environments with significant autonomy and ownership.
- Are excited about helping build a new function from the ground up.
- Enjoy collaborating with talented researchers, engineers, and commercial teams to solve difficult technical problems.
Why Join?
Influence the Future of AI
Contribute to research conversations and evaluation strategies that can influence how multiple frontier AI laboratories develop and improve their models.
Collaborate with Leading AI Researchers
Gain exposure to diverse perspectives on model behavior, reasoning, evaluations, and data from some of the most advanced AI research organizations.
Combine Research with Strategic Impact
Apply your technical expertise beyond traditional research settings, helping transform sophisticated findings into meaningful partnerships and real-world AI improvements.
Build Something from the Ground Up
Join a newly established function with meaningful ownership, autonomy, and opportunities to help shape its long-term direction.
Join a High-Growth AI Organization
Work alongside a highly technical, ambitious team developing infrastructure and datasets that support the next generation of AI systems.
#hc273516
