The capabilities of current AI systems are evolving at a rapid pace. While these advancements offer tremendous opportunities, they also present significant risks, such as the potential for deliberate misuse or the deployment of sophisticated yet misaligned models. At Apollo Research, our primary concern lies with deceptive alignment, a phenomenon where a model appears to be aligned but is, in fact, misaligned and capable of evading human oversight.
Our approach focuses on behavioral model evaluations, which we then use to audit real-world models. We also combine black-box approaches with applied interpretability. In our evaluations, we focus on LM agents, i.e. LLMs with agentic scaffolding similar to AIDE or SWE agent. We also study model organisms in controlled environments (see our security policies), e.g. to better understand capabilities related to scheming.
At Apollo, we aim for a culture that emphasizes truth-seeking, being goal-oriented, giving and receiving constructive feedback, and being friendly and helpful. If you’re interested in more details about what it’s like working at Apollo, you can find more information here.
About the Team
The current evals team consists of Mikita Balesni, Jérémy Scheurer, Alex Meinke, Rusheb Shah, Bronson Schoen, and Axel Højmark. Marius Hobbhahn manages and advises the evals team, though team members lead individual projects. You will mostly work with the evals team, but you will likely sometimes interact with the interpretability team, e.g. for white-box evaluations, and with the governance team to translate technical knowledge into concrete recommendations. You can find our full team here.
About the Role
We’re looking for research scientists, research engineers, and software engineers who are excited to work on these and similar projects. We intend to hire people with a broad range of experience and encourage applications even if you don’t yet have experience in any of our current team efforts. We welcome applicants of all ethnicities, genders, sexes, ages, abilities, religions, sexual orientations, regardless of pregnancy or maternity, marital status, or gender reassignment.
Evals Team Work
The evals team focuses on the following efforts:
* Conceptual work on safety cases for scheming, for example, our work on evaluation-based safety cases for scheming
* Building evaluations for scheming-related properties, such as situational awareness or deceptive reasoning.
* Conducting evaluations on frontier models and publishing the results either to the general public or a target audience such as AI developers or governments, for example, our work in OpenAI’s o1-preview system card.
* Creating model organisms and demonstrations of behavior related to deceptive alignment, e.g. exploring the influence of goal-directedness on scheming.
* Applied interpretability work that directly informs our evaluations, e.g. Detecting Strategic Deception Using Linear Probes.
* Designing and evaluating AI control protocols. We have not started these efforts yet but intend to work on them starting Q2 2025.
* Building a high-quality software stack to support all of these efforts. We have recently switched to Inspect as our primary evals framework.
Candidate characteristic in strong candidates
For all skills, we don’t require a formal background or industry experience and welcome self-taught candidates.
* Large Language Model (LLM) steering: The core skill of our evals research scientist role is steering LLMs. This can take many different forms, such as:
* Prompting: eliciting specific behavior through clever word choice.
* LM agents & scaffolding: chaining inputs and outputs from various models in a structured way, making them more goal-directed and agentic.
* Fluent LLM usage: With increasing capabilities, we can use LLMs to speed up all parts of our pipeline. We welcome candidates who have integrated LLMs into their workflow.
* Supervised fine-tuning: creating datasets and then fine-tuning models to improve a specific capability or to study aspects of learning/generalization.
* RL(HF/AIF): using other models, programmatic reward functions, or custom reward models as a source of feedback for fine-tuning an existing LLM.
* Software engineering: Model evaluators benefit from a solid foundation in software engineering. This can include developing APIs (ideally around LLMs or eval tasks), data science, system design, data engineering, and front-end development.
* Generalist: Most evals tasks require a wide range of skills ranging from LLM fine-tuning to developing frontend labeling interfaces. Therefore, we're seeking individuals with diverse skill sets, a readiness to acquire new skills rapidly, and a strong focus on results.
* Empirical Research Experience: We’re looking for candidates with prior empirical research experience. This includes the design and execution of experiments as well as writing up and communicating these findings. Optimally, the research included working with LLMs. This experience can come from academia, industry, or independent research.
* Scientific mindset: We think it is easy to overinterpret evals results and, thus, think a core skill of a good evals engineer or scientist is to keep track of potential alternative explanations for findings. Ideally, any candidate should be able to propose and test these alternative hypotheses in new experiments.
* Values: We’re looking for team members who thrive in a collaborative environment and are results-oriented. You can find out more about our culture here.
* Additionally, “nice to have” skills include experience related to AI control and cyber security.
* Depending on your preferred role, we will weigh these characteristics differently, e.g. software engineers don’t have to have research experience, but must have strong software engineering skills.
We want to emphasize that people who feel they don’t fulfill all of these characteristics but think they would be a good fit for the position nonetheless are strongly encouraged to apply. We believe that excellent candidates can come from a variety of backgrounds and are excited to give you opportunities to shine.
Core Skills: Artificial Intelligence, Machine LearningOther Skills: APIs, Data Architecture, Software Architecture, Cyber SecuritySeniority: Junior, Mid, Senior #J-18808-Ljbffr