Research Scientist, AI Controls and Monitoring

The shape of it

In the posting’s own words

As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems. Building on this expertise, Scale Labs has launched a new team focused on policy research, to bridge the gap between AI research and global policymakers to make informed, scientific decisions about AI risks and capabilities.

What it asks for · 5

• A track record of published research in machine learning, particularly in generative AI.
• At least three years of experience addressing sophisticated ML problems, whether in a research setting or in product development.
• Experience with runtime monitoring, anomaly detection, or observability for ML systems.
• Familiarity with AI control or alignment research (e.g., scalable oversight, interpretability, debate).
• Experience with post-training and RL techniques such as RLHF, DPO, GRPO, and similar approaches.

Tools and skills named

Words the posting leans on

• research13×
• control7×
• monitoring6×
• systems6×
• experience5×
• capabilities4×
• risk4×
• industry3×
• methods3×
• oversight3×
• agent2×
• alignment2×
• collaborate2×
• design2×
• evaluation2×
• even2×

Counted from the posting after the mission statement and the legal notices are set aside. The ones near the top are the ones a screener is looking for.

More open at Scale AI

• AI Advisory ConsultantSan Francisco, CA; New York, NY
• AI Advisory PrincipalSan Francisco, CA; New York, NY
• AI Applications Ops Manager, GPSDoha, Qatar
• AI Builder InternSan Francisco, CA
• AI Infrastructure Engineer, Model Serving PlatformSan Francisco, CA; New York, NY
• AI Infrastructure Engineer, Sandbox PlatformSan Francisco, CA; Seattle, WA; New York, NY