Senior / Staff Machine Learning Research Scientist, Agents
Scale AI · San Francisco, CA; Seattle, WA; New York, NY · Research · listed October 25, 2024
The shape of it
Seniority
Staff
Where
Not stated
Stated pay
$218,400 – $273,000 USD
Requirements listed
7
Length
977 words
In the posting’s own words
This role is at the intersection of cutting-edge AI research and practical application, with a focus on studying the data types essential for building state-of-the-art agents, such as browser and SWE agents. The ideal candidate will explore the data landscape needed to advance intelligent, adaptable AI agents, guiding the data strategy at Scale to drive innovation. This position requires not only expertise in LLM agents and planning algorithms but also creativity in addressing novel challenges related to data, interaction, and evaluation. You will contribute to impactful research publications on agents, collaborate with customer researchers, and work alongside the engineering team to translate these advancements into real-world, scalable solutions.
What it asks for · 7
- Practical experience working with LLMs, with proficiency in frameworks like Pytorch, Jax, or Tensorflow. You should also be adept at interpreting research literature and quickly turning new ideas into prototypes.
- A track record of published research in top ML venues (e.g., ACL, EMNLP, NAACL, NeurIPS, ICML, ICLR, COLM, etc.)
- At least three years of experience addressing sophisticated ML problems, either in a research setting or product development.
- Strong written and verbal communication skills and the ability to operate cross-functionally.
- Hands-on experience with open source LLM fine-tuning or involvement in bespoke LLM fine-tuning projects using Pytorch/Jax.
- Hands-on experience with agent frameworks such as OpenHands, Swarm, LangGraph, etc.
- Familiarity with agentic reasoning methods such as STaR and PLANSEARCH
Also a plus
- Hands-on experience with open source LLM fine-tuning or involvement in bespoke LLM fine-tuning projects using Pytorch/Jax.
- Hands-on experience and publications in building applications and evaluations related to AI agents such as tool-use, text2SQL, browser agents, coding agents and GUI agents.
- Hands-on experience with agent frameworks such as OpenHands, Swarm, LangGraph, etc.
- Familiarity with agentic reasoning methods such as STaR and PLANSEARCH
- Experience working with cloud technology stack (eg. AWS or GCP) and developing machine learning models in a cloud environment.
Tools and skills named
Models & research
- LLM4×
- Machine learning4×
- Fine-tuning2×
- JAX2×
- PyTorch2×
- Evaluations
- TensorFlow
Cloud & infra
- AWS
- GCP
Product & design
- Prototyping
Words the posting leans on
- agents10×
- research7×
- experience6×
- data4×
- llm4×
- hands-on experience3×
- practical3×
- addressing2×
- browser2×
- building2×
- cloud2×
- evaluation2×
- frameworks2×
- llm fine-tuning2×
- publications2×
- related2×
Counted from the posting after the mission statement and the legal notices are set aside. The ones near the top are the ones a screener is looking for.
The posting, your resume, and the gaps between them. One click loads all three.
More open at Scale AI
- AI Advisory ConsultantSan Francisco, CA; New York, NY
- AI Advisory PrincipalSan Francisco, CA; New York, NY
- AI Applications Ops Manager, GPSDoha, Qatar
- AI Builder InternSan Francisco, CA
- AI Infrastructure Engineer, Model Serving PlatformSan Francisco, CA; New York, NY
- AI Infrastructure Engineer, Sandbox PlatformSan Francisco, CA; Seattle, WA; New York, NY