Staff Software Engineer, Foundational Model Serving
Databricks · San Francisco, California · Engineering · listed October 23, 2025
The shape of it
Seniority
Staff
Experience asked
10+ years
Where
Not stated
Stated pay
$192,000 – $260,000 USD
Requirements listed
6
Length
809 words
In the posting’s own words
Foundation Model Serving is the API Product for hosting and serving frontier AI model inference for open source models like Llama, Qwen, and GPT OSS as well as proprietary models like Claude and OpenAI GPT. For this role, no prior ML or AI experience is necessary. We’re looking for engineers who have owned high scale operational sensitive systems like customer facing APIs, Edge Gateways, ML Inference, or similar services and have an interest in getting deep building LLM APIs and runtimes at scale.
What it asks for · 6
- 10+ years of experience building and operating large-scale distributed systems.
- Experience leading high-scale operationally sensitive backend systems.
- A track record of up-leveling teams engineering excellence.
- Proven ability to deliver technically complex, high-impact initiatives that create measurable customer or business value.
- Strong communication skills and ability to collaborate across teams in fast-moving environments.
- Strategic and product-oriented mindset with the ability to align technical execution with long-term vision.
Tools and skills named
Models & research
- Inference3×
- GPU2×
- Machine learning2×
- LLM
Data
- Databricks3×
Ways of working
- Mentorship
- Testing
Cloud & infra
- Distributed systems
Product & design
- Roadmap
Words the posting leans on
- systems9×
- model7×
- serving7×
- product6×
- technical5×
- customer4×
- data4×
- design4×
- engineers4×
- experience4×
- infrastructure4×
- operational4×
- platform4×
- apis3×
- building3×
- collaborate3×
Counted from the posting after the mission statement and the legal notices are set aside. The ones near the top are the ones a screener is looking for.
The posting, your resume, and the gaps between them. One click loads all three.