Staff Backend Software Engineer

The shape of it

In the posting’s own words

As part of the Unity AI Gateway team, you'll build the control plane that every AI request at Databricks passes through: partner and self-hosted models, agents, coding assistants, and MCP servers. It enforces budgets, routes each request to the right model, and applies guardrails inline. Unity AI Gateway is one of our fastest-growing businesses, moving trillions of tokens per week for thousands of customers.

What it asks for · 5

• 8+ years of experience in backend or infrastructure engineering
• Strong programming skills in Scala, or Go
• Experience with distributed systems, high-throughput APIs, or cloud-native infrastructure
• Familiarity with service-oriented architecture, deployment pipelines, and system observability
• Strong product and ownership mindset. You care about building the right solution, not just any solution

Also a plus

• Experience with real-time serving, AI infrastructure, or GPU orchestration
• Exposure to platforms like Bedrock, Vertex AI, or Azure ML
• Experience building developer platforms or internal tools supporting AI workflows

What the job covers

• Build the routing layer that picks the right model for each request across quality, cost, latency, availability, and remaining budget
• Improve reliability, latency, and efficiency of distributed AI workloads
• Collaborate with research, platform, infra, and AI/ML teams to deliver seamless end-to-end experiences
• Shape how developers and data scientists build and interact with AI on Databricks

Tools and skills named

Words the posting leans on

• data5×
• experience5×
• infrastructure5×
• platform4×
• build3×
• building3×
• customers3×
• request3×
• budget2×
• developer2×
• distributed2×
• every2×
• improve2×
• latency2×
• right model2×
• solution2×

Counted from the posting after the mission statement and the legal notices are set aside. The ones near the top are the ones a screener is looking for.

More open at Databricks

• デリバリーソリューションアーキテクトTokyo, Japan
• Account ExecutiveBengaluru, India; Mumbai, India
• Account Executive, Commercial - HunterTokyo, Japan
• Account Executive - SingaporeSingapore
• Accounting Data & Technology ManagerMountain View, California; San Francisco, California
• Accounting Manager, Accounts ReceivableCalifornia; New York; Remote - Colorado; Remote - Georgia; Remote - Ohio; Remote - Oregon; Remote - Pennsylvania; Remote - Texas; Remote - Washington; Remote - Washington D.C.