Staff Software Engineer - Streaming
Databricks · Seattle, Washington · Engineering - Pipeline · listed July 31, 2026
The shape of it
Seniority
Staff
Experience asked
8+ years
Where
Not stated
Stated pay
$182,400 – $247,000 USD
Requirements listed
6
Length
742 words
In the posting’s own words
We're seeking an experienced Staff Engineer to drive the technical direction of Spark Structured Streaming, spanning both open source and Databricks-specific components. Your mission is to make Spark Structured Streaming the state-of-the-art stream processing engine — adding advanced capabilities such as sophisticated state management and new operators, while re-imagining the engine's architecture to drive improvements for latency, throughput, and cost.
What it asks for · 6
- BS (or higher) in Computer Science or a related technical field, or equivalent practical experience
- 8+ years building related systems — big-data ecosystems, Apache Spark, or database internals
- A passion for database systems, storage systems, distributed systems, language design, or performance optimization
- Comfortable working toward a multi-year vision with incremental deliverables
- A track record of delivering features while maintaining a high bar for operational excellence and engineering quality
- Comfortable working cross-functionally with product management and directly with customers, with the ability to deeply understand the product and customer personas
What the job covers
- Set and drive the technical vision for Spark Structured Streaming across OSS and the Databricks Data Intelligence Platform
- Design and build core engine capabilities — state management, new operators, and architectural improvements to latency and throughput
- Raise the bar for engineering quality and operability, building software that is not just high quality but easy to run in production
- Make company-wide impact by driving stream processing adoption across the Databricks product portfolio
- Guide long-term architecture and technical-debt decisions, balancing them against the product roadmap
- Mentor and technically lead engineers on the team, and partner with the Engineering Manager to attract and grow top-tier talent
Degree language
- BS (or higher) in Computer Science or a related technical field, or equivalent practical experience
Tools and skills named
Data
- Spark8×
- Databricks5×
Product & design
- Product management
- Roadmap
Cloud & infra
- Distributed systems
Words the posting leans on
- data5×
- building4×
- customers4×
- product4×
- spark structured4×
- stream processing4×
- structured streaming4×
- systems4×
- drive3×
- engine3×
- technical3×
- apache spark2×
- architecture2×
- bar2×
- build2×
- capabilities2×
Counted from the posting after the mission statement and the legal notices are set aside. The ones near the top are the ones a screener is looking for.
The posting, your resume, and the gaps between them. One click loads all three.