Sr. Software Engineer - Ingestion Core team
Databricks · San Francisco, California · Engineering - Pipeline · listed September 16, 2026
The shape of it
Seniority
Senior
Experience asked
5+ years
Where
Not stated
Stated pay
$166,000 – $225,000 USD
Requirements listed
3
Length
754 words
In the posting’s own words
To enable all of this on Databricks, making data ingestion seamless is crucial. That’s the mission of the Ingestion Core Team: to make the ingestion of all data—structured and unstructured—simple, reliable, and efficient. Simplifying the complex is hard, and that’s where you come in. This role requires building distributed platform systems to incrementally ingest high-volume, petabyte-scale data from diverse sources—including cloud storage (SQS, ADLS, GCS), databases (Oracle, SQL Server, MySQL, Postgres), and file sources (Google Drive, SharePoint)—at high throughput and low cost. The data includes structured formats (JSON, Parquet, CSV) as well as unstructured data (text, images, docs, PPTs, and blobs), all of which land in Delta Lake with schema evolution and change data capture (CDC) capabilities.
What it asks for · 3
- 5+ years of experience writing production code in one of: Java, Scala, Go, C++, or Python.
- Experience with distributed systems, streaming, Spark, databases, data processing, or CDC.
- Experience building or operating systems where scale, throughput, latency, reliability, and cost are important considerations.
Tools and skills named
Data
- Databricks4×
- Spark2×
- Data warehouse
- Experimentation
- MySQL
- PostgreSQL
Languages
- SQL2×
- C++
- Go
- Java
- Python
- Scala
Models & research
- Machine learning3×
- Evaluations2×
Cloud & infra
- Distributed systems
- Observability
Words the posting leans on
- data13×
- distributed6×
- ingestion6×
- systems6×
- cost4×
- experience4×
- sources4×
- streaming4×
- throughput4×
- build3×
- building3×
- processing3×
- tools3×
- capabilities2×
- cdc2×
- data ingestion2×
Counted from the posting after the mission statement and the legal notices are set aside. The ones near the top are the ones a screener is looking for.
The posting, your resume, and the gaps between them. One click loads all three.