Senior Software Engineer - Infrastructure and Tools
Databricks · San Francisco, California · Engineering - Pipeline · listed August 10, 2022
The shape of it
Seniority
Senior
Experience asked
5+ years
Where
Not stated
Stated pay
$166,000 – $225,000 USD
Requirements listed
6
Length
787 words
In the posting’s own words
As a Senior Software Engineer on the Infrastructure teams, you will build scalable systems to power the Databricks platform, making it the de-facto platform for running Big Data and AI workloads. You will build and extend the Databricks infrastructure platform, which includes multi-cloud systems and services for managing thousands of Kubernetes clusters at scale, storing petabytes of data, highly scalable and distributed API gateways, rate limiting framework, network security and encryption, developer tools and infrastructure (we use Bazel), testing frameworks, and scalable CI/CD framework among many others.
What it asks for · 6
- BS (or higher) in Computer Science, or a related field
- 5+ years of experience writing production code in one of: Java, Scala, Go, C++ or Python
- Passion for building highly scalable and reliable infrastructure
- Experience architecting, developing and deploying large-scale distributed systems at scale
- Experience with cloud APIs (e.g., a public cloud such as AWS, Azure, GCP or an advanced private cloud such as Google, Facebook)
- Experience with cloud technologies, e.g. AWS, Azure, GCP, Docker, Kubernetes, or Terraform.
What the job covers
- Build and extend components of the core Databricks infrastructure
- Architect multi-cloud systems and abstractions to allow the Databricks product to run on top of existing Cloud providers
- Improve software development workflows for engineering and operational efficiency.
- Use our own data and AI platform (yes!) to analyze build and test logs and metrics to identify areas for improvement.
- Develop automated build, test, and release infrastructures.
- Set and uphold the standard for engineering processes to support high-quality engineering, including style and code checking, test harnesses, and release packaging.
Degree language
- BS (or higher) in Computer Science, or a related field
Tools and skills named
Cloud & infra
- AWS2×
- Azure2×
- GCP2×
- Distributed systems
- Docker
- Kubernetes
- Terraform
Languages
- C++
- Go
- Java
- Python
- Scala
Data
- Databricks2×
Words the posting leans on
- cloud5×
- experience4×
- build3×
- engineering3×
- infrastructure3×
- test3×
- aws azure2×
- azure gcp2×
- code2×
- e.g2×
- release2×
- systems2×
Counted from the posting after the mission statement and the legal notices are set aside. The ones near the top are the ones a screener is looking for.
The posting, your resume, and the gaps between them. One click loads all three.