Staff Software Engineer - Data Platform
Databricks · Bengaluru, India · Engineering - Pipeline · listed August 19, 2024
The shape of it
Seniority
Staff
Experience asked
4–10 years
Where
Not stated
Requirements listed
7
Length
668 words
In the posting’s own words
As a Staff Software Engineer working on the Data Platform team, you will leverage bleeding-edge AI developer tools and techniques to help build the Data Intelligence Platform for Databricks that will allow us to automate decision-making across the entire company. You will achieve this in collaboration with Databricks Product Teams, Data Science, and many more. You will define the future of a variety of tools spanning logging, orchestration, data transformation, metric store, governance platforms, and data consumption layers, just to name a few.
What it asks for · 7
- BS/MS/PhD in Computer Science or related majors, or equivalent experience.
- 10+ years of industry experience building and operating large-scale distributed systems.
- 4+ years of experience providing technical leadership on planet-scale production data systems
- Experience leading architecture efforts for performance-sensitive systems (e.g., latency-critical services, multi-tenant platforms, large-scale indexing pipelines).
- Strong communication skills and the ability to operate effectively in fast-paced, cross-functional environments.
- A strategic mindset with the ability to align engineering execution with longer-term product and company goals.
- Passion for mentoring and developing other engineers.
What the job covers
- Design and run the cross-company Data Intelligence Platform, which contains every business and product metric used to run Databricks. You’ll play a key role in developing the right balance of data protection and ease of shareability for the Data Intelligence Platform as we transition to a public company.
- Develop tooling and infrastructure to efficiently manage and run Databricks on Databricks at scale, across multiple clouds, geographies, and deployment types. This includes CI/CD processes, test frameworks for pipelines and data quality, and infrastructure-as-code tooling.
- Partner with our engineering teams to provide leadership in developing the long-term vision and requirements for the Databricks product.
- Build reliable data pipelines and solve data problems using Databricks, our partner’s products, and other OSS tools. Provide early feedback on the design and operations of these products.
- Represent Databricks at academic and industrial conferences & events.
Degree language
- BS/MS/PhD in Computer Science or related majors, or equivalent experience.
Tools and skills named
Data
- Databricks9×
- Data pipelines
Cloud & infra
- CI/CD
- Distributed systems
Ways of working
- Cross-functional
- Mentorship
Product & design
- User experience
Words the posting leans on
- data16×
- platform7×
- product6×
- experience4×
- data intelligence3×
- developing3×
- engineers3×
- infrastructure3×
- intelligence platform3×
- pipelines3×
- run3×
- systems3×
- tools3×
- build2×
- building2×
- business2×
Counted from the posting after the mission statement and the legal notices are set aside. The ones near the top are the ones a screener is looking for.
The posting, your resume, and the gaps between them. One click loads all three.