Distinguished Architect, AI
Datadog · New York, New York, USA; San Francisco, California, USA · Product Solutions Architecture · listed May 29, 2026
The shape of it
Seniority
Principal
Experience asked
10+ years
Where
Hybrid
Stated pay
$330,000 – $440,000 USD
Requirements listed
8
Length
895 words
In the posting’s own words
At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.
What it asks for · 8
- Industry Experience: 10+ years of experience with at-scale distributed systems architecture, high-performance computing, or large-scale infrastructure. Deep familiarity with the AI/LLM ecosystem, accelerator hardware (GPUs/TPUs), and modern orchestration frameworks.
- Strategic Thinker : Able to think long term and creatively about a wide variety of technical and business challenges
- Stakeholder Management : Proven experience interacting with and influencing elite individual contributors, research scientists, and technical founders in flat, rapid-growth environments.
- Technologist : A true close-to-the-metal technologist who maintains deep hands-on credibility and can white-board architectural solutions seamlessly with senior engineers. Strong understanding of best practices and real world challenges AI/LLM Ops and LLM Observability (LLMO).
- Presenter : Excellent customer-facing presentation skills for large audiences, comfortable discussing complex technical details as well as with briefing executives or non-technical personas.
- Communicator : Excellent verbal and written communication skills, ability to link product functionality to business objectives, value realization and ROI.
- Travel : Able to travel via auto, train or air up to 50% of the time
- Education : Bachelor’s degree in engineering or related field, Master’s degree preferred
What the job covers
- Leadership : Demonstrate thought leadership in the AI/LLM space. Influence key decision makers and stakeholders by connecting technical capabilities to organizational and business impact.
- Advisory : Strategically partner with highly technical Founders, Heads of Infrastructure, and Research Lead peers. Guide them on best practices and emerging industry trends in the AI/LLM space. Lead high-level technical and architectural conversations around AI adoption.
- Presentations : Lead deep-dive architecture reviews and design engagements with customer teams and their leaders to share industry trends, best practices, and demonstrate how Datadog can support high-throughput hyper scale AI workloads.
- GTM : Identify emerging AI-native technology shifts and feed them directly back to Datadog Product Management. Co-create custom observability integrations and solutions alongside Product SAs to keep Datadog at the absolute forefront of the AI stack.
- Collaboration : Collaborate with Product Solutions Architecture (PSA), Sales, Sales Engineering and Marketing in providing high-quality technical resources to a broad audience of practitioners and economic buyers.
- Hiring : Assist leadership in recruiting and hiring of top talent for the Product Solutions Architecture and Field CTO teams.
Degree language
- Education : Bachelor’s degree in engineering or related field, Master’s degree preferred
Tools and skills named
Cloud & infra
- Datadog7×
- Observability3×
- Distributed systems
Models & research
- LLM5×
- GPU
Go to market
- Solutions architecture3×
- Go-to-market
Operations & finance
- Recruiting
- Stakeholder management
Product & design
- Product management
- Roadmap
Words the posting leans on
- technical10×
- product6×
- solutions6×
- ai/llm4×
- business3×
- challenges3×
- experience3×
- infrastructure3×
- lead3×
- leadership3×
- observability3×
- practices3×
- product solutions3×
- skills3×
- solutions architecture3×
- technology3×
Counted from the posting after the mission statement and the legal notices are set aside. The ones near the top are the ones a screener is looking for.
The posting, your resume, and the gaps between them. One click loads all three.
More open at Datadog
- AI Research Engineer - Datadog AI Research (DAIR)Paris, France
- AI Research Scientist - Datadog AI Research (DAIR)New York, New York, USA
- AI Research Scientist - Datadog AI Research (DAIR)Paris, France
- Area Vice President, Sales EngineeringBoston, Massachusetts, USA; Denver, Colorado, USA; New York, New York, USA; San Francisco, California, USA
- Associate Field Marketing Manager (US East and Canada)New York, New York, USA
- Associate Growth Marketing ManagerNew York, New York, USA; San Francisco, California, USA