Quality Lead, Gen AI

The shape of it

In the posting’s own words

As a Quality Control Lead, you’ll own that call for some of our highest-impact Generative AI programs. You'll lead a large team of quality control specialists to measure and improve quality across these programs, from multilingual post-training data to agentic RL environments. You will work on frontier-level problems – the programs you work on train the models people are talking about.

What it asks for · 6

• A Bachelor’s degree in Computer Science, Engineering, Operations, or a related field.
• Experience building systems, processes, and teams across multiple customer segments or product lines.
• Master’s degree in Computer Science, Engineering, Operations, or a related field.
• Experience in AI/ML services, data annotation or model evaluation.
• Experience in a fast-growing, less-structured startup environment.
• Experience building teams from the ground up.

Also a plus

• Master’s degree in Computer Science, Engineering, Operations, or a related field.
• Experience in AI/ML services, data annotation or model evaluation.
• Experience in a fast-growing, less-structured startup environment.
• Experience building teams from the ground up.

What the job covers

• Lead and grow a team of quality specialists - hire, coach and calibrate this team of specialists.
• Turn unclear customer requirements into clear standards - work with delivery teams to interpret and improve customer requirements, and then turn that into measurable signals of data quality.
• Run the quality system. Own the daily operation: plan and allocate workforce capacity, produce quality reporting, measure productivity and efficiency, and drive quality control policies.
• Analyzing quality trends. Identify, root-cause, and elevate defect patterns that delivery teams can take action on.
• Build the future of QC. Our team already leverages agentic capabilities, but you will help decide and lead what gets built next to continue to scale and optimize our quality operations.

Degree language

• A Bachelor’s degree in Computer Science, Engineering, Operations, or a related field.
• Master’s degree in Computer Science, Engineering, Operations, or a related field.

Tools and skills named

Words the posting leans on

• quality13×
• operations6×
• data5×
• experience5×
• programs5×
• customer4×
• lead4×
• management4×
• quality control4×
• delivery3×
• leading3×
• specialists3×
• agentic2×
• computer science2×
• customer requirements2×
• degree computer2×

Counted from the posting after the mission statement and the legal notices are set aside. The ones near the top are the ones a screener is looking for.

More open at Scale AI

• Account Based Marketing LeadSan Francisco, CA; New York, NY
• AI Advisory PrincipalSan Francisco, CA; New York, NY
• AI Product Manager (Coding/Multimodal)San Francisco, CA
• Contracts ManagerWashington, DC
• Contributor Experience Manager, CommunitySan Francisco, CA; New York, NY
• Creative Advisor - Human Frontier CollectiveUnited States