Back To Jobs New Product Designer, Evals & Prompts

September 9, 2026

Hybrid

Senior

San Francisco

Important before applying

This job has conditions that may affect your decision to apply

Mandatory office attendance

Description

Anthropic builds reliable, interpretable and steerable AI systems. The New Product Designer, Evals & Prompts will design prompts and evaluation tools that keep model behavior aligned with product strategy, safety requirements and user expectations.

Responsibilities

Write and revise prompts for Claude’s tools, features and behaviors
Build graders that automate prompt fixes and rerun evaluations
Create visual low‑code evaluation tools usable without engineers
Monitor designers using the tools and simplify their workflow
Support model releases by testing surfaces and writing prompt migrations
Stand up and scale the eval harness across dozens of tools
Package unevaluable prompts into training data for model improvement

Requirements

Production‑quality Python programming experience
Experience building evaluation pipelines for large language model products
Experience creating internal low‑code tools for non‑engineers
Experience standing up test harnesses and sandboxing tool calls
Experience shipping prompts and understanding model‑specific behavior

Conditions

Hybrid work model with at least 25 % office attendance
Flexible working hours
Competitive salary with equity‑matching donations
Generous vacation and parental leave

PythonLLMEvalai

This device does not meet the site requirements

What may not work

Back To Jobs New Product Designer, Evals & Prompts

Job summary

Score

Description

Responsibilities

Requirements

Conditions

Similar jobs

Job summary

Score

Similar jobs

Back To Jobs New Product Designer, Evals & Prompts

Job summaryAnalysis and summary of the description [data-chart=chart-_R_b5s5eav5ubsqiuialb_] { --color-score: var(--warning); } .dark [data-chart=chart-_R_b5s5eav5ubsqiuialb_] { --color-score: var(--warning); } 52ScoreAverage

Job summary

Score

Description

Responsibilities

Requirements

Conditions

Similar jobs

Job summaryAnalysis and summary of the description [data-chart=chart-_R_b5s5eav5ubsqiuialb_] { --color-score: var(--warning); } .dark [data-chart=chart-_R_b5s5eav5ubsqiuialb_] { --color-score: var(--warning); } 52ScoreAverage

Job summary

Score

Similar jobs