Voice AI Evaluation Trainee

September 16, 2026

Office

Intern

Barcelona, Spain

Important before applying

This job has conditions that may affect your decision to apply

Office-only work

Description

HeyDiga builds conversational AI agents that handle phone and WhatsApp calls for businesses in Spain, Italy and France. The product, SONIA, operates as a virtual employee, managing appointments, answering questions and ensuring no call is missed. The team seeks a trainee to evaluate the voice AI pipeline, turn real conversations into data, metrics and actionable improvements.

Responsibilities

Perform error analysis across ASR, LLM reasoning and TTS layers
Create and annotate evaluation datasets from real customer conversations
Define and compute conversational quality metrics such as task success rate and WER
Conduct linguistic red‑team testing by interacting with the agent in target languages
Evaluate pronunciation and lexical accuracy for names, brands and addresses
Develop LLM‑as‑judge automatic evaluators and calibrate them against human annotations
Provide feedback to the ML team to prioritize and verify model improvements

Requirements

Native level Spanish proficiency or real C1 level
Native proficiency in at least one of Italian, French or Portuguese
Basic understanding of LLM‑based systems and prompt engineering
Familiarity with Python, pandas, notebooks and basic SQL
Excellent auditory discrimination to detect subtle pronunciation issues
Rigorous approach to annotation and documentation of errors
Availability to work on‑site in Barcelona for the internship duration

Conditions

Paid internship with stipend
On‑site work required in Barcelona
Full‑time commitment with 2‑3 available positions
No remote work option

Similar jobs

Picked by AI from the meaning of the description, not keywords

This device does not meet the site requirements

What may not work

Voice AI Evaluation Trainee

Job summary

Score

Description

Responsibilities

Requirements

Conditions

Similar jobs

Job summary

Score

Similar jobs

Voice AI Evaluation Trainee

Job summaryAnalysis and summary of the description [data-chart=chart-_R_b5s5eav5ubsqiuialb_] { --color-score: var(--destructive); } .dark [data-chart=chart-_R_b5s5eav5ubsqiuialb_] { --color-score: var(--destructive); } 42ScoreNeeds review

Job summary

Score

Description

Responsibilities

Requirements

Conditions

Similar jobs

Job summaryAnalysis and summary of the description [data-chart=chart-_R_b5s5eav5ubsqiuialb_] { --color-score: var(--destructive); } .dark [data-chart=chart-_R_b5s5eav5ubsqiuialb_] { --color-score: var(--destructive); } 42ScoreNeeds review

Job summary

Score

Similar jobs