У вакансии есть условия, которые могут повлиять на решение об отклике
Работа только из офиса
Описание
HeyDiga builds conversational AI agents that handle phone and WhatsApp calls for businesses in Spain, Italy and France. The product, SONIA, operates as a virtual employee, managing appointments, answering questions and ensuring no call is missed. The team seeks a trainee to evaluate the voice AI pipeline, turn real conversations into data, metrics and actionable improvements.
Обязанности
Perform error analysis across ASR, LLM reasoning and TTS layers
Create and annotate evaluation datasets from real customer conversations
Define and compute conversational quality metrics such as task success rate and WER
Conduct linguistic red‑team testing by interacting with the agent in target languages
Evaluate pronunciation and lexical accuracy for names, brands and addresses
Develop LLM‑as‑judge automatic evaluators and calibrate them against human annotations
Provide feedback to the ML team to prioritize and verify model improvements
Требования
Native level Spanish proficiency or real C1 level
Native proficiency in at least one of Italian, French or Portuguese
Basic understanding of LLM‑based systems and prompt engineering
Familiarity with Python, pandas, notebooks and basic SQL
Excellent auditory discrimination to detect subtle pronunciation issues
Rigorous approach to annotation and documentation of errors
Availability to work on‑site in Barcelona for the internship duration
Условия
Paid internship with stipend
On‑site work required in Barcelona
Full‑time commitment with 2‑3 available positions
No remote work option
Навигация
Действия
Похожие вакансии
Подобраны ИИ по смыслу описания, а не по ключевым словам