AI Product Analyst

October 8, 2026

Remote

Middle

Poland

Worth knowing

English is required
B2 level
Part-time role

Description

MEDvidi is an AI-powered mental healthcare platform serving patients across the US, combining licensed providers with proprietary AI tools. The AI Receptionist Team builds and improves Voice AI Agents that handle real patient conversations and automate parts of the care journey. The company is hiring an AI Product Analyst to evaluate, monitor, and improve these Voice AI systems in production, working at the intersection of Product, Engineering, Operations, and AI.

Responsibilities

Analyze production behavior of Voice AI Agents and conversational AI workflows
Investigate hallucinations, inconsistencies, silent failures, and quality degradation in AI-driven conversations
Work directly with call transcripts, logs, generated outputs, and operational datasets to uncover patterns and actionable insights
Design evaluation frameworks for measuring AI quality, reliability, and business impact
Build monitoring systems and dashboards for AI performance visibility
Measure the impact of AI systems on operational efficiency, business outcomes, and patient experience
Detect quality shifts, anomalies, and emerging failure modes in production environments
Partner closely with Product, Engineering, QA, and Operations teams on AI initiatives
Support rapid decision-making in fast-changing and ambiguous environments

Requirements

5+ years of experience in Product Analytics, Data Analytics, Operational Analytics, or analytics roles within complex production systems
Strong SQL skills
Python for analytical investigations and working with large-scale text datasets
Experience working with ML pipelines or AI-powered products
Understanding of LLM limitations, hallucinations, evaluation challenges, prompt sensitivity, and AI failure modes
Experience building monitoring systems, analytical frameworks, or operational dashboards
Strong communication skills and ability to translate analysis into product decisions
Ability to work effectively in ambiguous and fast-changing environments
Fluent Russian; English level B2 or higher
Ability to work CET-overlapping hours

Conditions

High-impact environment with a chance to influence how AI is used in real patient interactions
Competitive compensation and clear growth opportunities
Remote-first: fully remote, long-term B2B collaboration
Health insurance after the probation period, plus sports & wellness compensation
Career growth, including personalized English lessons via Preply
19 working days of vacation per year, 3 additional wellness days, and paid sick leave for the first 5 working days
Thoughtful gifts for important life events

Similar jobs

Similar in meaning, not just matching keywords

This device does not meet the site requirements

What may not work

AI Product Analyst

Job summary

Worth knowing

Description

Responsibilities

Requirements

Conditions

Similar jobs

Job summary

Similar jobs

AI Product Analyst

Job summaryAnalysis and summary of the descriptionAverage [data-chart=chart-_R_39f1binpfiv6abqaqlb_] { --color-score: var(--warning); } .dark [data-chart=chart-_R_39f1binpfiv6abqaqlb_] { --color-score: var(--warning); } 55

Job summary

Worth knowing

Description

Responsibilities

Requirements

Conditions

Similar jobs

Job summaryAnalysis and summary of the descriptionAverage [data-chart=chart-_R_39f1binpfiv6abqaqlb_] { --color-score: var(--warning); } .dark [data-chart=chart-_R_39f1binpfiv6abqaqlb_] { --color-score: var(--warning); } 55

Job summary

Similar jobs