Senior Engineer – GenAI Quality Assurance

13 сентября 2026 г.

Гибрид

Senior

Spain

Описание

Senior Engineer for GenAI Quality Assurance at Johnson & Johnson Innovative Medicine R&D, focusing on designing and testing complex GenAI applications in scientific environments. Responsible for validating, stress-testing, and improving AI-powered products across the lifecycle.

Обязанности

Design and implement automated and manual QA strategies for GenAI systems
Build regression tests, generate synthetic test data, build test harnesses and evaluation pipelines for accuracy, grounding, robustness, safety
Validate prompt logic, model behavior and evaluation metrics
Execute tests and debug pipelines
Support deployment of GenAI products
Lead system design reviews, advocating best practices for architecture and reliability of GenAI applications
Collaborate closely with data scientists and developers to embed testing and quality checkpoints
Establish testing standards and workflows for continuous integration and deployment
Conduct code reviews with a focus on design, testability, and maintainability
Document system design decisions, test cases, and best practices

Требования

Strong software engineering background with QA ownership
Familiarity with RAG & Graph frameworks
3+ years of experience as a software engineer or QA engineer, preferably including 1 year in GenAI systems
Advanced Python skills
Experience with LLM-based systems in real environments
Hands-on experience with LLM APIs (AWS Bedrock, Azure Foundry, GCP)
Cloud platforms (AWS, Azure, GCP)
Proven ability to implement test frameworks for GenAI applications
Knowledge of API testing, data validation, and data pipeline testing
Experience with version control (Git)
Experience with building and deploying AI/ML products through the full product lifecycle
Good understanding of scientific computing and ML frameworks
Solid understanding of safety, bias, and failure modes of GenAI systems

Условия

Hybrid working
Based in Madrid or Barcelona

PythonLLM APIsAWShealthcare

Устройство не соответствует требованиям сайта

Что может не работать

Senior Engineer – GenAI Quality Assurance

Сводка по вакансии

Оценка

Описание

Обязанности

Требования

Условия

Похожие вакансии

Сводка по вакансии

Оценка

Похожие вакансии

Senior Engineer – GenAI Quality Assurance

Сводка по вакансииАнализ и саммари по описанию [data-chart=chart-_R_b5s5eav5ubsqiuialb_] { --color-score: var(--success); } .dark [data-chart=chart-_R_b5s5eav5ubsqiuialb_] { --color-score: var(--success); } 72ОценкаХорошая

Сводка по вакансии

Оценка

Описание

Обязанности

Требования

Условия

Похожие вакансии

Сводка по вакансииАнализ и саммари по описанию [data-chart=chart-_R_b5s5eav5ubsqiuialb_] { --color-score: var(--success); } .dark [data-chart=chart-_R_b5s5eav5ubsqiuialb_] { --color-score: var(--success); } 72ОценкаХорошая

Сводка по вакансии

Оценка

Похожие вакансии