Sdet / QA Engineer

October 9, 2026

Remote

Senior

Barcelona, Spain

May rule you out

Another language required
Spanish

Worth knowing

English is required

Description

We are looking for a QA Engineer or Software Development Engineer in Test (SDET) who shares values of pragmatism, professionalism and transparency, working from anywhere in Spain on a wide range of client projects. You will evaluate, validate and improve quality across teams, develop exploratory and automated tests, track quality assurance metrics and liaise with technical and business stakeholders. A core part of the role is AI evaluation — raising pass rates on production AI agents.

Responsibilities

Take ownership of a Python LLM evaluation tool, diagnostic suite and golden datasets to raise pass rates on production AI agents
Refine scoring criteria and design multi-turn conversational evaluations for AI agents
Set up automated regression testing for core product flows using Playwright, covering integrated workflows and third-party channels
Implement SonarQube quality gate monitoring and daily deviation reporting
Partner with senior stakeholders on the QA strategy, standards and continuous improvement
Estimate, prioritize, plan and coordinate testing activities
Stay up-to-date with new testing tools and test strategies

Requirements

At least 4 years of experience in a similar role
Fluent in Spanish and English (speaking and writing)
Consultancy experience and an open mind around what is quality (adapting to clients)
Hands-on experience with Playwright, SonarQube and other testing tools (Cucumber, Selenium, Appium, Jenkins)
Knowledge of CI/CD tools and processes
Continuous learning and curiosity (keep up to date with advancements in the market)
Strong programming skills with Python (other stacks are a plus)
Practical experience in AI evaluation (LLM evals, agent testing, multi-turn chat scoring, golden dataset management)
QA strategy knowledge (holistic testing, Agile testing Manifesto) — a bonus
Anthropic certification — a bonus
Experience with performance/load testing for AI agents/call center agents and multi-channel integration — a bonus
Familiarity with BDD and TDD — a bonus
ISTQB certificate — a bonus

Conditions

Transparency — all salary bandings and company finances are available to everyone from day one
Personal Learning Budget with access to the Learnerbly online learning and development tool
Training with no fixed budget — courses paid for if relevant to the company, with a lightning talk on the subject
Working 100% remote, or hybrid if you want to drop by the office from time to time
Private medical and dental insurance
Restaurant, transport and nursery tickets (retribución flexible / tax deductible)
Gym discounts
Language classes (Spanish, English, French, German)
You choose between Linux, Mac or Windows
Working alongside Craftspeople on client projects and internal projects

Similar jobs

Similar in meaning, not just matching keywords

This device does not meet the site requirements

What may not work

Sdet / QA Engineer

Job summary

May rule you out

Worth knowing

Description

Responsibilities

Requirements

Conditions

Similar jobs

Job summary

Similar jobs

Sdet / QA Engineer

Job summaryAnalysis and summary of the descriptionGreat [data-chart=chart-_R_39f1binpfiv6abqaqlb_] { --color-score: var(--success); } .dark [data-chart=chart-_R_39f1binpfiv6abqaqlb_] { --color-score: var(--success); } 80

Job summary

May rule you out

Worth knowing

Description

Responsibilities

Requirements

Conditions

Similar jobs

Job summaryAnalysis and summary of the descriptionGreat [data-chart=chart-_R_39f1binpfiv6abqaqlb_] { --color-score: var(--success); } .dark [data-chart=chart-_R_39f1binpfiv6abqaqlb_] { --color-score: var(--success); } 80

Job summary

Similar jobs