Principal AI Solution Engineer

October 19, 2026

Lead

Also worth knowing

English is required
B2 level

Description

A Principal AI Solution Engineer is sought to join an engineering organization building a sovereign, multi-tenant agentic AI platform and the applied products on top of it. Work spans three layers — applied AI, AI infrastructure and the backend platform — under strict data residency constraints, with the product operating in Arabic and English. Small squads of three senior engineers make decisions in the room and ship to production.

Responsibilities

Set architecture for systems that span squads; write the decision down and defend it
Build and tune GPU-based serving — vLLM, TGI or TensorRT-LLM — for latency, throughput and a cost per token you can justify
Own the reference RAG and agent architecture other teams build against
Define service boundaries, API contracts, event-driven infrastructure and the SLO work that prevents incidents rather than answering them
Develop offline and online evaluation and regression detection, so models, prompts and retrieval can change without flying blind

Requirements

5+ years of hands-on engineering experience with shipped production systems spanning applied AI, AI infrastructure and backend platforms
At least 1 year of relevant leadership experience
Expertise in Python and its production ecosystem, including FastAPI, Pydantic and asyncio
Proficiency in production RAG end-to-end: ingestion, vector search, reranking and grounding evaluation
Background in agent orchestration frameworks such as LangGraph, LangChain, OpenAI Agent SDK or Microsoft Agent Framework
Competency in distributed systems, including idempotency, back-pressure and retry semantics, with strong event-driven architecture skills
Knowledge of PostgreSQL at scale, along with GPU inference and serving using vLLM, TGI or TensorRT-LLM
Familiarity with Kubernetes on Azure
Skills in at least one infrastructure language: Go, Rust, Java or Kotlin
Capability to use agentic coding tooling as a daily workflow, including project setup with CLAUDE.md, skills and agent configuration
Excellent command of written and spoken English (B2+ level)
Showcase of pgvector or Qdrant at production scale
Experience with Arabic-language, voice or conversational AI
Background in AI or mission-critical delivery in regulated environments such as government, defence or financial services
Familiarity with Azure sovereign cloud, Entra ID and Azure OpenAI
Understanding of Langfuse, Grafana, Prometheus and Terraform