Senior AI Engineer
Join us as an AI Engineer in our AI Products team to make sure the AI agents we ship are as reliable as they are fast to build. You'll design the evals, observability and tooling that keep agent quality high in a regulated bank.
➡️ What you'll do
- Build agents: You'll develop agents that take real actions for customers.
- Match rigor to risk: You'll size evaluation to the stakes, because an agent making transfers is not a PR bot.
- Own evaluation of every feature: You'll make sure every new agent capability comes with the right evaluation strategy, defining what needs to be tested offline and validated online, based on business requirements, expected outcomes and risk.
- Observe agents in production: You'll build the monitoring strategy that makes agent behaviour visible, tracks performance against business objectives and flags issues early.
- Scale it as a platform: You'll turn our tools, evaluation practices and monitoring capabilities into a self-service platform that lets other teams build, evaluate and operate their own agents.
➡️ What we're looking for
- Evaluation mindset: You've evaluated models or LLM systems and know what makes a test misleading.
- Strong ML foundations: You understand the ML lifecycle, from training and iteration to evaluation and monitoring, and core concepts such as overfitting, generalization and cross-validation.
- LLM and agentic systems knowledge: You understand the fundamentals of LLMs (particularly the Transformer architecture) and the building blocks of agentic systems. You know how to optimize an agent's harness (prompts, tools, hooks and orchestration) to improve its reliability and performance.
- Builder instinct and backend comfort: You've built and shipped something used by real users, whether professionally, during an internship or as a side project. You're comfortable reading and writing backend code, working with APIs and integrating systems.
- AI-native curiosity: You follow developments in AI closely, experiment with new approaches on your own and use AI tools daily in your work.
➡️ What we can offer you
- A rare problem: You'll make AI agents trustworthy in a regulated bank, where quality is not optional.
- Hands-on coaching: You'll learn directly from Pierre-Jean, one of the AI engineers in the team.
- Room to grow: Your scope grows as the platform opens to more teams.
- Space to experiment: You'll work at the frontier of AI in a team that keeps experimentation at its core.
➡️ Your future manager
Your manager will be [Sophie Cornay](_#), our Product Leader for AI Products.- Her background? Sophie has led product teams in startups and established tech companies.
- What does she bring to the team? She gives engineers real ownership and space to experiment.
➡️ Our stack and practices
- Python and Pydantic-ai: Python is our baseline language, and Pydantic-ai is our agentic framework.
- AWS: We access our models through AWS.
- Grafana: We track usage and cost per sub-agent on it.
- GitHub and CI: Every agent change ships through a reviewed pull request.
- Braintrust: Evaluation and agent monitoring run on our self-hosted instance.
Emplois Recommandés
Senior Clinical Research Associate
TFS HealthScience is a leading global mid-size Contract Research Organization (CRO) that partners with biotechnology and pharmaceutical companies throughout their entire clinical development journey…
Architecte d’Entreprise (h/f)
Votre mission LHH Recruitment Solutions , cabinet de conseil en recrutement et évaluation d’experts, cadres et dirigeants, accompagne son client dans le recrutement d’un Chef de Projet Archite…
Ingénieur Système Windows / Azure
Contexte de la mission Dans le cadre du renforcement de son équipe IT Operations, une entreprise recherche un Ingénieur Système & Cloud senior pour assurer le maintien en conditions opérationnelles…
Business Developer France H/F/NB - Stage
Descriptif du poste Wecasa, c’est un peu magique. Imagine : tu commandes une prestation à domicile en deux clics et 2 heures plus tard, un professionnel de talent est là, rien que pour toi. Tu t’e…
Event Production Internship (m/f/d)
LIVE THE MUSIC WITH US From a pioneer tech start-up created in 2007, Deezer has become one of the first French unicorns and the second largest independent music streaming platform in the world. …
Gestionnaire Sinistres IARD (H/F)
Le poste : Un cabinet de courtage en assurances parisien, à taille humaine recrute son/sa Gestionnaire Sinistres IARD . Rattaché(e) au service indemnisation, vous gérez principalement des sinis…
Consultant client onboarding CIB - Freelance
Taux journalier (TJM): TJM HT max 518 € (hors éventuels frais de mission, à discuter avec le client) Mission de l’équipe : La mission intervient au cœur du parcours d’onboarding des clients CIB, dep…
Team Lead Account Executive - Enterprise (f/h/n)
Chez Hublo, nous croyons qu’une société en bonne santé s’appuie sur des vocations préservées . C’est pourquoi, chaque jour, nous réconcilions les aspirations individuelles et les contraintes de…
Analyste Green Venture F/H
Vos missions au service de l’économie française En tant que stagiaire ; Vous effectuez de la veille sur différents secteurs innovants, Vous identifiez de nouvelles opportunités d’inves…
ingénieur informatique Poste de Travail - anglais fluent (IT)
Skills : Solide expérience de la conception, de la maintenance et du paramétrage des socles Windows avec Intune et Windows Autopilot. Pratique éprouvée du déploiement et de la mise à jour de la confi…