Staff Software Engineer (AI Backend Services)
ROLE DESCRIPTION The AI Backend Python Engineer (Staff) will provide technical leadership and define the architecture for backend systems that power the next generation of generative AI applications and large language model (LLM) integrations. This role focuses on driving strategic technical direction, designing platform-level solutions using Python, FastAPI, and AWS, and influencing engineering practices across the organization. KEY RESPONSIBILITIES
- Define technical strategy and architecture for Python-based AI backend platforms (on FastAPI) that support LLM integration, generative AI pipelines, and AI agent orchestration
- Architect scalable, reliable, and secure systems on AWS infrastructure (Lambda, EKS) that serve as the foundation for multiple teams
- Drive technical decisions that impact organization-wide engineering practices and platform capabilities
- Design and champion AI system observability using LangChain, Langfuse, and litellm
- Establish engineering standards for monitoring, logging, observability, and operational excellence across AI backend services
- Lead cross-functional initiatives to optimize performance, security, and scalability of large-scale AI applications
- Mentor and technically guide engineers at all levels, elevating team capabilities through code reviews, architecture reviews, and technical leadership
- Identify technical debt, performance bottlenecks, and architectural limitations; drive long-term solutions
- Collaborate with engineering leadership, product, and other stakeholders to align technical strategy with business objectives
- Influence technology choices, design patterns, and best practices across the AI Software & Operations department
- Represent the team in organization-wide technical discussions and drive adoption of innovative solutions
- 7+ years of professional software engineering experience with extensive backend and distributed systems expertise
- Deep expert-level proficiency in Python for building large-scale production systems
- Comprehensive understanding of LLMs, generative AI architectures, and AI infrastructure (LangChain, litellm, Langfuse, OpenAI/Anthropic APIs)
- Proven track record of architecting and delivering complex, scalable platforms on AWS
- Expert knowledge of microservices architecture, distributed systems design, and event-driven architectures
- Demonstrated experience with containerization, orchestration (Docker/Kubernetes), and cloud-native patterns
- Strong history of technical leadership, mentoring engineers, and driving organizational impact
- Bachelor's or Master's degree in Computer Science, Engineering, or related field, or equivalent practical experience
- Excellent strategic thinking and ability to balance short-term delivery with long-term architectural vision
- Extensive experience designing and building platform-level infrastructure for AI/ML workloads at scale
- Deep expertise in FastAPI, asynchronous Python, and high-performance backend systems
- Proven track record of architecting event-driven and real-time systems for AI applications
- Experience influencing engineering culture, establishing best practices, and driving technical standards
- Strong background in MLOps, model deployment strategies, and AI system reliability
- Expertise with infrastructure-as-code, CI/CD automation, and platform engineering
- Experience working with product and business stakeholders to translate requirements into technical strategy
- History of leading cross-functional technical initiatives with measurable organizational impact
- Published technical work, open-source contributions, or recognized expertise in AI backend systems
- Exceptional communication and influence skills across all levels of the organization
Emplois Recommandés
Comptable clients
Vous cherchez un nouveau défi au sein d'une entreprise en pleine croissance ? Vous êtes au bon endroit ! Je suis Adrien Vandoni, Manager Exécutif chez Fed Finance et je recrute un comptable clients…
Responsable de site maintenance (F/H)
Responsable de site maintenance : Super Héros de la Maintenance (F/H) VINCI FACILITIES Vous êtes un(e) expert(e) en maintenance et vous rêvez de rejoindre une équipe dynamique chez VINCI FACILITIES …
Pneumologue H/F - Paris 75005
Présentation de l'entrepriseRetrouvez plus de 4000 offres d'emploi santé sur notre site et application mobile Jober Group. Profitez d'un réseau de 2000 partenaires sur toute la France, d'une équip…
Ingénieur SysOps H/F
Dans un contexte de modernisation et de rationalisation du système d'information de la DILA, le pôle « Performance et automatisation » contribue à l'industrialisation des pratiques techniques, à l'au…
Auxiliaire de vie à domicile H/F - CDI WE et jours fériés
Auxiliaire de vie à domicile H/F - CDI WE et jours fériés AAD WE et JF Accompagner et aider au quotidien des personnes en perte d’autonomie (personnes âgées et/ou adultes handicapées) dans l’accompl…
Comptable général confirmé F/H
Entreprise « Soyez vous même, les autres sont déja pris. » Depuis plus de 20 ans, PERSUADERS RH, s’est construit sur une expertise forte dans le recrutement de profils complexes et a développé un…
Consultant(e) Expérimenté(e) Transformation Banque et SFS
Consultant(e) Management & Organisation - Transformation Banque, Assurance et Protection Sociale F/H Description de poste CGI Business Consulting, cabinet de conseil, éclaire les entreprises et …
Chargé de valorisation du patrimoine matériel et immatériel - MNSMN (75) H/F
Description des missions Missions et activités principales : Sous l'autorité du directeur de la communication et des relations extérieures, le/la chargé de valorisation du patrimoine matériel et…
PMO / Change manager informatique (IT)
Description de la prestationL?expert PMO / Change Manager aura pour mission de coordonner l?exécution du programme, de gérer les communications avec les parties prenantes et de piloter les initiatives…
Product Ops IA / Product Manager Ops - (H/F)
Mindset Chez Thiga, nous sommes convaincus que l’IA ne transforme pas seulement les produits, mais aussi la façon de les concevoir, de les construire et de les faire évoluer. Discovery, delivery, …