ML Systems Engineer — Inference Acceleration
Meet Arago and the Aragonians
Arago’s mission is to re-engineer the foundations of computing from first principles.
The explosive growth of AI is pushing the industry to rethink how processors are built. Arago is meeting that challenge with a proprietary technology that fuses optical and CMOS technologies to deliver an order-of-magnitude increase in performance.
Arago is the fastest, and currently the only, company to have built such a processor. It's backed by leading deep-tech investors and some of the most respected figures in semiconductors and computing, including the CEO of Arm, the founder of macOS who worked directly with Steve Jobs at Apple, an Nvidia Fellow, the Head of Optics at Google, and many other industry leaders.
Our work is guided by three clear values: do great things, move with high velocity, and operate as one unit. We work in a demanding environment where constant learning, ownership, and execution are expected, and where exceptional people have the opportunity to do their life’s work.
What you’ll do
Optimize the execution and serving of modern AI models on Arago's custom accelerator. Work across kernels, model execution, multi-device distribution, runtime, and inference serving, while helping shape the software stack around the capabilities of Arago's hardware.
Required Skills and Experience
Strong experience in high-performance ML inference, GPU/accelerator programming, or ML systems engineering.
Deep understanding of computer architecture, accelerator/GPU execution models, memory hierarchies, parallelism, and performance bottlenecks.
Experience developing and optimizing custom kernels using CUDA, Triton, ROCm/HIP, or equivalent low-level programming environments.
Experience with operator fusion, tiling, scheduling, data movement optimization, graph execution, and profiling of compute- and memory-bound workloads.
Strong understanding of distributed model execution, including tensor, pipeline, sequence, and/or expert parallelism and communication/computation overlap.
Hands-on experience with modern inference-serving systems such as vLLM, SGLang, TensorRT-LLM, or equivalent, including KV-cache management, continuous batching, paged attention, and prefill/decode scheduling.
Strong C++ and Python skills, and comfort working on a custom accelerator stack where compiler, runtime, kernels, and abstractions are actively being developed. Exposure to or experience with MLIR and MLIR dialects is a strong plus.
Language: English at a proficient level.
Responsibilities
Analyze modern AI workloads and identify kernel-, runtime-, memory-, and system-level bottlenecks on Arago's accelerator.
Develop and optimize custom kernels, fused operators, and execution strategies to maximize device utilization.
Design efficient mappings of models and operators across multiple Arago devices, including communication and synchronization strategies.
Develop inference-serving techniques such as continuous batching, paged KV caches, prefix/context caching, chunked prefill, and prefill/decode interleaving or disaggregation.
Build profiling, benchmarking, and performance-analysis infrastructure spanning kernels, full models, and serving workloads.
Work closely with Arago's hardware, compiler, and runtime teams to co-design software abstractions and influence future hardware features based on real model workloads.
Pay and benefits
Competitive cash compensation, with final package based on location, experience, and the pay of team members in similar positions.
Meaningful stock option plan offered (included in the majority of full time offers).
Healthcare coverage (including family-friendly options), pension contributions, professional development support, and 25 days of PTO, in addition to public holidays.
Ownership of a key technical domain, with significant vertical and/or horizontal growth opportunities, based on performance and individual drive.
We look forward to hearing how you can help shape the future of AI at Arago.
Emplois Recommandés
Short-Term Analyst Intern
When you join EDF Trading, you'll become part of a diverse international team of experts who challenge conventional ideas, test new approaches, and think outside the box. Energy markets evolve rapidl…
STAGE FIN D’ETUDE OU ALTERNANCE STAGE : CONSULTANT(E) BI (H/F)
Pour accélérer le développement de notre startup coopérative, nous souhaitons recruter un(e) Consultant(e) BI (H/F). Ce poste et notre contexte permettent une montée en compétences en BI dans un con…
Auxiliaire petite enfance F/H
Description de l'entreprise La Halte-garderie Le Chalet a ouvert ses portes en 2000 pour accueillir des enfants valides du quartier ainsi que des enfants touchés par la paralysie cé…
Collaborateur comptable billingue Chinois - F/H
Entreprise : Le CABRH, cabinet de recrutement et de chasse de têtes , recrute pour le compte de l’un de ses clients, un cabinet d’expertise comptable, un Collaborateur comptable bilingue chinois …
Hôte(sse) de caisse grande distribution H/F
Nous recherchons pour notre client spécialisé dans la vente produits alimentaires, grand acteur de la distribution, des hôte(sse) de caisses H/F. Votre mission est essentielle pour la satisfaction des…
Collaborateur comptable anglophone F/H - CDI - Paris 9e
Consultant en recrutement chez Fed Finance, je recherche un collaborateur comptable bilingue anglais (F/H) en CDI à Paris (75009). Votre fonction Notre client est un cabinet d'expertise comptable et…
Business Analyst Fonctionnel Senior - Épargne / Rentes - Freelance
Taux journalier (TJM): 500 Contexte Dans le cadre de la mise en place d’un nouveau cadre de gestion, un client dans le secteur de l’épargne recherche un Business Analyst Fonctionnel spécialisé en Ép…
Médecin généraliste H/F - Paris 75009
Présentation de l'entrepriseRetrouvez plus de 4000 offres d'emploi santé sur notre site et application mobile Jober Group. Profitez d'un réseau de 2000 partenaires sur toute la France, d'une équip…