DevOps Engineer - AI Model Evaluator
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations involving cloud platforms , Kubernetes , CI/CD systems , observability , and infrastructure automation .
- Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models to assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional DevOps , SRE , or Cloud Engineering experience.
- Experience with AWS , Azure , GCP , Kubernetes , Terraform , CI/CD pipelines , or observability tooling.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability engineering solutions.
Preferred
- Experience supporting production-scale systems.
Compensation & Legal
- $400 per accepted task
- Compensation tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: [email protected]
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Emplois Recommandés
Job étudiant - Professeur Particulier - Télétravail possible
Vous êtes à la recherche d'un job étudiant ? Devenez professeur avec Voscours. Partagez vos connaissances avec nos élèves : soutien scolaire, musique, sports, langues, technologie… Nous sommes à…
Consultant Senior/ Chef de projet Data / IA H/F Ajouter aux favoris
mc2i is an independent consulting firm that supports its key clients with their digital transformation projects. For over 36 years, we've been active in diverse sectors and areas, including Human …
Responsable Certifications - Matériaux Construction H/F
Présentation de la société Depuis 2021, Team.is accompagne les startups, scale-ups et entreprises innovantes, industries de pointe et entreprises de services dans leurs recrutements les plus strat…
ALTERNANCE SERVEUR(SE) CW
Offre d’Alternance – Apprenti(e) Serveur(se) (H/F) Lieu : PARIS Contrat : Apprentissage Donnez du sens à votre avenir avec Auguste Académie . Nous recrutons pour un restaurant partenai…
Pâtissier (H/F)
L'entreprise Nous recrutons pour notre client qui est une enseigne de grande distribution reconnue, engagée à proposer à ses clients des produits de qualité et une expérience d'achat conviviale.…
Commis pâtisserie H/F - PARIS SOCIETY
Notre histoire : Avec un catalogue de plus de cinquante lieux, le groupe Paris Society, fondé en 2008 par Laurent de GOURCUFF, est un acteur incontournable de l’hospitalité en France. Le group…
Key Account and Partnership Manager Ajouter aux favoris
Schaeffler is a dynamic global technology company and its success has been a result of its entrepreneurial spirit and long history of private ownership. Does that sound interesting to you? As a partne…
Aide ménager.e F/H
Description de l'entreprise Soyons fiers de notre métier ! Chez VIVASERVICES, nous savons qu’une personne épanouie dans son travail, c’est l’assurance d’un client satisfait et d’u…
Assistant.e DTC E-Commerce
Coty is one of the world’s largest beauty companies with an iconic portfolio of brands across fragrance, color cosmetics, skincare, and body care. At Coty, we celebrate the entire human kaleidoscope a…
Tech Lead DevOps Plateforme Data & IA - Freelance
Taux journalier (TJM): 545 € Contexte de la mission Au sein de la fabrique digitale d'un acteur majeur du transport public, vous intégrerez l'équipe en charge de la plateforme Data du Groupe, dédiée…