(Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure
San Franciscoonsitesenior$250K – $320K
via Greenhouse
About this role
About The Role We're looking for a software engineer, reliability-minded but still a builder, to own what happens in production to the Kubernetes-native control plane that provisions and runs our GPU inference fleet. The platform team builds the manifest-driven API and controllers that let the inference team declare what they need, a cluster, a model deployment, a capacity change, and get it reconciled underneath. Your job is to keep that promise true in the real world: triaging InfiniBand issues when prefill and decode nodes stall exchanging KV cache over RDMA, diagnosing hero-model and LoRA-serving faults that don't show up in generic health checks, and extending the automated self-healing system so each new failure mode becomes a permanent fix instead of a recurring page.…
What we'd score you on
reqspace match rubricFive dimensions, recruiter-grade. Upload your resume and we'll generate a written explanation of where you fit and where the gaps are.
1
Skills match
For this role: kubernetes, mode, teams, zoom, salesforce
2
Level fit
This role is senior-level. We check your trajectory against it.
3
Domain experience
Your work in the role's domain matters more than your years total. We weight recent and direct experience.
4
Recency
A skill you used last quarter weighs more than one from five years ago. We grade on recency, not lifetime.
5
Location fit
This role is based in San Francisco. We weight your proximity and willingness to relocate.
Score yourself on this role.
Free · no card · written explanation included
Skills in this role
Pulled from the job description. These are the keywords we'll weight when scoring your fit.
kubernetesmodeteamszoomsalesforce
More at Togetherai
- View →Staff Software Engineer - AI Compute, Together CloudAmsterdam
- View →Systems Research Engineer Intern - GPU Programming (Summer 2027)San Francisco
- View →Staff Engineer, Distributed Storage and HPC & AI InfrastructureBangalore India
- View →Lead/Manager Together Cloud InfrastructureAmsterdam
- View →Commercial Counsel-Infrastructure and GTMSan Francisco
- View →Forward Deployed Engineer, Post-TrainingSan Francisco
