Research Engineer, Inference Foundation
Коротко
Develops, tunes, and operates the core inference engine and orchestrator for large-scale LLM serving; improves throughput, latency, release reliability, fleet
Описание от работодателя
You will develop, tune, and operate the core inference engine and orchestrator for large-scale LLM serving. You will improve throughput, latency, release reliability, fleet efficiency, capacity elasticity, topology, and infrastructure that supports reinforcement-learning and post-training workloads. You will debug across the systems stack and contribute upstream improvements when appropriate.