Mistral AI is seeking a senior engineer to own and optimize the inference stack, engine orchestration, and scalable serving for frontier AI models. You will work on production-grade ML/LLM services, capacity sizing, and training-serving pipelines to keep models responsive and cost-efficient.
The role emphasizes building high-performance serving systems, with hands-on experience in vLLM, SGLang, or TensorRT-LLM, and deep CUDA/NCCL knowledge. Hybrid work in London area is supported.
#J-18808-Ljbffr
Step into the LLM Inference & Serving Engineer role at Mistral AI in Greater London, England, United Kingdom and grow with us.
The LLM Inference & Serving Engineer position in the IT & Technology, Engineering field is open for applications.
We have an opening for a LLM Inference & Serving Engineer in Greater London, England, United Kingdom within IT & Technology, Engineering.