LLM Serving Platform Engineer

Scaleai · London, England · 2 days ago

Apply on partner site You apply on the advertiser's own site — nothing is stored here.

Scale AI is seeking a Software Engineer on the ML Infrastructure team to design and build platforms for scalable, reliable serving of LLMs. You will collaborate with researchers and engineers to productionize models, ensuring high-performance, fault-tolerant systems across environments.

The ideal candidate has strong ML fundamentals and deep backend system design experience, with hands-on skills in Python, Go, Rust, or C++, and experience with Docker, Kubernetes, and cloud infrastructure.

Apply on partner site Listing supplied by one of our partner job boards. Last confirmed: 2 days ago.

Report this job

Market data from EasyWorkClub, not from the employer

More openings at Scaleai

17 other openings we list

Applied AI Engineer, Global Public Sector · London
Head of Product Management, Forward Deployed & Strategy · London
Public Sector Lead, Central & Local Government · London
AI Infrastructure Engineer, Serving Platform · London
Software Engineer, Platform · London

More jobs with this title

LLM Inference & Serving Engineer Mistral AI · 1 week ago Senior Lead AI Platform Engineer: LLM Serving & Kubernetes Aumni · 1 week ago AI Infrastructure Engineer, Serving Platform Scaleai · 4 days ago Lead, GenAI & LLM Platform Engineer JPMorgan Chase & Co. · 1 day ago LLM Engineer Ultralytics · 2 days ago Senior Backend Engineer (Data serving) United States Digital Space LLC · 2 days ago Senior Backend Engineer (Data serving) Pleo · 1 week ago AI Platform Engineer – Production-Ready LLM Systems Barlowe LLP · 1 week ago