Inference Systems Engineer: Scale GPU Fleets & Kubernetes

Luma is building large-scale inference systems and needs a systems engineer to own model serving within the inference engine. You will scale deployments across thousands of machines, optimize GPU utilization, and ensure reliability across clusters and hardware providers.

Ideal candidates have strong Python and system-architecture skills, experience with Linux, Docker, Kubernetes, and model deployment frameworks such as PyTorch, Hugging Face, vLLM, or TensorRT-LLM. Equal opportunity employer.

Report this job