Senior AI Infrastructure Engineer - GPU Cloud Platform
Near Tech Search ·neartechsearch.com
Apply direct
Senior AI Infrastructure Engineer – GPU Cloud Platform
London (Hybrid, 2 days in office) | £90,000 – £120,000 | Permanent
The company
A VC-backed AI cloud provider that gives AI companies and research teams access to large-scale GPU compute. They’ve raised Series A funding, have around 60 people, and are scaling their platform across multiple data centres in the UK and Europe. Customers range from early-stage AI startups to enterprise ML teams running large training and inference workloads.
The role
You’ll join a small, senior infrastructure team that owns the platform customers run their workloads on. This is a hands-on role with real ownership. You’ll help shape how the platform scales as GPU capacity grows over the next 12–18 months.
What you’ll be doing
- Building and operating Kubernetes clusters for GPU workloads across bare-metal and cloud environments
- Managing GPU scheduling, multi-tenancy and resource isolation using tools such as the NVIDIA GPU Operator
- Automating provisioning and configuration with Terraform, Ansible and GitOps (ArgoCD/Flux)
- Improving observability and reliability with Prometheus, Grafana and alerting on high-value compute
- Working on networking and storage performance for distributed training (InfiniBand/RoCE, high-throughput storage)
- Supporting customers and internal ML engineers to get workloads running efficiently
- Taking part in a fair, well-supported on-call rota
What they’re looking for
- 5+ years in platform, infrastructure or SRE roles
- Deep production Kubernetes experience, ideally including operators or custom controllers
- Strong Terraform / infrastructure as code skills
- Solid Linux and networking fundamentals
- Go or Python for tooling and automation
- Experience with AWS, GCP, Azure or on-prem environments
Nice to have
- GPU infrastructure experience (NVIDIA, CUDA drivers, DCGM)
- Slurm or HPC backgrounds
- Bare-metal or data-centre experience
- Exposure to Ray, Kubeflow or distributed training workloads
Please note: Applicants must have the right to work in the UK. Visa sponsorship is not available for this role.
Interested? Apply directly or email max@neartechsearch.com for a confidential conversation and the full job spec.