Principal AI Platform Engineer

We are recruiting for a Senior or Principal AI Platform Engineer to help shape, build and operate the infrastructure and services that underpin our AI platform, providing engineers with secure, reliable access to AI models and inference services.

• →Take ownership of the platform layer above our managed GPU infrastructure, including model serving, inference runtimes, AI gateways and supporting services. You will help make these capabilities easy for engineering teams to consume while maintaining appropriate controls around security, performance and availability.
• →Using technologies such as containers, Kubernetes, vLLM and AI gateway platforms, you will deploy and operate scalable inference services, improve observability and performance, and investigate complex technical issues across the platform. You will also help establish engineering standards for operating AI services within a secure enterprise environment, including cases where the target system has no route to the internet.

We are a multidisciplinary team looking for candidates with a broad mix of skills and experience. You do not need to meet every requirement. What matters most is sound engineering judgement, adaptability and the ability to make a meaningful contribution.

• Experience operating shared or business-critical platforms
• Familiarity with large language models and the practical considerations of running them
• Experience troubleshooting distributed systems and performance issues
• Familiarity with infrastructure as code and CI/CD
• Effective communication and stakeholder engagement
• Curiosity and a drive for continuous improvement

Key areas we value experience in:

• Linux, application and server administration
• Containers and container orchestration, such as Docker and Kubernetes
• AI inference and model serving platforms, such as vLLM, SGLang or similar
• AI gateways and API management, such as LiteLLM, Bifrost or similar
• GPU workloads, including performance, utilisation and resource management
• Programming and scripting, such as Python, Bash or Go
• Monitoring, observability and SRE practices
• Secure, resilient and scalable service design
• Authentication, access control, rate limiting and service integration
• Technical documentation and operational guidance

You must be eligible for full security clearance.  For more information and guidance please visit: https://www.gov.uk/government/publications/united-kingdom-security-vettingclearance-levels