Head of GPU Cloud

Head of GPU Cloud About the Company Developing software foundation for next-generation accelerated computing platform for large-scale AI infrastructure IndustryInformation Technology and Services TypePrivately Held About the Role The Company is in search of a Head of GPU Cloud to spearhead the engineering team dedicated to the development of a next-generation accelerated computing platform. The successful candidate will be instrumental in defining the architecture and operating model for large-scale AI inference services, with a direct impact on GPU utilization, platform economics, and customer experience. This role demands a leader with a strong technical background in software engineering, particularly in the areas of cloud platforms, distributed infrastructure, and HPC. The Head of GPU Cloud will be responsible for scaling the engineering organization, setting the technical strategy, and ensuring the platform's reliability and performance. Close collaboration with cross-functional leaders is essential to align software decisions with the technical requirements of the infrastructure. Applicants for the Head of GPU Cloud position at the company should have a minimum of 12 years' of software engineering experience, with at least 5 years' in a leadership role. The ideal candidate will have a proven track record in operating large-scale model inference and a deep understanding of model serving optimization, Kubernetes, and containerized infrastructure. Experience in GPU cloud, AI infrastructure, and accelerated computing environments is highly valued. The role requires a leader with strong technical and leadership judgment, capable of balancing performance, reliability, security, and customer experience. Additional experience in areas such as elastic inference services, model customization workflows, and scaling engineering organizations in dynamic environments is a plus. The Head of GPU Cloud will be expected to establish engineering standards, lead the team in incident readiness, and recruit and develop senior technical talent. Functions Engineering