Software Engineering Manager – Cloud TPU

About the role

Google Cloud is looking for a Software Engineering Manager to lead the team that builds and operates critical TPU‑based services for AI customers worldwide. You will drive the architecture and execution of large‑scale machine‑learning infrastructure, from chip‑level optimizations to fleet‑wide deployments.

Key responsibilities

• Build, mentor, and inspire a high‑performance software engineering team.
• Define project goals, contribute to product strategy, and manage a large product budget.
• Oversee deployment of large‑scale ML infrastructure across multiple sites internationally.
• Solve complex ML infrastructure challenges and drive technical strategy.
• Collaborate directly with customers to ensure successful solution landings.

Required profile

• Bachelor’s degree or equivalent practical experience.
• 8+ years of software development experience building distributed cloud services.
• 3+ years in an engineering management role, including hiring and team development.
• 2+ years of experience with LLM training or inference, performance optimization, and GPU/TPU acceleration.
• Preferred: Master’s or PhD in Computer Science and experience in a complex matrixed organization.

Required skills

• Distributed cloud services
• Large Language Model (LLM) training and inference
• Performance optimization and distributed execution
• GPU acceleration
• TPU acceleration
• PyTorch
• JAX
• TensorFlow