Senior Machine Learning Performance Engineer

About the role

Amazon’s Annapurna Labs team is building the next generation of AI infrastructure on AWS Neuron, powering Generative AI and advanced ML workloads on custom accelerators. As a Senior ML Performance Engineer you will shape the performance engineering group from the ground up and drive end‑to‑end system efficiency.

Key responsibilities

• Optimize performance across the full ML software stack, from high‑level frameworks to low‑level hardware.
• Analyze and profile demanding ML workloads running on Inferentia and Trainium accelerators.
• Develop high‑performance kernels for critical ML operations.
• Enhance the Neuron SDK to improve developer experience and system capabilities.
• Collaborate with compiler, framework, and hardware teams to maximize end‑to‑end performance.
• Work on instruction scheduling, memory management, parallelism, and compiler enhancements.

Required profile

• Proven experience in performance engineering for machine‑learning systems.
• Strong problem‑solving skills and ability to work in a fast‑paced, startup‑like environment.
• Excellent communication and cross‑functional collaboration abilities.

Required skills

• AWS Neuron
• Inferentia and Trainium accelerators
• Kernel development and optimization
• Compiler optimization techniques
• Performance analysis and profiling tools

What we offer

• Opportunity to influence a core engineering team at a global scale.
• Access to cutting‑edge AI hardware and software stack.
• Collaborative, high‑impact environment in Tel Aviv.