Staff Applied AI Engineer - Managed Inference

About the role

Crusoe, a vertically integrated AI infrastructure company, is hiring a Staff Applied AI Engineer for its Managed Inference team in Tel Aviv. You will partner directly with strategic customers to deploy, optimize and scale their models into production, owning the technical journey from benchmark proof-of-concepts to production endpoints serving billions of tokens daily. The role bridges deep inference engineering with customer-facing technical leadership.

Key responsibilities

• Scope workloads, define metrics (TTFT, throughput, cost per token), build benchmarks and lead technical proof-of-concepts.
• Serve as technical lead for customer engineering teams through architecture reviews and rollout planning.
• Tune engines (KV cache, speculative decoding, parallelism, quantization) to meet performance targets.
• Profile and diagnose engine-level bottlenecks and deliver production fixes.
• Own end-to-end customer onboarding, deployment, autoscaling, capacity planning and SLO monitoring.
• Optimize configurations for base, custom and fine-tuned models to accelerate time to value.
• Feed field insights back into product roadmaps and contribute code to the inference engine and tooling.
• Publish reference architectures, cookbooks and technical blogs.

Required profile

• 5+ years in a technical role with strong programming and production skills (Kubernetes, Docker, GPU servers).
• Proven ability to lead technical discussions with customer engineers and leadership.
• Experience as an FDE, solutions engineer or inference engineer at an AI cloud, lab or provider.
• Hands-on background in fine-tuning/post-training (LoRA, SFT, DPO) or contributions to open-source engines.

Required skills

• Inference engines: vLLM, SGLang, TensorRT-LLM and performance profiling.
• Strong command of KV-cache tuning, batching, parallelism, quantization and related cost math.
• Solid knowledge of the open-source model landscape and hardware-model matching.

What we offer

• A competitive benefits package covering pension contributions and additional perks for work-life balance.