Director - Agentic Search & Data Infrastructure

About the role

We are looking for a Director to lead the development of our agentic web‑search AI product and the underlying data infrastructure that indexes and caches the web at massive scale. The role sits at the intersection of AI product leadership and high‑scale infrastructure, reporting to senior leadership and driving a small group of two engineering teams.

Key responsibilities

• Define technical and product strategy for an agentic web‑search system from research through production and scaling.
• Make architecture and build‑vs‑buy decisions for LLM‑based agents, evaluation frameworks and LLMOps pipelines.
• Lead and mentor two engineering teams, grow engineering managers and ensure delivery of both product features and infrastructure components.
• Scale the API surface from millions to billions of calls per month while maintaining reliability, cost‑efficiency and performance.
• Own the large‑scale data pipelines, storage, crawling, caching and indexing operations that keep the web index fresh and comprehensive.

Required profile

• 2+ years in an agentic AI or AI‑infrastructure company with a production AI product at scale.
• 10+ years leading high‑scale R&D infrastructure, having grown systems by an order of magnitude.
• 2+ years managing team leaders and developing engineering managers.
• Proven track record taking an AI product from early stage to a market‑leading position.

Required skills

• Deep hands‑on experience with large language models (LLMs) and agentic architectures.
• Expertise in evaluation/benchmarking, prompt and context engineering, and LLMOps.
• Strong background in high‑throughput, high‑availability infrastructure and cost‑performance optimisation.
• Experience with large‑scale data pipelines, storage systems, web‑scale crawling, caching and indexing.