AI Architect

About the role

RealHires is building the intelligence layer of a global talent marketplace. We need an AI Architect to own and evolve the AI pre‑vetting engine that evaluates remote candidates at scale.

Key responsibilities

• Architect, develop, and operate the AI pre‑vetting engine, including prompts, scoring logic, and data pipelines.
• Design production‑grade prompts that deliver structured, accurate, and cost‑efficient outputs.
• Build and maintain evaluation frameworks, test sets, QA loops, and performance metrics to ensure AI decisions are reliable.
• Make strategic architectural decisions across models, APIs, and build‑vs‑buy options.
• Scale solutions for text, audio, and video data while optimizing latency and cost.
• Collaborate directly with the Founder and a small engineering team to shape the future of AI at RealHires.

Required profile

• Proven experience shipping LLM‑based systems used by real users in production.
• Deep expertise in prompt engineering, including structured outputs and failure handling.
• Experience building AI evaluation frameworks and validating model performance with metrics.
• Strong understanding of API design, data flow architecture, latency, and cost optimization.
• Excellent communication skills for explaining technical concepts to non‑technical stakeholders.

Required skills

• LLM systems development
• Prompt engineering
• Structured output design
• Model selection
• AI evaluation frameworks
• Testing and metrics
• API design
• Data flow architecture
• Latency optimization
• Cost optimization
• Speech‑to‑text pipelines
• Video analysis pipelines

What we offer

• Full‑time remote position with flexible hours.
• Minimum 4 hours daily overlap with US Eastern Time.
• Competitive compensation based on region.
• Opportunity to shape AI strategy in a fast‑growing, bootstrapped company.