Senior AI Engineer - AI Evaluation Environments
HR Home · Tel Aviv-Yafo
תיאור המשרה
About the role
The company is looking for a Senior AI Engineer to design, build and scale advanced AI evaluation and training environments. You will create realistic, interactive environments that simulate real-world systems and scenarios, so that AI agents can be tested, evaluated and improved. The role combines strong backend engineering with an interest in AI, reinforcement learning and complex system design, and involves working closely with AI researchers to turn research concepts into production-ready systems.
Key responsibilities
- Design and build end-to-end environments for training and evaluating AI agents, including simulated systems, scenarios and automated evaluation mechanisms.
- Develop environments for tool-use, web and computer-use agents.
- Ensure environments are secure, isolated, reliable and resistant to unintended shortcuts or reward manipulation.
- Analyze agent execution traces to find weaknesses, unexpected behavior and improvement opportunities.
- Design evaluation systems that assess the quality, reliability and effectiveness of AI training tasks, and set quality standards focused on realism, accuracy and training value.
- Improve evaluation mechanisms based on research findings, user feedback and model performance.
- Build and scale infrastructure for running AI environments and evaluation pipelines, including queue-driven execution systems, isolated execution environments and scalable grading mechanisms.
- Package and integrate environments into external training and evaluation pipelines.
- Work with AI researchers to translate research ideas into functional environments, and use evaluation insights to improve environment design.
- Take part in technical design reviews, code reviews and engineering best practices.
Required profile
- 6+ years of experience as a Backend Engineer building and maintaining production systems.
- BSc in Computer Science or a related field, preferably from a leading university.
- Academic background in AI or Machine Learning, including a degree, thesis or research experience.
- Hands-on experience building AI-powered applications using LLMs, agents or evaluation frameworks.
- Proven ability to own systems end-to-end, from architecture and design through production.
- High level of autonomy and ability to solve complex, undefined problems independently.
- Fluent written and spoken English.
Required skills
- Strong Python skills and hands-on production experience with Docker, Kubernetes and cloud infrastructure (AWS preferred).
- Experience designing distributed systems and working with message queues.
Questions fréquentes
מדוע אתם מדווחים על ההצעה הזו?
Explore further
Salaries, guides and searches for ישראל.
Salary: Senior DevOps Engineer Based on 16 job offers in ישראלSalaries by job title
הגש בקשה ב-30 שניות
הזינו את המייל שלכם כדי להגיש בקשה. חשבון יווצר אוטומטית.
בהמשך, אתם מסכימים לתנאי השימוש שלנו.
כבר יש לכם חשבון? התחברות
Une question sur cette offre ?
Posez-la ici : vous recevrez le récapitulatif de l'offre par e-mail, tout de suite.
מתפרסם לפני 6 שעות
תפוגה בעוד חודש מעכשיו
1 צפיות · 0 interested
הגדל את סיכוייך
העלה את קורות החיים שלך: אנו מציעים לך מודעות תואמות לפרופיל שלך.
מנתח את קורות החיים שלך...
HR Home
Tel Aviv-Yafo
הצעות דומות
-
Solutions Architect, Cloud Identity Security
Silverfort Tel Aviv-Yafo -
Senior Solutions Architect - Pre-Sales (Tel Aviv)
MongoDB Tel Aviv-Yafo -
Technical Solutions Consultant, gTech Ads Sellside
Google Tel Aviv-Yafo -
Configuration Manager - Live Game Events
lnw -
E-commerce Manager (Shopify)
BOA Ideas - Shopify Platinum agency Kfar Saba