Senior AI Engineer - AI Evaluation Environments
HR Home · Tel Aviv-Yafo
وصف الوظيفة
About the role
The company is looking for a Senior AI Engineer to design, build and scale advanced AI evaluation and training environments. You will create realistic, interactive environments that simulate real-world systems and scenarios, so that AI agents can be tested, evaluated and improved. The role combines strong backend engineering with an interest in AI, reinforcement learning and complex system design, and involves working closely with AI researchers to turn research concepts into production-ready systems.
Key responsibilities
- Design and build end-to-end environments for training and evaluating AI agents, including simulated systems, scenarios and automated evaluation mechanisms.
- Develop environments for tool-use, web and computer-use agents.
- Ensure environments are secure, isolated, reliable and resistant to unintended shortcuts or reward manipulation.
- Analyze agent execution traces to find weaknesses, unexpected behavior and improvement opportunities.
- Design evaluation systems that assess the quality, reliability and effectiveness of AI training tasks, and set quality standards focused on realism, accuracy and training value.
- Improve evaluation mechanisms based on research findings, user feedback and model performance.
- Build and scale infrastructure for running AI environments and evaluation pipelines, including queue-driven execution systems, isolated execution environments and scalable grading mechanisms.
- Package and integrate environments into external training and evaluation pipelines.
- Work with AI researchers to translate research ideas into functional environments, and use evaluation insights to improve environment design.
- Take part in technical design reviews, code reviews and engineering best practices.
Required profile
- 6+ years of experience as a Backend Engineer building and maintaining production systems.
- BSc in Computer Science or a related field, preferably from a leading university.
- Academic background in AI or Machine Learning, including a degree, thesis or research experience.
- Hands-on experience building AI-powered applications using LLMs, agents or evaluation frameworks.
- Proven ability to own systems end-to-end, from architecture and design through production.
- High level of autonomy and ability to solve complex, undefined problems independently.
- Fluent written and spoken English.
Required skills
- Strong Python skills and hands-on production experience with Docker, Kubernetes and cloud infrastructure (AWS preferred).
- Experience designing distributed systems and working with message queues.
Questions fréquentes
لماذا تبلغ عن هذا العرض؟
اكتشف المزيد
الرواتب والأدلة وعمليات البحث في Israel.
الراتب: Senior DevOps Engineer استنادًا إلى 16 عرض عمل في Israelالرواتب حسب المهنة
قدم طلبك في 30 ثانية
أدخل بريدك الإلكتروني للتقديم. سيتم إنشاء حساب تلقائياً.
بالمتابعة، أنت توافق على شروط الاستخدام.
لديك حساب بالفعل؟ تسجيل الدخول
لديك سؤال حول هذا العرض؟
اطرحه هنا: ستصلك تفاصيل العرض كاملة عبر البريد الإلكتروني، فوراً.
عزز فرصك
حمّل سيرتك الذاتية وسنقترح عليك الوظائف التي تناسب ملفك.
جاري تحليل سيرتك الذاتية...
HR Home
Tel Aviv-Yafo
عروض عمل ذات صلة
-
Solutions Architect, Cloud Identity Security
Silverfort Tel Aviv-Yafo -
Senior Solutions Architect - Pre-Sales (Tel Aviv)
MongoDB Tel Aviv-Yafo -
Technical Solutions Consultant, gTech Ads Sellside
Google Tel Aviv-Yafo -
Configuration Manager - Live Game Events
lnw -
E-commerce Manager (Shopify)
BOA Ideas - Shopify Platinum agency Kfar Saba