At Toloka AI we create data that powers leading GenAI models and innovations. We work with frontier labs, big tech, renowned AI startups, enterprises and non-profit research organizations worldwide. We use a combination of Experts + Crowd + Tech Platform to teach AI models to reason and evaluate their efficacy and safety. We have experts in more than 50 different domains—from doctors and lawyers to physicists and engineers—and boast one of the most diverse global crowds, representing over 100 countries and speaking 40+ languages. We are a well-funded startup with an enviable portfolio of clients including Anthropic, Amazon, Microsoft, poolside, Recraft, and Shopify.
Recently, we secured strategic investment led by Bezos Expeditions with participation from Mikhail Parakhin, CTO of Shopify and board advisor to leading GenAI companies, who now serves as our Chairman of the Board. Our remote-first team is globally distributed around the world: USA, UK, the Netherlands, Israel, Czech Republic, Serbia, and more. We are headquartered in Amsterdam.
About the role
We believe the future of work lies in effective AI–human collaboration, not in purely autonomous systems operating on their own.
That’s why we’re building Hybrid Agents – systems where AI and human experts work side-by-side, solve tasks together, and leverage each other’s strengths. From general-purpose tasks to highly specialized professional domains, our platform unites people and models, backed by state-of-the-art technology and a growing marketplace of expert talent.
As a Senior AI/ML Engineer, you will be a core contributor to the AI layer of our product.
What You’ll Work On
- Build agentic systems and develop skills such as search, browsing, coding, and more;
- Design and experiment with hybrid-execution mechanics, including human hand-off and result validation;
- Develop automated evaluations that measure system quality on real-world tasks;
- Research and integrate state-of-the-art techniques to improve core quality and agent skills;
- Develop and maintain production services;
- Contribute to agent infrastructure – tools, environments, and third-party integrations.
Qualifications
- 3+ years of industry experience in machine learning;
- Solid understanding of how modern deep-learning models work, including their strengths and limitations;
- Experience developing software and building products with language models;
- Strong engineering skills with proficiency in Python and commonly used ML frameworks;
- Proven track record of delivering ML-driven products.
Preferred but not required
- Experience building complex agentic systems;
- Experience designing or implementing evaluation metrics;
- Contributions to ML research projects;
- Fluency in English.
Ready to apply for this role?
Apply Now →
