Toolathlon is a benchmark to assess language agents' general tool use in realistic environments. It features 600+ diverse tools based on real-world software environments. Each task requires ...
03/10: Added support for latest transformer versions, which support Llama 3.1, 3.2 and other latest models. Expanded support to evaluate any LLM2vec model, check mteb_eval_custom.py 04/07: Added ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results