Pleiades efficiency benchmark beta alone: 3/3 iterations orchestra + beta: 3/3 iterations at 2026-10-29T17:07:15.191Z, shop seed 1, 3 iterations of every case (averages below), cost: each call at its model's OpenRouter price, a model without one at $0.05 in / $0.08 out per 1M tokens setup beta alone: mistralai/voxtral-small-24b-2507, temperature 0 orchestra + beta: beta-text: mistralai/voxtral-small-24b-2507, temperature 0 delta-function-call: meta-llama/llama-3.1-8b-instruct, temperature 0 gamma-decision: perplexity/pplx-decider-v1.2, temperature n/a alpha-understand: mistralai/voxtral-small-24b-2507, temperature 0 metric beta alone orchestra + beta case runs 42 42 errors 0 0 success 64% 100% latency p50 1.26 s 2.17 s latency mean 1.25 s 2.19 s steps / case 2.3 6.3 model calls 1.6 4.3 tool calls 0.6 2.0 input tokens / iteration 9649 37880 output tokens / iteration 655 1487 cost / iteration $0.001161 $0.003514 cost / success $0.000129 $0.000251 tokens of beta alone: every call of the model (usage of each step) tokens of orchestra + beta: every model call of the request (Laya, delta, alpha-understand, beta) from /v1/admin/requests == beta alone case ok errors time model tools tokens reply / error add-one 3/3 0 1.57 s 2.0 1.0 885 What else can I help you with? add-count 3/3 0 1.46 s 2.0 1.0 901 What else can I help you with? add-list 0/3 0 0.81 s 1.0 0.0 448 I'm sorry, but I currently don't have the ability to access or modify your cart. However, I can help price 0/3 0 0.97 s 1.0 0.0 435 I'm sorry, but I don't have the capability to check the price of Tasty Granite Salad. You might want remove-one 3/3 0 1.25 s 2.0 1.0 873 Handmade Plastic Bacon removed from your cart. remove-all 0/3 0 0.84 s 1.0 0.0 425 I'm sorry, but I don't have the ability to access or modify your cart. If you need assistance with t out-of-stock 3/3 0 1.79 s 2.0 1.0 894 I'm sorry, the Small Metal Shirt is currently out of stock. add-one-ru 3/3 0 1.35 s 2.0 1.0 897 Добавлено: 1 × Handmade Plastic Bacon. add-count-ru 3/3 0 1.29 s 2.0 1.0 916 Добавлено: 3 × Handcrafted Marble Gloves. add-list-ru 3/3 0 1.78 s 2.0 1.0 1002 Что еще? price-ru 0/3 0 0.70 s 1.0 0.0 426 I'm sorry, but I don't have the necessary tools to provide the price of Tasty Granite Salad. Is ther remove-one-ru 3/3 0 1.26 s 2.0 1.0 878 Handmade Plastic Bacon удален из корзины. remove-all-ru 0/3 0 0.69 s 1.0 0.0 426 I'm sorry, but I don't have the ability to access or modify your shopping cart. If you need help wit out-of-stock-ru 3/3 0 1.71 s 2.0 1.0 898 К сожалению, Small Metal Shirt отсутствует. == orchestra + beta case ok errors time model tools tokens reply / error add-one 3/3 0 2.05 s 5.0 2.0 3170 Handmade Plastic Bacon added to your cart. add-count 3/3 0 2.37 s 5.0 2.0 3217 Handcrafted Marble Gloves added to your cart. add-list 3/3 0 3.56 s 6.0 4.0 3832 Your items have been added to the cart. price 3/3 0 2.10 s 4.0 1.0 2871 The Tasty Granite Salad costs $206.59. remove-one 3/3 0 1.81 s 4.0 1.0 2560 Handmade Plastic Bacon has been removed from your cart. remove-all 3/3 0 1.15 s 2.0 3.0 1390 Removed from your cart: 1 × Handmade Marble Car, 2 × Small Steel Bike. out-of-stock 3/3 0 2.17 s 4.0 1.0 2642 The Small Metal Shirt is out of stock. Try adding another item to your cart. 1. Small Steel Bike 2. add-one-ru 3/3 0 2.36 s 5.0 2.0 3178 Товар добавлен в корзину. add-count-ru 3/3 0 2.29 s 5.0 2.0 3221 Handcrafted Marble Gloves добавлены в корзину. add-list-ru 3/3 0 2.92 s 6.0 4.0 3816 Ваш заказ добавлен в корзину. price-ru 3/3 0 2.43 s 4.0 1.0 2864 Tasty Granite Salad стоит $206.59. remove-one-ru 3/3 0 2.32 s 4.0 1.0 2566 Handmade Plastic Bacon удален из корзины. remove-all-ru 3/3 0 0.62 s 2.0 3.0 1386 Убрал из корзины: 1 × Handmade Marble Car, 2 × Small Steel Bike. out-of-stock-ru 3/3 0 2.47 s 4.0 1.0 2654 К сожалению, Small Metal Shirt отсутствует на складе. Попробуйте добавить в корзину один из следующи