Pleiades efficiency benchmark deepseek/deepseek-v4-flash: 1/1 iterations mistralai/mistral-small-2603: 1/1 iterations qwen/qwen3.7-flash: 1/1 iterations at 2026-10-29T08:00:10.547Z, shop seed 1, 1 iterations of every case (averages below), cost: each call at its model's OpenRouter price, a model without one at $0.05 in / $0.08 out per 1M tokens setup metric deepseek/deepseek-v4-flash mistralai/mistral-small-2603 qwen/qwen3.7-flash case runs 14 14 14 errors 0 0 0 success 100% 100% 100% latency p50 6.88 s 1.49 s 4.62 s latency mean 6.30 s 1.60 s 4.89 s steps / case 4.9 3.9 3.4 model calls 2.7 2.4 2.1 tool calls 2.1 1.5 1.3 input tokens / iteration 28843 14970 21504 output tokens / iteration 2377 741 3527 cost / iteration $0.003057 $0.002690 $0.001104 cost / success $0.000218 $0.000192 $0.000079 tokens of deepseek/deepseek-v4-flash: every call of the model (usage of each step) tokens of mistralai/mistral-small-2603: every call of the model (usage of each step) tokens of qwen/qwen3.7-flash: every call of the model (usage of each step) == deepseek/deepseek-v4-flash case ok errors time model tools tokens reply / error add-one 1/1 0 6.88 s 3.0 2.0 2231 Done! I've added 1 **Handmade Plastic Bacon** ($45.79) to your cart. add-count 1/1 0 5.40 s 3.0 2.0 2378 I've added 3 Handcrafted Marble Gloves to your cart for $62.99 each. Is there anything else you'd li add-list 1/1 0 10.52 s 3.0 4.0 3021 I've added the Handmade Marble Car, Small Steel Bike, and Tasty Granite Salad to your cart. price 1/1 0 6.90 s 2.0 1.0 1566 Tasty Granite Salad costs $206.59. remove-one 1/1 0 8.45 s 3.0 2.0 2500 I've removed Handmade Plastic Bacon from your cart. remove-all 1/1 0 7.91 s 3.0 3.0 2562 Your cart is now empty — I removed everything from it. out-of-stock 1/1 0 3.67 s 2.0 1.0 1360 The **Small Metal Shirt** is unfortunately **out of stock** at $82.49, so I'm unable to add it to yo add-one-ru 1/1 0 3.87 s 3.0 2.0 2274 Готово! Я добавил Handmade Plastic Bacon в вашу корзину. add-count-ru 1/1 0 7.70 s 3.0 2.0 2649 Готово: добавил 3 Handcrafted Marble Gloves в корзину. add-list-ru 1/1 0 6.93 s 3.0 4.0 3238 Готово! Я добавил в корзину Handmade Marble Car, Small Steel Bike и Tasty Granite Salad. price-ru 1/1 0 3.63 s 2.0 1.0 1340 Tasty Granite Salad стоит **$206.59**. remove-one-ru 1/1 0 3.30 s 3.0 2.0 2138 Готово! Handmade Plastic Bacon удалён из вашей корзины. remove-all-ru 1/1 0 9.17 s 3.0 3.0 2293 Корзина очищена. Все товары удалены. out-of-stock-ru 1/1 0 3.92 s 2.0 1.0 1670 К сожалению, «Small Metal Shirt» сейчас нет в наличии (out of stock), поэтому я не могу добавить его == mistralai/mistral-small-2603 case ok errors time model tools tokens reply / error add-one 1/1 0 1.96 s 3.0 2.0 1495 I've added **Handmade Plastic Bacon** to your cart. add-count 1/1 0 1.44 s 2.0 1.0 899 Done! Three Handcrafted Marble Gloves have been added to your cart. add-list 1/1 0 1.58 s 2.0 1.0 1006 Done! I've added one Handmade Marble Car, one Small Steel Bike, and one Tasty Granite Salad to your price 1/1 0 1.49 s 2.0 1.0 956 The **Tasty Granite Salad** costs **$206.59**. remove-one 1/1 0 2.13 s 2.0 1.0 866 Le produit "Handmade Plastic Bacon" a été retiré de votre panier. remove-all 1/1 0 1.91 s 3.0 3.0 1391 Your cart is now empty. out-of-stock 1/1 0 1.22 s 2.0 1.0 944 I'm sorry, but the **Small Metal Shirt** is currently out of stock. Would you like to add a differen add-one-ru 1/1 0 1.75 s 3.0 2.0 1510 Товар "Handmade Plastic Bacon" добавлен в корзину. add-count-ru 1/1 0 1.36 s 2.0 1.0 906 В корзину добавлено 3 пары Handcrafted Marble Gloves. add-list-ru 1/1 0 1.29 s 2.0 1.0 994 Товары добавлены в корзину. price-ru 1/1 0 1.13 s 2.0 1.0 954 Tasty Granite Salad стоит 206,59 долларов США. remove-one-ru 1/1 0 1.28 s 2.0 1.0 871 Готово! Handmade Plastic Bacon удалён из корзины. remove-all-ru 1/1 0 1.89 s 3.0 3.0 1400 Всё удалено из корзины. out-of-stock-ru 1/1 0 1.92 s 3.0 2.0 1519 Товар "Small Metal Shirt" временно недоступен, поэтому я не смог добавить его в корзину. == qwen/qwen3.7-flash case ok errors time model tools tokens reply / error add-one 1/1 0 4.19 s 2.0 1.0 1582 I have added 1 Handmade Plastic Bacon to your cart. add-count 1/1 0 6.43 s 2.0 1.0 1848 I've added 3 Handcrafted Marble Gloves to your cart. add-list 1/1 0 4.86 s 2.0 1.0 1770 I've added 1 Handmade Marble Car, 1 Small Steel Bike, and 1 Tasty Granite Salad to your cart. price 1/1 0 3.68 s 2.0 1.0 1542 Tasty Granite Salad costs $206.59. remove-one 1/1 0 4.28 s 2.0 1.0 1556 Handmade Plastic Bacon has been removed from your cart. remove-all 1/1 0 5.38 s 3.0 3.0 2514 I've removed all items from your cart. It is now empty. out-of-stock 1/1 0 3.74 s 2.0 1.0 1586 I'm sorry, but the Small Metal Shirt is currently out of stock and cannot be added to your cart. add-one-ru 1/1 0 5.79 s 2.0 1.0 1556 Товар "Handmade Plastic Bacon" добавлен в корзину. add-count-ru 1/1 0 5.61 s 2.0 1.0 1824 Товар «Handcrafted Marble Gloves» (3 шт.) успешно добавлен в вашу корзину. add-list-ru 1/1 0 4.62 s 2.0 1.0 1812 Я добавил в корзину: Handmade Marble Car, Small Steel Bike и Tasty Granite Salad. price-ru 1/1 0 4.52 s 2.0 1.0 1624 Стоимость Tasty Granite Salad составляет $206.59. remove-one-ru 1/1 0 5.87 s 2.0 1.0 1710 Я убрал Handmade Plastic Bacon из корзины. remove-all-ru 1/1 0 5.20 s 3.0 3.0 2546 Корзина очищена. out-of-stock-ru 1/1 0 4.30 s 2.0 1.0 1561 К сожалению, товар "Small Metal Shirt" отсутствует на складе и не может быть добавлен в корзину.