28 lines
760 B
Plaintext
28 lines
760 B
Plaintext
Benchmark Run: 20250314_111430
|
||
Server: http://localhost:11434
|
||
|
||
CPU Information:
|
||
python_version: 3.10.16.final.0 (64 bit)
|
||
cpuinfo_version: [9, 0, 0]
|
||
cpuinfo_version_string: 9.0.0
|
||
arch: ARM_8
|
||
bits: 64
|
||
count: 10
|
||
arch_string_raw: arm64
|
||
brand_raw: Apple M1 Pro
|
||
|
||
Benchmark Results:
|
||
|
||
[38;5;147m[1m🏆 Final Model Leaderboard:[0m
|
||
|
||
[1m[38;5;221molmo2:13b-1124-instruct-q4_K_M[0m
|
||
[1mOverall Success Rate:[0m 81.9% (59/72 cases)
|
||
[1mAverage Tokens/sec:[0m 9.16 (8.49 - 9.16)
|
||
[1mAverage Duration:[0m 27.80s
|
||
[1mMin/Max Avg Duration:[0m 9.97s / 27.80s
|
||
[1mTest Results:[0m
|
||
- Fibonacci: ❌ 5/18 cases (27.8%)
|
||
- Binary Search: ✅ 18/18 cases (100.0%)
|
||
- Palindrome: ✅ 18/18 cases (100.0%)
|
||
- Anagram Check: ✅ 18/18 cases (100.0%)
|