Results for macOS
| system | cpu | gpu | memory | os_version | ollama_version | model_name | throughput |
|---|---|---|---|---|---|---|---|
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | mistral:7b | 13.13 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | gemma:2b | 29.1 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | gemma:7b | 10.6 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llama2:7b | 13.7 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llama2:13b | 7.41 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llava:7b | 13.64 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llava:13b | 7.48 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | mistral:7b | 35.71 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | gemma:2b | 77.18 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | gemma:7b | 29.17 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llama2:7b | 36.68 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llama2:13b | 20.54 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llava:7b | 37.51 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llava:13b | 21 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | mistral:7b | 35.81 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | gemma:2b | 77.52 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | gemma:7b | 29.27 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llama2:7b | 36.62 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llama2:13b | 20.62 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llava:7b | 37.09 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llava:13b | 20.98 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.30 | mistral:7b | 50.62 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.30 | gemma:2b | 107.65 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.30 | gemma:7b | 42.84 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.30 | llama2:7b | 52.71 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.30 | llama2:13b | 30.16 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.30 | llava:7b | 48.89 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.30 | llava:13b | 28.43 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.30 | llama2:13b | 11.13 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.30 | gemma:7b | 14.68 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.30 | mistral:7b | 18.18 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.30 | llama2:7b | 20.53 |
| macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.1.30 | mistral:7b | 19.65 |
| macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.1.30 | gemma:2b | 45.07 |
| macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.1.30 | gemma:7b | 14.69 |
| macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.1.30 | llama2:7b | 16.8 |
| macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.1.30 | llama2:13b | 8.43 |
| macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.1.30 | llava:7b | 16.52 |
| macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.1.30 | llava:13b | 9.06 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.30 | mistral:7b | 88.03 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.30 | gemma:2b | 165 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.30 | gemma:7b | 79.19 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.30 | llama2:7b | 89.54 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.30 | llama2:13b | 54.83 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.30 | llava:7b | 92.52 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.30 | llava:13b | 55.87 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:2b | 28.84 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:2b | 28.67 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:7b | 10.73 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | codegemma:2b | 29.24 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | mistral:7b | 13.07 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | mistral:7b | 57.2 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:2b | 113.61 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:7b | 48.59 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llama2:7b | 58.46 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llama2:13b | 34.85 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llava:7b | 59.48 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llava:13b | 35.29 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | mistral:7b | 60.48 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:2b | 120.69 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:7b | 50.42 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llama2:7b | 61.65 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llama2:13b | 36.05 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llava:7b | 62.51 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llava:13b | 36.66 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.31 | mistral:7b | 51.25 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.31 | gemma:2b | 101.45 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.31 | gemma:7b | 43.83 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.31 | llama2:7b | 52.4 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.31 | llama2:13b | 22.35 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.31 | llava:7b | 41.26 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.31 | llava:13b | 25.48 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.31 | mistral:7b | 33.29 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.31 | gemma:2b | 73.3 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.31 | gemma:7b | 27.51 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.31 | llama2:7b | 34.32 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.31 | llama2:13b | 19.17 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.31 | llava:7b | 34.85 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.31 | llava:13b | 19.74 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | mistral:7b | 36.12 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | mistral:7b | 32.97 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | gemma:2b | 72.53 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | gemma:7b | 27.09 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llama2:7b | 33.76 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llama2:13b | 18.78 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llava:7b | 34.16 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llava:13b | 18.76 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | mistral:7b | 30.12 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:2b | 75.7 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:7b | 24.14 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:7b | 31.37 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:13b | 17.56 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:7b | 36.95 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:13b | 17.85 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | mistral:7b | 31.5 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:2b | 82.54 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:7b | 25.9 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:7b | 31.88 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:13b | 18.24 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:7b | 32.7 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:13b | 18.44 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | mistral:7b | 31.55 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:2b | 78.52 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:7b | 25.75 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:7b | 31.88 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:13b | 18.24 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:7b | 27.55 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:13b | 18.05 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | mistral:7b | 8.24 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:2b | 29.11 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:7b | 11.3 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | llama2:7b | 8.89 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | llama2:13b | 4.93 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | llava:7b | 10.93 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | llava:13b | 6.07 |
| macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.1.31 | mistral:7b | 65.46 |
| macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.1.31 | llama3:8b | 60.55 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.32 | llama2:7b | 20.11 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | mistral:7b | 31.9 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | gemma:2b | 72.68 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | gemma:7b | 25.78 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llama2:7b | 33.16 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llama2:13b | 16.66 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llava:7b | 33.8 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llava:13b | 18.39 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | mistral:7b | 33.94 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | gemma:2b | 73.88 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | gemma:7b | 28.3 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llama2:7b | 34.81 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llama2:13b | 19.59 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llava:7b | 35.33 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llava:13b | 19.63 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | mistral:7b | 60.51 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llama3:8b | 54.64 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | phi3:3.8b | 69.57 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | gemma:2b | 117.46 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | gemma:7b | 50.72 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llava:7b | 62.75 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llava:13b | 37.13 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | mistral:7b | 59.38 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:2b | 126.09 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:7b | 50.35 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:7b | 60.6 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:13b | 34.83 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:7b | 61.7 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:13b | 35.53 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | mistral:7b | 28.94 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | gemma:2b | 59.85 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | gemma:7b | 20.63 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | llama2:7b | 19.5 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | llama2:13b | 12.88 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | llava:7b | 30 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | llava:13b | 13.34 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | llama3:8b-instruct-q8_0 | 22.05 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | llama3:8b | 27.79 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.32 | mistral:7b | 13.16 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.32 | llama3:8b | 11.92 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.32 | phi3:3.8b | 19.74 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.32 | gemma:2b | 29.23 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.32 | gemma:7b | 10.74 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.32 | llava:7b | 13.53 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.32 | llava:13b | 7.57 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-31-g4c241e36 | mistral:7b | 62.63 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-31-g4c241e36 | llama3:8b | 53.75 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-31-g4c241e36 | phi3:3.8b | 79.23 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-31-g4c241e36 | gemma:2b | 118.32 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-31-g4c241e36 | gemma:7b | 51.6 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-31-g4c241e36 | llava:7b | 65.91 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-31-g4c241e36 | llava:13b | 38.45 |
| macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | mistral:7b | 36.05 |
| macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llama3:8b | 32.61 |
| macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | phi3:3.8b | 49.67 |
| macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:2b | 76.69 |
| macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:7b | 29.67 |
| macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llava:7b | 37.64 |
| macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llava:13b | 20.99 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | mistral:7b | 31.43 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llama3:8b | 30.74 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | phi3:3.8b | 42.33 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | gemma:2b | 75.51 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | gemma:7b | 28.14 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llava:7b | 35.17 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llava:13b | 19.8 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-13-gae4d5086 | mistral:7b | 65.13 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-13-gae4d5086 | llama3:8b | 57.58 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-13-gae4d5086 | phi3:3.8b | 80.14 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-13-gae4d5086 | gemma:2b | 114.57 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-13-gae4d5086 | gemma:7b | 50.92 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-13-gae4d5086 | llava:7b | 65.93 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-13-gae4d5086 | llava:13b | 37.84 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.33 | mistral:7b | 57.01 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.33 | llama3:8b | 52.02 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.33 | phi3:3.8b | 67.18 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.33 | gemma:2b | 111.19 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.33 | gemma:7b | 48.04 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.33 | llava:7b | 58.78 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.33 | llava:13b | 32.22 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | mistral:7b | 53.27 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:2b | 110.88 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:7b | 39.99 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:7b | 49.7 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:13b | 29.1 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:7b | 53.9 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:13b | 29.66 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.39 | mistral:7b | 56.73 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.39 | llama3:8b | 51.14 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.39 | phi3:3.8b | 59.15 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.39 | gemma:2b | 105.09 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.39 | gemma:7b | 43.36 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.39 | llava:7b | 58.43 |
| macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.39 | llava:13b | 34.39 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | mistral:7b | 59.46 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | llama3:8b | 52.58 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | phi3:3.8b | 72.56 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:2b | 115.15 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:7b | 48.22 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:7b | 61.25 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:13b | 35.23 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | mistral:7b | 59.43 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | llama3:8b | 51.98 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | phi3:3.8b | 72.32 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:2b | 112.26 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:7b | 46.34 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:7b | 61.53 |
| macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:13b | 34.16 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.34 | mistral:7b | 32.84 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.34 | llama3:8b | 29.87 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.34 | phi3:3.8b | 39.7 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.34 | gemma:2b | 71.56 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.34 | gemma:7b | 27.03 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.34 | llava:7b | 34.19 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.34 | llava:13b | 19.32 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.39 | mistral:7b | 12.85 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.39 | llama3:8b | 11.81 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.39 | phi3:3.8b | 18.28 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.39 | gemma:2b | 28.64 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.39 | gemma:7b | 10.58 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.39 | llava:7b | 13.17 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.39 | llava:13b | 7.25 |
| macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.34 | mistral:7b | 12.96 |
| macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.34 | llama3:8b | 5.7 |
| macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.34 | phi3:3.8b | 16.09 |
| macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.34 | gemma:2b | 27.88 |
| macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.34 | gemma:7b | 0.18 |
| macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.34 | llava:7b | 9.33 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | mistral:7b | 59.85 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llama3:8b | 55.27 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | phi3:3.8b | 73.4 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:2b | 127.16 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:7b | 50.6 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:7b | 61.27 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:13b | 35.62 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | mistral:7b | 60.2 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llama3:8b | 55.26 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | phi3:3.8b | 73.07 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:2b | 127.78 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:7b | 50.61 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:7b | 62.6 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:13b | 35.77 |
| macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | mistral:7b | 13.13 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.37 | mistral:7b | 55.44 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.37 | llama3:8b | 52.04 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.37 | phi3:3.8b | 67.86 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.37 | gemma:2b | 112.65 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.37 | gemma:7b | 41.58 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.37 | llava:7b | 52.45 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.37 | llava:13b | 30.18 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.38-5-gf2cf97d | mistral:7b | 60.65 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.38-5-gf2cf97d | llama3:8b | 53.29 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.38-5-gf2cf97d | phi3:3.8b | 65.61 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.38-5-gf2cf97d | gemma:2b | 102.33 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.38-5-gf2cf97d | gemma:7b | 47.91 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.38-5-gf2cf97d | llava:7b | 65.76 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.38-5-gf2cf97d | llava:13b | 37.32 |
| macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.37 | mistral:7b | 20.04 |
| macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.37 | llama3:8b | 17.53 |
| macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.37 | phi3:3.8b | 29.17 |
| macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.37 | gemma:2b | 45.61 |
| macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.37 | gemma:7b | 0.23 |
| macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.37 | llava:7b | 20.02 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | mistral:7b | 64.92 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | llama3:8b | 57.53 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | phi3:3.8b | 82.64 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | gemma:2b | 123.08 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | gemma:7b | 53.14 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | llava:7b | 66.54 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | llava:13b | 38.9 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | mistral:7b | 60.39 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | llama3:8b | 54.45 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | phi3:3.8b | 72.55 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | gemma:2b | 125.43 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | gemma:7b | 50.67 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | llava:7b | 62.34 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | llava:13b | 35.77 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | mistral:7b | 59.78 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | llama3:8b | 54.42 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | phi3:3.8b | 70.79 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | gemma:2b | 125.46 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | gemma:7b | 50.38 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | llava:7b | 61.46 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | llava:13b | 35.6 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | mistral:7b | 59.79 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llama3:8b | 54.93 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | phi3:3.8b | 73.06 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:2b | 127.04 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:7b | 50.56 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:7b | 61.97 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:13b | 35.61 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.38 | mistral:7b | 35.21 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.38 | llama3:8b | 30.52 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.38 | phi3:3.8b | 41.48 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.38 | gemma:2b | 69.86 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.38 | gemma:7b | 27.78 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.38 | llava:7b | 36.19 |
| macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.38 | llava:13b | 20.18 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | mistral:7b | 18.91 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | llama3:8b | 17.88 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | phi3:3.8b | 29.05 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | gemma:2b | 46.18 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | gemma:7b | 16.31 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | llava:7b | 20.7 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | llava:13b | 10.83 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.37 | mistral:7b | 19.16 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.37 | llama3:8b | 16.61 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.37 | phi3:3.8b | 23.4 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.37 | gemma:2b | 40.23 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.37 | gemma:7b | 12.35 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.37 | llava:7b | 14 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.37 | llava:13b | 6.72 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | mistral:7b | 61.48 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llama3:8b | 54.99 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | phi3:3.8b | 78.17 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | gemma:2b | 121.51 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | gemma:7b | 51.11 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llava:7b | 63.59 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llava:13b | 37.57 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | mistral:7b | 59.78 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llama3:8b | 55.37 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | phi3:3.8b | 73.03 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:2b | 128.27 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:7b | 50.61 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:7b | 62.77 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:13b | 35.83 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.1.38 | mistral:7b | 85.89 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.1.38 | llama3:8b | 79.33 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.1.38 | phi3:3.8b | 99.98 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.1.38 | gemma:2b | 163.63 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.1.38 | gemma:7b | 78.65 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.1.38 | llava:7b | 89.17 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.1.38 | llava:13b | 54.72 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | mistral:7b | 28.74 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | llama3:8b | 26.57 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | phi3:3.8b | 43.02 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | gemma:2b | 65.72 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | gemma:7b | 24.23 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | llava:7b | 29.31 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | llava:13b | 16.39 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | mistral:7b | 75.06 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | llama3:8b | 64.64 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | phi3:3.8b | 107.43 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | gemma:2b | 134.7 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | gemma:7b | 60.79 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | llava:7b | 77.4 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | llava:13b | 13.15 |
| macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | phi3:3.8b | 26.82 |
| macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.1.31 | llama3:8b | 60.42 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | mistral:7b | 61.38 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llama3:8b | 55.45 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | phi3:3.8b | 78.27 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | gemma:2b | 121.41 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | gemma:7b | 51.74 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llava:7b | 62.84 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llava:13b | 37.16 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | mistral:7b | 17.6 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | llama3:8b | 10.45 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | phi3:3.8b | 14.43 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | gemma:2b | 37.98 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | gemma:7b | 13.12 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | llava:7b | 19.12 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | llava:13b | 7.3 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | mistral:7b | 28.16 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | llama3:8b | 26.32 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | phi3:3.8b | 42.77 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | gemma:2b | 65.3 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | gemma:7b | 24.14 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | llava:7b | 29.52 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | llava:13b | 16.79 |
| macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | llama3:8b | 11.98 |
| macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | phi3:3.8b | 19.18 |
| macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:2b | 29.15 |
| macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:7b | 9.83 |
| macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.1.41 | mistral:7b | 74.79 |
| macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.1.41 | llama3:8b | 68.42 |
| macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.1.41 | phi3:3.8b | 69.59 |
| macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.1.41 | gemma:2b | 131.64 |
| macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.1.41 | gemma:7b | 66.73 |
| macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.1.41 | llava:7b | 74.96 |
| macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.1.41 | llava:13b | 50.3 |
| macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | llava:7b | 11.41 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.41 | mistral:7b | 84.74 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.41 | llama3:8b | 79.09 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.41 | phi3:3.8b | 86.1 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.41 | gemma:2b | 160.76 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.41 | gemma:7b | 77.69 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.41 | llava:7b | 88.77 |
| macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.41 | llava:13b | 54.64 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | mistral:7b | 61.35 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llama3:8b | 54.79 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | phi3:3.8b | 70.54 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | mistral:7b | 12.9 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | llama3:8b | 11.92 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | phi3:3.8b | 18.82 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:2b | 29.53 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:7b | 10.83 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | llava:7b | 13.5 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | llava:13b | 7.53 |
| macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.42 | mistral:7b | 35.62 |
| macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.42 | llama3:8b | 32.77 |
| macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.42 | phi3:3.8b | 43.4 |
| macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:2b | 78.58 |
| macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:7b | 29.75 |
| macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.42 | llava:7b | 37.48 |
| macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.42 | llava:13b | 20.95 |
| macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | mistral:7b | 33.45 |
| macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | llama3:8b | 30.84 |
| macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | phi3:3.8b | 37.91 |
| macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | gemma:2b | 75.22 |
| macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | gemma:7b | 28.26 |
| macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | llava:7b | 34.68 |
| macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | llava:13b | 19.89 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | mistral:7b | 13.1 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | llama3:8b | 11.91 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | phi3:3.8b | 18.63 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | qwen:1.8b | 36.51 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | phi:2.7b | 37.23 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:2b | 29.21 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:7b | 10.84 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | llava:7b | 13.64 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | llava:13b | 7.54 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.41 | mistral:7b | 50.06 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.41 | llama3:8b | 46.2 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.41 | phi3:3.8b | 61.05 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.41 | gemma:2b | 108.31 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.41 | gemma:7b | 34.96 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.41 | llava:7b | 44.26 |
| macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.41 | llava:13b | 25.64 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.43 | mistral:7b | 13.07 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.43 | llama3:8b | 11.88 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.43 | phi3:3.8b | 18.86 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.43 | gemma:2b | 29.16 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.43 | gemma:7b | 10.9 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.43 | llava:7b | 13.61 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.43 | llava:13b | 7.59 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | mistral:7b | 32.24 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | llama3:8b | 29.6 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | phi3:3.8b | 37.88 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | gemma:2b | 72.4 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | gemma:7b | 25.44 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | llava:7b | 33.77 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | llava:13b | 18.04 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | mistral:7b | 32.21 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | llama3:8b | 29.53 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | phi3:3.8b | 37.36 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | gemma:2b | 72.8 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | gemma:7b | 26.58 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | llava:7b | 33.28 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | llava:13b | 18.33 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.43 | mistral:7b | 32.4 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.43 | llama3:8b | 29.7 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.43 | phi3:3.8b | 35.14 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.43 | gemma:2b | 72.76 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.43 | gemma:7b | 27.21 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.43 | llava:7b | 34.4 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.43 | llava:13b | 19.21 |
| macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.47 | mistral:7b | 12.84 |
| macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.47 | llama3:8b | 10.69 |
| macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.47 | phi3:3.8b | 19.75 |
| macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.47 | gemma:2b | 29.03 |
| macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.47 | gemma:7b | 1.35 |
| macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.47 | llava:7b | 12.25 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | mistral:7b | 33.18 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | llama3:8b | 30.08 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | phi3:3.8b | 35.27 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | gemma:2b | 73.93 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | gemma:7b | 27.24 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | llava:7b | 34.96 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | llava:13b | 19.44 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | mistral:7b | 28.52 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | llama3:8b | 26.44 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | phi3:3.8b | 40.03 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | gemma:2b | 66.34 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | gemma:7b | 23.72 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | llava:7b | 29.75 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | llava:13b | 16.32 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | mistral:7b | 31.91 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | llama3:8b | 28.95 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | phi3:3.8b | 34.48 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | gemma:2b | 71 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | gemma:7b | 26.05 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | llava:7b | 33.36 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | llava:13b | 16.72 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | mistral:7b | 28.22 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | llama3:8b | 26.47 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | phi3:3.8b | 39.95 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | gemma:2b | 65.62 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | gemma:7b | 23.51 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | llava:7b | 29.36 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | llava:13b | 16.55 |
| macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | mistral:7b | 33.3 |
| macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | llama3:8b | 30.96 |
| macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | phi3:3.8b | 37.87 |
| macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | gemma:2b | 75.79 |
| macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | gemma:7b | 28.14 |
| macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | llava:7b | 35.2 |
| macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | llava:13b | 20.12 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.47 | mistral:7b | 45.26 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.47 | llama3:8b | 39.4 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.47 | phi3:3.8b | 50.77 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.47 | gemma:2b | 104.89 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.47 | gemma:7b | 37.25 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.47 | llava:7b | 53.42 |
| macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.47 | llava:13b | 28.22 |
| macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | mistral:7b | 66.52 |
| macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | llama3:8b | 60.38 |
| macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | phi3:3.8b | 75.84 |
| macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | gemma:2b | 68.55 |
| macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | gemma:7b | 30.2 |
| macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | llava:7b | 67.64 |
| macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | llava:13b | 40.49 |
| macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | mistral:7b | 66.62 |
| macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | llama3:8b | 61.09 |
| macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | phi3:3.8b | 75.85 |
| macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | gemma:2b | 63.05 |
| macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | gemma:7b | 29.29 |
| macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | llava:7b | 67.34 |
| macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | llava:13b | 40.71 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.48 | mistral:7b | 57.06 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.48 | llama3:8b | 52.01 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.48 | phi3:3.8b | 59.51 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.48 | gemma:2b | 112.1 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.48 | gemma:7b | 41.42 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.48 | llava:7b | 53.25 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.48 | llava:13b | 30.86 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | mistral:7b | 12.87 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | llama3:8b | 11.8 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | phi3:3.8b | 20.06 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | gemma:2b | 29.09 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | gemma:7b | 10.65 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | llava:7b | 13.33 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | llava:13b | 7.3 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.48 | mistral:7b | 32.99 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.48 | llama3:8b | 29.72 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.48 | phi3:3.8b | 45.4 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.48 | gemma:2b | 62.4 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.48 | gemma:7b | 24.66 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.48 | llava:7b | 31.86 |
| macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.48 | llava:13b | 16.13 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | mistral:7b | 13.1 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | llama3:8b | 11.84 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | phi3:3.8b | 19.83 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | gemma:2b | 28.93 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | gemma:7b | 10.76 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | llava:7b | 13.51 |
| macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | llava:13b | 7.46 |
| macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | mistral:7b | 13.15 |
| macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | llama3:8b | 11.91 |
| macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | phi3:3.8b | 19.59 |
| macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:2b | 28.98 |
| macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:7b | 7.87 |
| macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | llava:7b | 11.35 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.1 | mistral:7b | 28.62 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.1 | llama3:8b | 27.02 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.1 | phi3:3.8b | 44.07 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.1 | gemma:2b | 66.56 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.1 | gemma:7b | 24.47 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.1 | llava:7b | 30.29 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.1 | llava:13b | 17.15 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.2 | mistral:7b | 28.6 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.2 | llama3:8b | 26.29 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.2 | phi3:3.8b | 43.25 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.2 | gemma:2b | 63.46 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.2 | gemma:7b | 23.94 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.2 | llava:7b | 29.39 |
| macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.2 | llava:13b | 16.55 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.2.5 | mistral:7b | 19.99 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.2.5 | llama3:8b | 12.7 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.2.5 | phi3:3.8b | 20.65 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.2.5 | gemma:2b | 30.69 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.2.5 | gemma:7b | 9.07 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.2.5 | llava:7b | 12.74 |
| macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.2.5 | llava:13b | 6.3 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | llama3:8b | 51.99 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | llama3:8b | 51.79 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | codestral | 20.82 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | llama3:8b | 51.9 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | codestral | 21.24 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | mistral:7b | 44.93 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | llama3:8b | 38.25 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | phi3:3.8b | 64.44 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | gemma:2b | 104.13 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | gemma:7b | 32.89 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | llava:7b | 46.24 |
| macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | llava:13b | 26.31 |
| macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | mistral:7b | 18.56 |
| macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | llama3:8b | 11.24 |
| macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | phi3:3.8b | 20.87 |
| macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | gemma:2b | 33.51 |
| macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | gemma:7b | 9.36 |
| macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | llava:7b | 11.01 |
| macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | llava:13b | 5.48 |
| macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | mistral:7b | 19.29 |
| macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | llama3:8b | 16.32 |
| macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | phi3:3.8b | 25.29 |
| macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | gemma:2b | 41.3 |
| macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | gemma:7b | 13.45 |
| macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | llava:7b | 18.11 |
| macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | llava:13b | 8.61 |