Results for macOS
system | cpu | gpu | memory | os_version | ollama_version | model_name | throughput |
---|---|---|---|---|---|---|---|
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | mistral:7b | 13.13 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | gemma:2b | 29.1 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | gemma:7b | 10.6 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llama2:7b | 13.7 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llama2:13b | 7.41 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llava:7b | 13.64 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llava:13b | 7.48 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | mistral:7b | 35.71 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | gemma:2b | 77.18 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | gemma:7b | 29.17 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llama2:7b | 36.68 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llama2:13b | 20.54 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llava:7b | 37.51 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llava:13b | 21 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | mistral:7b | 35.81 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | gemma:2b | 77.52 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | gemma:7b | 29.27 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llama2:7b | 36.62 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llama2:13b | 20.62 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llava:7b | 37.09 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.30 | llava:13b | 20.98 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.30 | mistral:7b | 50.62 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.30 | gemma:2b | 107.65 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.30 | gemma:7b | 42.84 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.30 | llama2:7b | 52.71 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.30 | llama2:13b | 30.16 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.30 | llava:7b | 48.89 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.30 | llava:13b | 28.43 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.30 | llama2:13b | 11.13 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.30 | gemma:7b | 14.68 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.30 | mistral:7b | 18.18 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.30 | llama2:7b | 20.53 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.1.30 | mistral:7b | 19.65 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.1.30 | gemma:2b | 45.07 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.1.30 | gemma:7b | 14.69 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.1.30 | llama2:7b | 16.8 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.1.30 | llama2:13b | 8.43 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.1.30 | llava:7b | 16.52 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.1.30 | llava:13b | 9.06 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.30 | mistral:7b | 88.03 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.30 | gemma:2b | 165 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.30 | gemma:7b | 79.19 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.30 | llama2:7b | 89.54 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.30 | llama2:13b | 54.83 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.30 | llava:7b | 92.52 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.30 | llava:13b | 55.87 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:2b | 28.84 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:2b | 28.67 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:7b | 10.73 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | codegemma:2b | 29.24 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | mistral:7b | 13.07 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | mistral:7b | 57.2 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:2b | 113.61 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:7b | 48.59 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llama2:7b | 58.46 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llama2:13b | 34.85 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llava:7b | 59.48 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llava:13b | 35.29 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | mistral:7b | 60.48 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:2b | 120.69 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:7b | 50.42 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llama2:7b | 61.65 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llama2:13b | 36.05 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llava:7b | 62.51 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llava:13b | 36.66 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.31 | mistral:7b | 51.25 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.31 | gemma:2b | 101.45 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.31 | gemma:7b | 43.83 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.31 | llama2:7b | 52.4 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.31 | llama2:13b | 22.35 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.31 | llava:7b | 41.26 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.31 | llava:13b | 25.48 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.31 | mistral:7b | 33.29 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.31 | gemma:2b | 73.3 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.31 | gemma:7b | 27.51 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.31 | llama2:7b | 34.32 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.31 | llama2:13b | 19.17 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.31 | llava:7b | 34.85 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.31 | llava:13b | 19.74 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | mistral:7b | 36.12 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | mistral:7b | 32.97 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | gemma:2b | 72.53 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | gemma:7b | 27.09 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llama2:7b | 33.76 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llama2:13b | 18.78 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llava:7b | 34.16 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llava:13b | 18.76 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | mistral:7b | 30.12 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:2b | 75.7 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:7b | 24.14 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:7b | 31.37 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:13b | 17.56 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:7b | 36.95 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:13b | 17.85 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | mistral:7b | 31.5 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:2b | 82.54 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:7b | 25.9 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:7b | 31.88 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:13b | 18.24 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:7b | 32.7 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:13b | 18.44 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | mistral:7b | 31.55 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:2b | 78.52 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:7b | 25.75 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:7b | 31.88 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:13b | 18.24 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:7b | 27.55 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:13b | 18.05 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | mistral:7b | 8.24 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:2b | 29.11 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:7b | 11.3 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | llama2:7b | 8.89 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | llama2:13b | 4.93 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | llava:7b | 10.93 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.31 | llava:13b | 6.07 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.1.31 | mistral:7b | 65.46 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.1.31 | llama3:8b | 60.55 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.32 | llama2:7b | 20.11 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | mistral:7b | 31.9 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | gemma:2b | 72.68 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | gemma:7b | 25.78 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llama2:7b | 33.16 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llama2:13b | 16.66 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llava:7b | 33.8 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llava:13b | 18.39 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | mistral:7b | 33.94 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | gemma:2b | 73.88 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | gemma:7b | 28.3 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llama2:7b | 34.81 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llama2:13b | 19.59 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llava:7b | 35.33 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llava:13b | 19.63 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | mistral:7b | 60.51 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llama3:8b | 54.64 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | phi3:3.8b | 69.57 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | gemma:2b | 117.46 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | gemma:7b | 50.72 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llava:7b | 62.75 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llava:13b | 37.13 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | mistral:7b | 59.38 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:2b | 126.09 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:7b | 50.35 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:7b | 60.6 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:13b | 34.83 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:7b | 61.7 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:13b | 35.53 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | mistral:7b | 28.94 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | gemma:2b | 59.85 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | gemma:7b | 20.63 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | llama2:7b | 19.5 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | llama2:13b | 12.88 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | llava:7b | 30 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | llava:13b | 13.34 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | llama3:8b-instruct-q8_0 | 22.05 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | llama3:8b | 27.79 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.32 | mistral:7b | 13.16 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.32 | llama3:8b | 11.92 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.32 | phi3:3.8b | 19.74 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.32 | gemma:2b | 29.23 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.32 | gemma:7b | 10.74 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.32 | llava:7b | 13.53 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.32 | llava:13b | 7.57 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-31-g4c241e36 | mistral:7b | 62.63 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-31-g4c241e36 | llama3:8b | 53.75 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-31-g4c241e36 | phi3:3.8b | 79.23 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-31-g4c241e36 | gemma:2b | 118.32 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-31-g4c241e36 | gemma:7b | 51.6 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-31-g4c241e36 | llava:7b | 65.91 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-31-g4c241e36 | llava:13b | 38.45 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | mistral:7b | 36.05 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llama3:8b | 32.61 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | phi3:3.8b | 49.67 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:2b | 76.69 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | gemma:7b | 29.67 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llava:7b | 37.64 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.31 | llava:13b | 20.99 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | mistral:7b | 31.43 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llama3:8b | 30.74 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | phi3:3.8b | 42.33 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | gemma:2b | 75.51 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | gemma:7b | 28.14 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llava:7b | 35.17 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.32 | llava:13b | 19.8 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-13-gae4d5086 | mistral:7b | 65.13 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-13-gae4d5086 | llama3:8b | 57.58 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-13-gae4d5086 | phi3:3.8b | 80.14 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-13-gae4d5086 | gemma:2b | 114.57 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-13-gae4d5086 | gemma:7b | 50.92 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-13-gae4d5086 | llava:7b | 65.93 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-13-gae4d5086 | llava:13b | 37.84 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.33 | mistral:7b | 57.01 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.33 | llama3:8b | 52.02 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.33 | phi3:3.8b | 67.18 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.33 | gemma:2b | 111.19 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.33 | gemma:7b | 48.04 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.33 | llava:7b | 58.78 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.33 | llava:13b | 32.22 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | mistral:7b | 53.27 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:2b | 110.88 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | gemma:7b | 39.99 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:7b | 49.7 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llama2:13b | 29.1 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:7b | 53.9 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.32 | llava:13b | 29.66 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.39 | mistral:7b | 56.73 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.39 | llama3:8b | 51.14 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.39 | phi3:3.8b | 59.15 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.39 | gemma:2b | 105.09 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.39 | gemma:7b | 43.36 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.39 | llava:7b | 58.43 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.1.39 | llava:13b | 34.39 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | mistral:7b | 59.46 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | llama3:8b | 52.58 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | phi3:3.8b | 72.56 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:2b | 115.15 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:7b | 48.22 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:7b | 61.25 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:13b | 35.23 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | mistral:7b | 59.43 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | llama3:8b | 51.98 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | phi3:3.8b | 72.32 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:2b | 112.26 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:7b | 46.34 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:7b | 61.53 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:13b | 34.16 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.34 | mistral:7b | 32.84 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.34 | llama3:8b | 29.87 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.34 | phi3:3.8b | 39.7 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.34 | gemma:2b | 71.56 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.34 | gemma:7b | 27.03 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.34 | llava:7b | 34.19 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.34 | llava:13b | 19.32 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.39 | mistral:7b | 12.85 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.39 | llama3:8b | 11.81 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.39 | phi3:3.8b | 18.28 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.39 | gemma:2b | 28.64 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.39 | gemma:7b | 10.58 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.39 | llava:7b | 13.17 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.39 | llava:13b | 7.25 |
macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.34 | mistral:7b | 12.96 |
macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.34 | llama3:8b | 5.7 |
macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.34 | phi3:3.8b | 16.09 |
macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.34 | gemma:2b | 27.88 |
macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.34 | gemma:7b | 0.18 |
macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.34 | llava:7b | 9.33 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | mistral:7b | 59.85 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llama3:8b | 55.27 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | phi3:3.8b | 73.4 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:2b | 127.16 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:7b | 50.6 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:7b | 61.27 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:13b | 35.62 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | mistral:7b | 60.2 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llama3:8b | 55.26 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | phi3:3.8b | 73.07 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:2b | 127.78 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:7b | 50.61 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:7b | 62.6 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:13b | 35.77 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | mistral:7b | 13.13 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.37 | mistral:7b | 55.44 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.37 | llama3:8b | 52.04 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.37 | phi3:3.8b | 67.86 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.37 | gemma:2b | 112.65 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.37 | gemma:7b | 41.58 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.37 | llava:7b | 52.45 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.37 | llava:13b | 30.18 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.38-5-gf2cf97d | mistral:7b | 60.65 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.38-5-gf2cf97d | llama3:8b | 53.29 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.38-5-gf2cf97d | phi3:3.8b | 65.61 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.38-5-gf2cf97d | gemma:2b | 102.33 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.38-5-gf2cf97d | gemma:7b | 47.91 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.38-5-gf2cf97d | llava:7b | 65.76 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.38-5-gf2cf97d | llava:13b | 37.32 |
macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.37 | mistral:7b | 20.04 |
macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.37 | llama3:8b | 17.53 |
macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.37 | phi3:3.8b | 29.17 |
macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.37 | gemma:2b | 45.61 |
macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.37 | gemma:7b | 0.23 |
macOS | Apple M2 | Apple M2 | 8.00 | macOS 14.2 (23C64) | 0.1.37 | llava:7b | 20.02 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | mistral:7b | 64.92 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | llama3:8b | 57.53 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | phi3:3.8b | 82.64 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | gemma:2b | 123.08 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | gemma:7b | 53.14 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | llava:7b | 66.54 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | llava:13b | 38.9 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | mistral:7b | 60.39 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | llama3:8b | 54.45 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | phi3:3.8b | 72.55 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | gemma:2b | 125.43 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | gemma:7b | 50.67 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | llava:7b | 62.34 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | llava:13b | 35.77 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | mistral:7b | 59.78 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | llama3:8b | 54.42 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | phi3:3.8b | 70.79 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | gemma:2b | 125.46 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | gemma:7b | 50.38 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | llava:7b | 61.46 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.37 | llava:13b | 35.6 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | mistral:7b | 59.79 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llama3:8b | 54.93 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | phi3:3.8b | 73.06 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:2b | 127.04 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:7b | 50.56 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:7b | 61.97 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:13b | 35.61 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.38 | mistral:7b | 35.21 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.38 | llama3:8b | 30.52 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.38 | phi3:3.8b | 41.48 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.38 | gemma:2b | 69.86 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.38 | gemma:7b | 27.78 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.38 | llava:7b | 36.19 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.1.38 | llava:13b | 20.18 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | mistral:7b | 18.91 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | llama3:8b | 17.88 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | phi3:3.8b | 29.05 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | gemma:2b | 46.18 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | gemma:7b | 16.31 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | llava:7b | 20.7 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | llava:13b | 10.83 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.37 | mistral:7b | 19.16 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.37 | llama3:8b | 16.61 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.37 | phi3:3.8b | 23.4 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.37 | gemma:2b | 40.23 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.37 | gemma:7b | 12.35 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.37 | llava:7b | 14 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.37 | llava:13b | 6.72 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | mistral:7b | 61.48 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llama3:8b | 54.99 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | phi3:3.8b | 78.17 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | gemma:2b | 121.51 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | gemma:7b | 51.11 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llava:7b | 63.59 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llava:13b | 37.57 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | mistral:7b | 59.78 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llama3:8b | 55.37 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | phi3:3.8b | 73.03 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:2b | 128.27 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | gemma:7b | 50.61 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:7b | 62.77 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.34 | llava:13b | 35.83 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.1.38 | mistral:7b | 85.89 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.1.38 | llama3:8b | 79.33 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.1.38 | phi3:3.8b | 99.98 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.1.38 | gemma:2b | 163.63 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.1.38 | gemma:7b | 78.65 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.1.38 | llava:7b | 89.17 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.1.38 | llava:13b | 54.72 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | mistral:7b | 28.74 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | llama3:8b | 26.57 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | phi3:3.8b | 43.02 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | gemma:2b | 65.72 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | gemma:7b | 24.23 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | llava:7b | 29.31 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | llava:13b | 16.39 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | mistral:7b | 75.06 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | llama3:8b | 64.64 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | phi3:3.8b | 107.43 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | gemma:2b | 134.7 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | gemma:7b | 60.79 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | llava:7b | 77.4 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | llava:13b | 13.15 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | v0.1.33-rc5-30-g4e82cbc8 | phi3:3.8b | 26.82 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.1.31 | llama3:8b | 60.42 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | mistral:7b | 61.38 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llama3:8b | 55.45 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | phi3:3.8b | 78.27 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | gemma:2b | 121.41 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | gemma:7b | 51.74 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llava:7b | 62.84 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llava:13b | 37.16 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | mistral:7b | 17.6 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | llama3:8b | 10.45 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | phi3:3.8b | 14.43 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | gemma:2b | 37.98 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | gemma:7b | 13.12 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | llava:7b | 19.12 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.1.38 | llava:13b | 7.3 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | mistral:7b | 28.16 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | llama3:8b | 26.32 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | phi3:3.8b | 42.77 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | gemma:2b | 65.3 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | gemma:7b | 24.14 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | llava:7b | 29.52 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.38 | llava:13b | 16.79 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | llama3:8b | 11.98 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | phi3:3.8b | 19.18 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:2b | 29.15 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:7b | 9.83 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.1.41 | mistral:7b | 74.79 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.1.41 | llama3:8b | 68.42 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.1.41 | phi3:3.8b | 69.59 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.1.41 | gemma:2b | 131.64 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.1.41 | gemma:7b | 66.73 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.1.41 | llava:7b | 74.96 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.1.41 | llava:13b | 50.3 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | llava:7b | 11.41 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.41 | mistral:7b | 84.74 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.41 | llama3:8b | 79.09 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.41 | phi3:3.8b | 86.1 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.41 | gemma:2b | 160.76 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.41 | gemma:7b | 77.69 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.41 | llava:7b | 88.77 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 192.00 | macOS 14.4 (23E214) | 0.1.41 | llava:13b | 54.64 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | mistral:7b | 61.35 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | llama3:8b | 54.79 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.38 | phi3:3.8b | 70.54 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | mistral:7b | 12.9 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | llama3:8b | 11.92 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | phi3:3.8b | 18.82 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:2b | 29.53 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:7b | 10.83 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | llava:7b | 13.5 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | llava:13b | 7.53 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.42 | mistral:7b | 35.62 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.42 | llama3:8b | 32.77 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.42 | phi3:3.8b | 43.4 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:2b | 78.58 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:7b | 29.75 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.42 | llava:7b | 37.48 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.1.42 | llava:13b | 20.95 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | mistral:7b | 33.45 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | llama3:8b | 30.84 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | phi3:3.8b | 37.91 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | gemma:2b | 75.22 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | gemma:7b | 28.26 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | llava:7b | 34.68 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | llava:13b | 19.89 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | mistral:7b | 13.1 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | llama3:8b | 11.91 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | phi3:3.8b | 18.63 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | qwen:1.8b | 36.51 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | phi:2.7b | 37.23 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:2b | 29.21 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:7b | 10.84 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | llava:7b | 13.64 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.42 | llava:13b | 7.54 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.41 | mistral:7b | 50.06 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.41 | llama3:8b | 46.2 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.41 | phi3:3.8b | 61.05 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.41 | gemma:2b | 108.31 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.41 | gemma:7b | 34.96 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.41 | llava:7b | 44.26 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.1.41 | llava:13b | 25.64 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.43 | mistral:7b | 13.07 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.43 | llama3:8b | 11.88 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.43 | phi3:3.8b | 18.86 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.43 | gemma:2b | 29.16 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.43 | gemma:7b | 10.9 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.43 | llava:7b | 13.61 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.43 | llava:13b | 7.59 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | mistral:7b | 32.24 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | llama3:8b | 29.6 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | phi3:3.8b | 37.88 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | gemma:2b | 72.4 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | gemma:7b | 25.44 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | llava:7b | 33.77 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | llava:13b | 18.04 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | mistral:7b | 32.21 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | llama3:8b | 29.53 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | phi3:3.8b | 37.36 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | gemma:2b | 72.8 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | gemma:7b | 26.58 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | llava:7b | 33.28 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.41 | llava:13b | 18.33 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.43 | mistral:7b | 32.4 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.43 | llama3:8b | 29.7 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.43 | phi3:3.8b | 35.14 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.43 | gemma:2b | 72.76 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.43 | gemma:7b | 27.21 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.43 | llava:7b | 34.4 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.43 | llava:13b | 19.21 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.47 | mistral:7b | 12.84 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.47 | llama3:8b | 10.69 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.47 | phi3:3.8b | 19.75 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.47 | gemma:2b | 29.03 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.47 | gemma:7b | 1.35 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.47 | llava:7b | 12.25 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | mistral:7b | 33.18 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | llama3:8b | 30.08 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | phi3:3.8b | 35.27 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | gemma:2b | 73.93 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | gemma:7b | 27.24 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | llava:7b | 34.96 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | llava:13b | 19.44 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | mistral:7b | 28.52 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | llama3:8b | 26.44 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | phi3:3.8b | 40.03 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | gemma:2b | 66.34 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | gemma:7b | 23.72 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | llava:7b | 29.75 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | llava:13b | 16.32 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | mistral:7b | 31.91 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | llama3:8b | 28.95 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | phi3:3.8b | 34.48 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | gemma:2b | 71 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | gemma:7b | 26.05 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | llava:7b | 33.36 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | .0 | llava:13b | 16.72 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | mistral:7b | 28.22 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | llama3:8b | 26.47 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | phi3:3.8b | 39.95 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | gemma:2b | 65.62 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | gemma:7b | 23.51 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | llava:7b | 29.36 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.1.44 | llava:13b | 16.55 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | mistral:7b | 33.3 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | llama3:8b | 30.96 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | phi3:3.8b | 37.87 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | gemma:2b | 75.79 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | gemma:7b | 28.14 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | llava:7b | 35.2 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.1.41 | llava:13b | 20.12 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.47 | mistral:7b | 45.26 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.47 | llama3:8b | 39.4 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.47 | phi3:3.8b | 50.77 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.47 | gemma:2b | 104.89 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.47 | gemma:7b | 37.25 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.47 | llava:7b | 53.42 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.1.47 | llava:13b | 28.22 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | mistral:7b | 66.52 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | llama3:8b | 60.38 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | phi3:3.8b | 75.84 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | gemma:2b | 68.55 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | gemma:7b | 30.2 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | llava:7b | 67.64 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | llava:13b | 40.49 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | mistral:7b | 66.62 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | llama3:8b | 61.09 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | phi3:3.8b | 75.85 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | gemma:2b | 63.05 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | gemma:7b | 29.29 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | llava:7b | 67.34 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.1.47 | llava:13b | 40.71 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.48 | mistral:7b | 57.06 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.48 | llama3:8b | 52.01 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.48 | phi3:3.8b | 59.51 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.48 | gemma:2b | 112.1 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.48 | gemma:7b | 41.42 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.48 | llava:7b | 53.25 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.1.48 | llava:13b | 30.86 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | mistral:7b | 12.87 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | llama3:8b | 11.8 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | phi3:3.8b | 20.06 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | gemma:2b | 29.09 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | gemma:7b | 10.65 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | llava:7b | 13.33 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | llava:13b | 7.3 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.48 | mistral:7b | 32.99 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.48 | llama3:8b | 29.72 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.48 | phi3:3.8b | 45.4 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.48 | gemma:2b | 62.4 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.48 | gemma:7b | 24.66 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.48 | llava:7b | 31.86 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.1.48 | llava:13b | 16.13 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | mistral:7b | 13.1 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | llama3:8b | 11.84 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | phi3:3.8b | 19.83 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | gemma:2b | 28.93 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | gemma:7b | 10.76 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | llava:7b | 13.51 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.1.48 | llava:13b | 7.46 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | mistral:7b | 13.15 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | llama3:8b | 11.91 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | phi3:3.8b | 19.59 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:2b | 28.98 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | gemma:7b | 7.87 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.1.42 | llava:7b | 11.35 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.1 | mistral:7b | 28.62 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.1 | llama3:8b | 27.02 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.1 | phi3:3.8b | 44.07 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.1 | gemma:2b | 66.56 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.1 | gemma:7b | 24.47 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.1 | llava:7b | 30.29 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.1 | llava:13b | 17.15 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.2 | mistral:7b | 28.6 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.2 | llama3:8b | 26.29 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.2 | phi3:3.8b | 43.25 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.2 | gemma:2b | 63.46 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.2 | gemma:7b | 23.94 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.2 | llava:7b | 29.39 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.2.2 | llava:13b | 16.55 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.2.5 | mistral:7b | 19.99 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.2.5 | llama3:8b | 12.7 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.2.5 | phi3:3.8b | 20.65 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.2.5 | gemma:2b | 30.69 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.2.5 | gemma:7b | 9.07 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.2.5 | llava:7b | 12.74 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.2.5 | llava:13b | 6.3 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | llama3:8b | 51.99 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | llama3:8b | 51.79 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | codestral | 20.82 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | llama3:8b | 51.9 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | codestral | 21.24 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | mistral:7b | 44.93 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | llama3:8b | 38.25 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | phi3:3.8b | 64.44 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | gemma:2b | 104.13 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | gemma:7b | 32.89 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | llava:7b | 46.24 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.2.5 | llava:13b | 26.31 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | mistral:7b | 18.56 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | llama3:8b | 11.24 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | phi3:3.8b | 20.87 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | gemma:2b | 33.51 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | gemma:7b | 9.36 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | llava:7b | 11.01 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | llava:13b | 5.48 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | mistral:7b | 19.29 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | llama3:8b | 16.32 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | phi3:3.8b | 25.29 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | gemma:2b | 41.3 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | gemma:7b | 13.45 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | llava:7b | 18.11 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.2.5 | llava:13b | 8.61 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.2.8 | mistral:7b | 12.52 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.2.8 | llama3.1:8b | 11.95 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.2.8 | phi3:3.8b | 20.46 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.2.8 | qwen2:7b | 12.58 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.2.8 | gemma2:9b | 9.4 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.2.8 | llava:7b | 13.65 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.2.8 | llava:13b | 7.55 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.0 | mistral:7b | 58.29 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.0 | llama3.1:8b | 54.05 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.0 | phi3:3.8b | 73.67 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.0 | qwen2:7b | 44.08 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.0 | gemma2:9b | 35.76 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.0 | llava:7b | 53.13 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.0 | llava:13b | 31.68 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.2.7 | mistral:7b | 34.96 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.2.7 | llama3.1:8b | 31.75 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.2.7 | phi3:3.8b | 49.35 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.2.7 | qwen2:7b | 33.46 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.2.7 | gemma2:9b | 25.4 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.2.7 | llava:7b | 36.58 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.2.7 | llava:13b | 20.61 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.2 | mistral:7b | 34.99 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.2 | llama3.1:8b | 32.05 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.2 | phi3:3.8b | 49.93 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.2 | qwen2:7b | 33.92 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.2 | gemma2:9b | 25.3 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.2 | llava:7b | 35.76 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.2 | llava:13b | 20.43 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.2 | mistral:7b | 28.52 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.2 | llama3.1:8b | 18.38 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.2 | phi3:3.8b | 35.13 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.2 | qwen2:7b | 22.54 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.2 | gemma2:9b | 20.93 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.2 | llava:7b | 29.72 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.2 | llava:13b | 17.03 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.3 | mistral:7b | 28.07 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.3 | llama3.1:8b | 26.22 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.3 | phi3:3.8b | 42.02 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.3 | qwen2:7b | 27.63 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.3 | gemma2:9b | 21.11 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.3 | llava:7b | 29.23 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.3 | llava:13b | 16.09 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.3 | mistral:7b | 12.78 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.3 | llama3.1:8b | 11.64 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.3 | phi3:3.8b | 18.44 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.3 | qwen2:7b | 12.23 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.3 | gemma2:9b | 9.26 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.3 | llava:7b | 13.22 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.3 | llava:13b | 7.35 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.3 | mistral:7b | 28.31 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.3 | llama3.1:8b | 26.16 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.3 | phi3:3.8b | 43.92 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.3 | qwen2:7b | 27.98 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.3 | gemma2:9b | 20.67 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.3 | llava:7b | 28.72 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.3 | llava:13b | 16.02 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.3 | mistral:7b | 50.37 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.3 | llama3.1:8b | 39.82 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.3 | phi3:3.8b | 49.61 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.3 | qwen2:7b | 31.85 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.3 | gemma2:9b | 21.88 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.3 | llava:7b | 31.6 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.3 | llava:13b | 22.67 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.4 | mistral:7b | 51.86 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.4 | llama3.1:8b | 47.58 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.4 | phi3:3.8b | 66.31 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.4 | qwen2:7b | 50.24 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.4 | gemma2:9b | 36.76 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.4 | llava:7b | 54.53 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.4 | llava:13b | 32.1 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.4 | mistral:7b | 51.28 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.4 | llama3.1:8b | 47.7 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.4 | phi3:3.8b | 59.04 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.4 | qwen2:7b | 50.22 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.4 | gemma2:9b | 36.36 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.4 | llava:7b | 54.03 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.4 | llava:13b | 32.01 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.4 | mistral-nemo:latest | 33.25 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.3.6 | mistral:7b | 10.65 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.3.6 | llama3.1:8b | 6.38 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.3.6 | phi3:3.8b | 20.1 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.3.6 | qwen2:7b | 12.53 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.3.6 | gemma2:9b | 0.17 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.3.6 | llava:7b | 10.53 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.6 | mistral:7b | 28.11 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.6 | llama3.1:8b | 25.87 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.6 | phi3:3.8b | 43.25 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.6 | qwen2:7b | 28.51 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.6 | gemma2:9b | 21.03 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.6 | llava:7b | 29.05 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.6 | llava:13b | 16.46 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.6 | mistral:7b | 45.97 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.6 | llama3.1:8b | 40.39 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.6 | phi3:3.8b | 60.17 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.6 | qwen2:7b | 43.44 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.6 | gemma2:9b | 32.43 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.6 | llava:7b | 53.99 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.3.6 | llava:13b | 27.93 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.6 | mistral:7b | 59.75 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.6 | llama3.1:8b | 57.15 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.6 | phi3:3.8b | 81.35 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.6 | qwen2:7b | 58.38 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.6 | gemma2:9b | 42.34 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.6 | llava:7b | 61.67 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.6 | llava:13b | 33.97 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.7 | mistral:7b | 34.64 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.7 | llama3.1:8b | 32.29 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.7 | phi3:3.8b | 45.42 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.7 | qwen2:7b | 34.19 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.7 | gemma2:9b | 25.91 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.7 | llava:7b | 37.64 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.7 | llava:13b | 15.04 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.7 | mistral:7b | 29.29 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.7 | llama3.1:8b | 17.58 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.7 | phi3:3.8b | 50.88 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.7 | qwen2:7b | 34.61 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.7 | gemma2:9b | 26.27 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.7 | llava:7b | 38.03 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.7 | llava:13b | 20.4 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.3.8 | mistral:7b | 50 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.3.8 | llama3.1:8b | 44.1 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.3.8 | phi3:3.8b | 63.64 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.3.8 | qwen2:7b | 47.28 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.3.8 | gemma2:9b | 35.74 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.3.8 | llava:7b | 56.91 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.3.8 | llava:13b | 30.98 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.9 | mistral:7b | 28.55 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.9 | llama3.1:8b | 26.45 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.9 | phi3:3.8b | 39.48 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.9 | qwen2:7b | 28.12 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.9 | gemma2:9b | 20.99 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.9 | llava:7b | 29.31 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.9 | llava:13b | 16.64 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.3.9 | mistral:7b | 19.21 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.3.9 | llama3.1:8b | 18.51 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.3.9 | phi3:3.8b | 30.91 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.3.9 | qwen2:7b | 19.36 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.3.9 | gemma2:9b | 15.11 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.3.9 | llava:7b | 20.32 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.3.9 | llava:13b | 11.34 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.9 | mistral:7b | 33.7 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.9 | llama3.1:8b | 31.05 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.9 | phi3:3.8b | 48.31 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.9 | qwen2:7b | 33.39 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.9 | gemma2:9b | 24.54 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.9 | llava:7b | 35.53 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.9 | llava:13b | 19.87 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.6 | mistral:7b | 58.18 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.6 | llama3.1:8b | 53.49 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.6 | phi3:3.8b | 63.95 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.6 | qwen2:7b | 50.79 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.6 | gemma2:9b | 39.37 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.6 | llava:7b | 60.27 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.6 | llava:13b | 34.85 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.3.9 | llama3.1:8b | 18.54 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.3.9 | qwen2:7b | 19.74 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.9 | mistral:7b | 28.54 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.9 | llama3.1:8b | 26.53 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.9 | phi3:3.8b | 43.89 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.9 | qwen2:7b | 11.68 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.9 | gemma2:9b | 11.42 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.9 | llava:7b | 22.77 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.9 | llava:13b | 16.68 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.3.10 | mistral:7b | 33.86 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.3.10 | llama3.1:8b | 30.61 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.3.10 | phi3:3.8b | 43.81 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.3.10 | qwen2:7b | 32.58 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.3.10 | gemma2:9b | 23.91 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.3.10 | llava:7b | 35.09 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.3.10 | llava:13b | 19.85 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.3.10 | mistral:7b | 31.17 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.3.10 | llama3.1:8b | 28.51 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.3.10 | phi3:3.8b | 43.09 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.3.10 | qwen2:7b | 27.63 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.3.10 | gemma2:9b | 22.17 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.3.10 | llava:7b | 32.95 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.3.10 | llava:13b | 18.53 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.10 | mistral:7b | 61.69 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.10 | llama3.1:8b | 52.49 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.10 | phi3:3.8b | 80.66 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.10 | qwen2:7b | 58.43 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.10 | gemma2:9b | 42.72 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.10 | llava:7b | 63.85 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.10 | llava:13b | 37.35 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.6 | mistral:7b | 35.98 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.6 | llama3.1:8b | 32.56 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.6 | phi3:3.8b | 52.13 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.6 | qwen2:7b | 34.58 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.6 | gemma2:9b | 26.23 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.6 | llava:7b | 37.4 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.6 | llava:13b | 20.83 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.10 | mistral:7b | 35.57 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.10 | llama3.1:8b | 32.43 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.10 | phi3:3.8b | 50.09 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.10 | qwen2:7b | 34.07 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.10 | gemma2:9b | 25.68 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.10 | llava:7b | 37.07 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.10 | llava:13b | 20.94 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.10 | mistral:7b | 13.1 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.10 | llama3.1:8b | 11.95 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.10 | phi3:3.8b | 19.02 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.10 | qwen2:7b | 12.58 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.10 | gemma2:9b | 9.44 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.10 | llava:7b | 13.54 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.10 | llava:13b | 7.54 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.11 | mistral:7b | 42.79 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.11 | llama3.1:8b | 38.59 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.11 | phi3:3.8b | 53.92 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.11 | qwen2:7b | 33.83 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.11 | gemma2:9b | 24.32 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.11 | llava:7b | 46.11 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.11 | llava:13b | 18.08 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.11 | mistral:7b | 36.02 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.11 | llama3.1:8b | 32.72 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.11 | phi3:3.8b | 52.78 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.11 | qwen2:7b | 34.36 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.11 | gemma2:9b | 26.18 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.11 | llava:7b | 36.62 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.11 | llava:13b | 21.05 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.11 | llama3.1:8b | 33.04 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.11 | qwen2.5:7b-instruct-fp16 | 12.28 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.11 | qwen2.5:14b-instruct-q8_0 | 10.95 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.11 | llama3.1:8b-instruct-fp16 | 11.35 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.11 | gemma2:9b-text-fp16 | 12.22 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.11 | mistral:7b | 35.73 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.11 | llama3.1:8b | 32.34 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.11 | phi3:3.8b | 50.21 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.11 | qwen2:7b | 34.43 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.11 | gemma2:9b | 25.59 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.11 | llava:7b | 37.04 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.11 | llava:13b | 20.96 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.12 | mistral:7b | 48.77 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.12 | llama3.1:8b | 46.24 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.12 | phi3:3.8b | 68.35 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.12 | qwen2:7b | 47.6 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.12 | gemma2:9b | 32.24 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.12 | llava:7b | 45.99 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.12 | llava:13b | 25.65 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.3.12 | mistral:7b | 18.77 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.3.12 | llama3.1:8b | 17.16 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.3.12 | phi3:3.8b | 27.61 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.3.12 | qwen2:7b | 18.16 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.3.12 | gemma2:9b | 13.31 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.3.12 | llava:7b | 19.99 |
macOS | Apple M2 | Apple M2 | 24.00 | macOS 14.5 (23F79) | 0.3.12 | llava:13b | 10.63 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.12 | mistral:7b | 27.81 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.12 | llama3.1:8b | 25.46 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.12 | phi3:3.8b | 43.19 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.12 | qwen2:7b | 27.23 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.12 | gemma2:9b | 20.18 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.12 | llava:7b | 29.34 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.12 | llava:13b | 16.19 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.12 | mistral:7b | 61.83 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.12 | llama3.1:8b | 54.27 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.12 | phi3:3.8b | 63.21 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.12 | qwen2:7b | 27.64 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.12 | gemma2:9b | 25.26 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.12 | llava:7b | 45.94 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.12 | llava:13b | 27.46 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.12 | mistral:7b | 33.98 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.12 | llama3.1:8b | 31.09 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.12 | phi3:3.8b | 48.12 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.12 | qwen2:7b | 33.29 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.12 | gemma2:9b | 24.86 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.12 | llava:7b | 35.32 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.12 | llava:13b | 20.2 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.12 | qwen2.5:7b-instruct-fp16 | 12.2 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.12 | gemma2:9b-text-fp16 | 12.2 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.12 | mistral:7b | 76.45 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.12 | llama3.1:8b | 71.22 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.12 | phi3:3.8b | 90.36 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.12 | qwen2:7b | 72.64 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.12 | gemma2:9b | 52.29 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.12 | llava:7b | 80.12 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.12 | llava:13b | 49.37 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.12 | mistral:7b | 28.59 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.12 | llama3.1:8b | 26.62 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.12 | phi3:3.8b | 43.7 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.12 | qwen2:7b | 28.35 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.12 | gemma2:9b | 21.05 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.12 | llava:7b | 29.43 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.12 | llava:13b | 16.69 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | mistral:7b | 13.18 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | llama3.1:8b | 11.89 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | phi3:3.8b | 20.59 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | qwen2:7b | 7.22 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | gemma2:9b | 7.43 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | llava:7b | 13.56 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | llava:13b | 7.55 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | mistral:7b | 35.78 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | llama3.1:8b | 32.25 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | phi3:3.8b | 51.04 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | qwen2:7b | 34.19 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | gemma2:9b | 25.48 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | llava:7b | 36.83 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | llava:13b | 20.94 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | mistral:7b | 13.06 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | llama3.1:8b | 11.89 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | phi3:3.8b | 19.41 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | qwen2:7b | 12.49 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | gemma2:9b | 9.43 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | llava:7b | 13.52 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.12 | llava:13b | 7.59 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.13 | mistral:7b | 28.33 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.13 | llama3.1:8b | 26.3 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.13 | phi3:3.8b | 39.58 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.13 | qwen2:7b | 28.46 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.13 | gemma2:9b | 21.04 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.13 | llava:7b | 29.39 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.13 | llava:13b | 16.66 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.13 | phi3:3.8b | 32.88 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.13 | llama2:7b | 21.44 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.13 | qwen2:7b | 20.11 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.13 | llama2:7b | 13.78 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.13 | qwen2:7b | 12.59 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.13 | llama2:7b | 21.27 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.13 | qwen2:7b | 19.95 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.13 | llama2:7b | 13.67 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.13 | qwen2:7b | 12.62 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | mistral:7b | 53.86 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | llama3.1:8b | 51.64 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | phi3:3.8b | 68.82 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | qwen2:7b | 49.57 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | gemma2:9b | 37.71 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | llava:7b | 59.01 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | llava:13b | 35.14 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | mistral:7b | 61.19 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | llama3.1:8b | 56.9 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | phi3:3.8b | 70.54 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | qwen2:7b | 56.53 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | gemma2:9b | 39.97 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | llava:7b | 61.49 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | llava:13b | 36.23 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | mistral:7b | 61.06 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | llama3.1:8b | 53.88 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | phi3:3.8b | 70.21 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | qwen2:7b | 59.81 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | gemma2:9b | 41.77 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | llava:7b | 63.2 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.3 | llava:13b | 37.38 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.3.13 | mistral:7b | 19.89 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.3.13 | llama3.1:8b | 18.58 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.3.13 | phi3:3.8b | 30.17 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.3.13 | qwen2:7b | 19.48 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.3.13 | gemma2:9b | 14.68 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.3.13 | llava:7b | 20.93 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.3.13 | llava:13b | 11.18 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.13 | qwen2:1.5b-instruct-fp16 | 27.83 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.13 | qwen2:7b | 20.02 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.13 | qwen2:1.5b-instruct-fp16 | 27.87 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.13 | qwen2:7b | 20.12 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.13 | qwen2:1.5b-instruct-fp16 | 27.94 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.13 | qwen2:7b | 20.02 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 64.00 | macOS 15.0.1 (24A348) | 0.3.13 | mistral:7b | 75.16 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 64.00 | macOS 15.0.1 (24A348) | 0.3.13 | llama3.1:8b | 68.65 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 64.00 | macOS 15.0.1 (24A348) | 0.3.13 | phi3:3.8b | 88 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 64.00 | macOS 15.0.1 (24A348) | 0.3.13 | qwen2:7b | 70.15 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 64.00 | macOS 15.0.1 (24A348) | 0.3.13 | gemma2:9b | 50.62 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 64.00 | macOS 15.0.1 (24A348) | 0.3.13 | llava:7b | 73.63 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 64.00 | macOS 15.0.1 (24A348) | 0.3.13 | llava:13b | 48.3 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | mistral:7b | 30.9 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | llama3.1:8b | 29.02 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | phi3:3.8b | 46.57 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | qwen2:7b | 31.51 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | gemma2:9b | 23.62 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | llava:7b | 33.18 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | llava:13b | 18.41 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | mistral:7b | 33.18 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | llama3.1:8b | 30.34 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | phi3:3.8b | 46 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | qwen2:7b | 32.06 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | gemma2:9b | 23.51 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | llava:7b | 34.62 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | llava:13b | 19.18 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | mistral:7b | 63.35 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | llama3.1:8b | 58.28 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | phi3:3.8b | 83.04 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | qwen2:7b | 52.62 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | gemma2:9b | 40.65 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:7b | 63.96 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:13b | 37.35 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | mistral:7b | 62.95 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | llama3.1:8b | 59.08 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | phi3:3.8b | 80.8 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | qwen2:7b | 49.01 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | gemma2:9b | 38.98 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:7b | 59.95 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:13b | 35.76 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.11 | mistral:7b | 32.58 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.11 | llama3.1:8b | 30.15 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.11 | phi3:3.8b | 46.42 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.11 | qwen2:7b | 31.82 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.11 | gemma2:9b | 24.08 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.11 | llava:7b | 34.54 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.11 | llava:13b | 18.58 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | mistral:7b | 80.76 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | llama3.1:8b | 75.54 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | phi3:3.8b | 87.19 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | qwen2:7b | 78.34 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | gemma2:9b | 55.01 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | llava:7b | 68.98 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | llava:13b | 51.04 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | mistral:7b | 79 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | llama3.1:8b | 73.37 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | phi3:3.8b | 62.06 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | qwen2:7b | 76.78 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | gemma2:9b | 54.68 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | llava:7b | 54.28 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | llava:13b | 45.95 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.13 | mistral:7b | 50.29 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.13 | llama3.1:8b | 46.68 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.13 | phi3:3.8b | 58.6 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.13 | qwen2:7b | 40.23 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.13 | gemma2:9b | 30.87 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.13 | llava:7b | 48.73 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.13 | llava:13b | 28.73 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.12 | mistral:7b | 51.11 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.12 | llama3.1:8b | 43.45 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.12 | phi3:3.8b | 68.37 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.12 | qwen2:7b | 45.91 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.12 | gemma2:9b | 35.84 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.12 | llava:7b | 53.09 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.12 | llava:13b | 28.45 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.12 | mistral:7b | 72.07 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.12 | llama3.1:8b | 67.78 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.12 | phi3:3.8b | 81.63 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.12 | qwen2:7b | 68.71 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.12 | gemma2:9b | 49.56 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.12 | llava:7b | 74.97 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.12 | llava:13b | 46.85 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | mistral:7b | 62.08 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | llama3.1:8b | 58.09 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | phi3:3.8b | 81.46 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | qwen2:7b | 59.15 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | gemma2:9b | 39.2 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:7b | 58.18 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:13b | 33.64 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.13 | qwen2:1.5b-instruct-fp16 | 27.78 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.13 | qwen2:7b | 20.06 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.12 | mistral:7b | 61.49 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.12 | llama3.1:8b | 56.34 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.12 | phi3:3.8b | 78.01 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.12 | qwen2:7b | 59.93 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.12 | gemma2:9b | 43.13 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.12 | llava:7b | 62.78 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.12 | llava:13b | 36.65 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.14 | mistral:7b | 28.78 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.14 | llama3.1:8b | 26.6 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.14 | phi3:3.8b | 43.98 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.14 | qwen2:7b | 28.13 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.14 | gemma2:9b | 20.93 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.14 | llava:7b | 29.03 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.3.14 | llava:13b | 15.98 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.13 | llama3.1:8b | 51.35 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | mistral:7b | 32.92 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | llama3.1:8b | 30.17 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | phi3:3.8b | 46.59 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | qwen2:7b | 31.8 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | gemma2:9b | 23.72 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | llava:7b | 34.54 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | llava:13b | 19.55 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | mistral:7b | 13.03 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | llama3.1:8b | 11.98 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | phi3:3.8b | 18.27 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | qwen2:7b | 12.58 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | gemma2:9b | 9.52 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:7b | 13.79 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:13b | 7.63 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | mistral:7b | 53.2 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llama3.1:8b | 48.46 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | phi3:3.8b | 68.97 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | qwen2:7b | 51.27 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | gemma2:9b | 36.55 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:7b | 52.06 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:13b | 26.85 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.14 | mistral:7b | 61.15 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.14 | llama3.1:8b | 54.27 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.14 | phi3:3.8b | 78.43 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.14 | qwen2:7b | 55.35 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.14 | gemma2:9b | 40.97 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.14 | llava:7b | 62.88 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.3.14 | llava:13b | 36.64 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.14 | mistral:7b | 38.68 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.14 | llama3.1:8b | 49.38 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.14 | phi3:3.8b | 36.82 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.14 | qwen2:7b | 31.28 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.14 | gemma2:9b | 29.9 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.14 | llava:7b | 48.98 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.14 | llava:13b | 31.32 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.3 | mistral:7b | 28.5 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.3 | llama3.1:8b | 26.24 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.3 | phi3:3.8b | 43.71 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.3 | qwen2:7b | 27.96 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.3 | gemma2:9b | 21.17 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.3 | llava:7b | 28.96 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.3 | llava:13b | 16.57 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.14 | mistral:7b | 20.57 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.14 | llama3.1:8b | 13.27 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.14 | phi3:3.8b | 24.98 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.14 | qwen2:7b | 19.27 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.14 | gemma2:9b | 13.25 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.14 | llava:7b | 19.45 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.3.14 | llava:13b | 10.54 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.3.14 | mistral:7b | 61.24 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.3.14 | llama3.1:8b | 57.75 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.3.14 | phi3:3.8b | 78.43 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.3.14 | qwen2:7b | 60.28 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.3.14 | gemma2:9b | 44.2 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.3.14 | llava:7b | 65.09 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.3.14 | llava:13b | 38.46 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | mistral:7b | 13.03 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | llama3.1:8b | 11.71 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | phi3:3.8b | 19.72 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | qwen2:7b | 11.44 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | gemma2:9b | 8.59 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:7b | 12.36 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:13b | 6.31 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | mistral:7b | 13.07 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | llama3.1:8b | 11.83 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | phi3:3.8b | 17.89 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | qwen2:7b | 12.45 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | gemma2:9b | 7.83 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:7b | 13.63 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:13b | 7.53 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.14 | mistral:7b | 50.11 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.14 | llama3.1:8b | 47.39 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.14 | phi3:3.8b | 68.86 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.14 | qwen2:7b | 50.24 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.14 | gemma2:9b | 36.99 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.14 | llava:7b | 52.21 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.14 | llava:13b | 30.64 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.14 | mistral:7b | 51.48 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.14 | llama3.1:8b | 47.7 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.14 | phi3:3.8b | 67.98 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.14 | qwen2:7b | 45.88 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.14 | gemma2:9b | 35.16 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.14 | llava:7b | 51.91 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.3.14 | llava:13b | 30.01 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.3.14 | mistral:7b | 63.45 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.3.14 | llama3.1:8b | 58.2 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.3.14 | phi3:3.8b | 79.44 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.3.14 | qwen2:7b | 60.07 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.3.14 | gemma2:9b | 45.45 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.3.14 | llava:7b | 65.25 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.3.14 | llava:13b | 38.64 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | mistral:7b | 52.96 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llama3.1:8b | 48.86 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | phi3:3.8b | 69.99 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | qwen2:7b | 49.98 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | gemma2:9b | 36.94 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:7b | 52.4 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:13b | 32.77 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | mistral:7b | 76.75 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | llama3.1:8b | 73.38 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | phi3:3.8b | 85.65 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | qwen2:7b | 76.48 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | gemma2:9b | 54.12 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | llava:7b | 77.97 |
macOS | Apple M1 Ultra | Apple M1 Ultra | 128.00 | macOS 14.5 (23F79) | 0.3.14 | llava:13b | 52.26 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | mistral:7b | 34.13 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | llama3.1:8b | 31.36 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | phi3:3.8b | 41.54 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | qwen2:7b | 32 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | gemma2:9b | 23.49 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | llava:7b | 34.65 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.3.14 | llava:13b | 18.92 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.3.14 | mistral:7b | 11.28 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.3.14 | llama3.1:8b | 11.43 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.3.14 | phi3:3.8b | 20.03 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.3.14 | qwen2:7b | 12.06 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.3.14 | gemma2:9b | 5.39 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:7b | 12.16 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | mistral:7b | 56.73 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llama3.1:8b | 52.72 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | phi3:3.8b | 73.31 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | qwen2:7b | 54.07 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | gemma2:9b | 37.66 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:7b | 53.66 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:13b | 30.99 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.3.14 | mistral:7b | 62.56 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.3.14 | llama3.1:8b | 58.34 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.3.14 | phi3:3.8b | 80.78 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.3.14 | qwen2:7b | 61.58 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.3.14 | gemma2:9b | 44.91 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:7b | 65.74 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:13b | 38.25 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | mistral:7b | 62.23 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | llama3.1:8b | 57.1 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | phi3:3.8b | 81.4 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | qwen2:7b | 59.93 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | gemma2:9b | 42.58 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:7b | 63.3 |
macOS | Apple M3 Max | Apple M3 Max | 48.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:13b | 37.06 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.3.6 | mistral:7b | 59.59 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.3.6 | llama3.1:8b | 54.99 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.3.6 | phi3:3.8b | 73.36 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.3.6 | qwen2:7b | 58.97 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.3.6 | gemma2:9b | 42.3 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.3.6 | llava:7b | 62.06 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.3.6 | llava:13b | 35.74 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | mistral:7b | 25.76 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llama3.1:8b | 27.24 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | phi3:3.8b | 43.6 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | qwen2:7b | 28.85 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | gemma2:9b | 21.62 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:7b | 30.95 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:13b | 17.17 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | mistral:7b | 29.8 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llama3.1:8b | 27.41 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | phi3:3.8b | 41.69 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | qwen2:7b | 29.01 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | gemma2:9b | 22.62 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:7b | 31.99 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:13b | 17.6 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | mistral:7b | 30.71 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llama3.1:8b | 27.73 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | phi3:3.8b | 47.67 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | qwen2:7b | 29 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | gemma2:9b | 21.84 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:7b | 31.72 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:13b | 17.89 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.0 | mistral:7b | 61.18 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.0 | llama3.1:8b | 53.28 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.0 | phi3:3.8b | 76.24 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.0 | qwen2:7b | 57.98 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.0 | gemma2:9b | 42.7 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.0 | llava:7b | 64.17 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.0 | llava:13b | 37.28 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.0 | mistral:7b | 61.26 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.0 | llama3.1:8b | 53.66 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.0 | phi3:3.8b | 79.96 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.0 | qwen2:7b | 57.92 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.0 | gemma2:9b | 41.67 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.0 | llava:7b | 62.48 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.0 | llava:13b | 36.66 |
macOS | Apple M3 | Apple M3 | 24.00 | macOS 14.7 (23H124) | 0.3.14 | mistral:7b | 18.35 |
macOS | Apple M3 | Apple M3 | 24.00 | macOS 14.7 (23H124) | 0.3.14 | llama3.1:8b | 14.21 |
macOS | Apple M3 | Apple M3 | 24.00 | macOS 14.7 (23H124) | 0.3.14 | phi3:3.8b | 23.21 |
macOS | Apple M3 | Apple M3 | 24.00 | macOS 14.7 (23H124) | 0.3.14 | qwen2:7b | 13.7 |
macOS | Apple M3 | Apple M3 | 24.00 | macOS 14.7 (23H124) | 0.3.14 | gemma2:9b | 9.75 |
macOS | Apple M3 | Apple M3 | 24.00 | macOS 14.7 (23H124) | 0.3.14 | llava:7b | 14.14 |
macOS | Apple M3 | Apple M3 | 24.00 | macOS 14.7 (23H124) | 0.3.14 | llava:13b | 7.54 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.3.14 | mistral:7b | 12.98 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.3.14 | llama3.1:8b | 11.14 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.3.14 | phi3:3.8b | 19.15 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.3.14 | qwen2:7b | 11.16 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.3.14 | gemma2:9b | 0.2 |
macOS | Apple M1 | Apple M1 | 8.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:7b | 11.08 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | mistral:7b | 56.65 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | llama3.1:8b | 48.69 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | phi3:3.8b | 62.49 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | qwen2:7b | 53.4 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | gemma2:9b | 40.66 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | llava:7b | 59.7 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | llava:13b | 35.48 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.0 | mistral:7b | 22.62 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.0 | llama3.1:8b | 20.88 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.0 | phi3:3.8b | 34.78 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.0 | qwen2:7b | 21.82 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.0 | gemma2:9b | 16.28 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.0 | llava:7b | 21.85 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.0 | llava:13b | 12.71 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.14 | mistral:7b | 63.35 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.14 | llama3.1:8b | 58.41 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.14 | phi3:3.8b | 85.1 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.14 | qwen2:7b | 61.94 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.14 | gemma2:9b | 45.36 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.14 | llava:7b | 53.16 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.3.14 | llava:13b | 36.98 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.4.0 | mistral:7b | 33.95 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.4.0 | llama3.1:8b | 31.01 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.4.0 | phi3:3.8b | 46.83 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.4.0 | qwen2:7b | 33.08 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.4.0 | gemma2:9b | 24.42 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.4.0 | llava:7b | 35.37 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.4.0 | llava:13b | 20.34 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.4.0 | mistral:7b | 61.33 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.4.0 | llama3.1:8b | 54.52 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.4.0 | phi3:3.8b | 76.93 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.4.0 | qwen2:7b | 52.42 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.4.0 | gemma2:9b | 34.9 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.4.0 | llava:7b | 64.06 |
macOS | Apple M2 Max | Apple M2 Max | 32.00 | macOS 14.3.1 (23D60) | 0.4.0 | llava:13b | 31.42 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.1 | mistral:7b | 46.49 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.1 | llama3.1:8b | 42.95 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.1 | phi3:3.8b | 67.67 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.1 | qwen2:7b | 46.35 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.1 | gemma2:9b | 34.62 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.1 | llava:7b | 48.95 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.1 | llava:13b | 27.88 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.4.0 | mistral:7b | 31.66 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.4.0 | llama3.1:8b | 28.74 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.4.0 | phi3:3.8b | 45.72 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.4.0 | qwen2:7b | 29.97 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.4.0 | gemma2:9b | 22.64 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.4.0 | llava:7b | 33.51 |
macOS | Apple M1 Pro | Apple M1 Pro | 32.00 | macOS 14.5 (23F79) | 0.4.0 | llava:13b | 18.4 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.4.1 | mistral:7b | 32.49 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.4.1 | llama3.1:8b | 29.98 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.4.1 | phi3:3.8b | 44.14 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.4.1 | qwen2:7b | 31.34 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.4.1 | gemma2:9b | 23.55 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.4.1 | llava:7b | 33.98 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.4.1 | llava:13b | 19.75 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.1 | mistral:7b | 23.03 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.1 | llama3.1:8b | 21.5 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.1 | phi3:3.8b | 37.15 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.1 | qwen2:7b | 22.36 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.1 | gemma2:9b | 16.88 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.1 | llava:7b | 22.58 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.1 | llava:13b | 13.25 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.1 | mistral:7b | 27.87 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.1 | llama3.1:8b | 25.65 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.1 | phi3:3.8b | 43.69 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.1 | qwen2:7b | 27.63 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.1 | gemma2:9b | 20.5 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.1 | llava:7b | 29.5 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.1 | llava:13b | 16.75 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.4.1 | mistral:7b | 85.95 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.4.1 | llama3.1:8b | 80.05 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.4.1 | phi3:3.8b | 104.88 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.4.1 | qwen2:7b | 86.19 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.4.1 | gemma2:9b | 60.07 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.4.1 | llava:7b | 89.21 |
macOS | Apple M2 Ultra | Apple M2 Ultra | 64.00 | macOS 14.5 (23F79) | 0.4.1 | llava:13b | 55.95 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.1 | mistral:7b | 59.73 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.1 | llama3.1:8b | 54.87 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.1 | phi3:3.8b | 79.53 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.1 | qwen2:7b | 58.73 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.1 | gemma2:9b | 42.46 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.1 | llava:7b | 63.75 |
macOS | Apple M2 Max | Apple M2 Max | 96.00 | macOS 14.4.1 (23E224) | 0.4.1 | llava:13b | 37.49 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.1 | mistral:7b | 35.94 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.1 | llama3.1:8b | 32.45 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.1 | phi3:3.8b | 52.14 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.1 | qwen2:7b | 34.29 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.1 | gemma2:9b | 25.52 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.1 | llava:7b | 37.13 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.1 | llava:13b | 21.02 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | mistral:7b | 33.21 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llama3.1:8b | 30.68 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | phi3:3.8b | 49.53 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | qwen2:7b | 33.54 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | gemma2:9b | 25.1 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:7b | 36.59 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:13b | 20.8 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | mistral:7b | 13.18 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | llama3.1:8b | 12.07 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | phi3:3.8b | 21.07 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | qwen2:7b | 12.68 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | gemma2:9b | 9.69 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:7b | 13.73 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.3.14 | llava:13b | 7.5 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.1 | mistral:7b | 46.43 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.1 | llama3.1:8b | 41.67 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.1 | phi3:3.8b | 65.3 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.1 | qwen2:7b | 44.56 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.1 | gemma2:9b | 32.37 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.1 | llava:7b | 48.88 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.1 | llava:13b | 28.09 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.4.1 | mistral:7b | 64.01 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.4.1 | llama3.1:8b | 57.28 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.4.1 | phi3:3.8b | 82.61 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.4.1 | qwen2:7b | 60.88 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.4.1 | gemma2:9b | 45.2 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.4.1 | llava:7b | 64.83 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.4.1 | llava:13b | 37.22 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.4.1 | mistral:7b | 34.18 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.4.1 | llama3.1:8b | 31.42 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.4.1 | phi3:3.8b | 44.15 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.4.1 | qwen2:7b | 33.18 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.4.1 | gemma2:9b | 25.06 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.4.1 | llava:7b | 35.56 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.4.1 | llava:13b | 20.42 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.4.1 | mistral:7b | 51.04 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.4.1 | llama3.1:8b | 47.42 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.4.1 | phi3:3.8b | 68.87 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.4.1 | qwen2:7b | 50.78 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.4.1 | gemma2:9b | 36.83 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.4.1 | llava:7b | 53.1 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.4.1 | llava:13b | 30.71 |
macOS | Apple M4 Max | Apple M4 Max | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | mistral:7b | 79.23 |
macOS | Apple M4 Max | Apple M4 Max | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | llama3.1:8b | 69.39 |
macOS | Apple M4 Max | Apple M4 Max | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | phi3:3.8b | 79.06 |
macOS | Apple M4 Max | Apple M4 Max | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | qwen2:7b | 62.31 |
macOS | Apple M4 Max | Apple M4 Max | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | gemma2:9b | 46.91 |
macOS | Apple M4 Max | Apple M4 Max | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | llava:7b | 70.35 |
macOS | Apple M4 Max | Apple M4 Max | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | llava:13b | 41.07 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.4.2 | mistral:7b | 43.98 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.4.2 | llama3.1:8b | 38.06 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.4.2 | phi3:3.8b | 63.82 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.4.2 | qwen2:7b | 37.54 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.4.2 | gemma2:9b | 28.06 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.4.2 | llava:7b | 54.45 |
macOS | Apple M2 Max | Apple M2 Max | 64.00 | macOS 14.3.1 (23D60) | 0.4.2 | llava:13b | 25.7 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | mistral:7b | 12.92 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | llama3.1:8b | 11.65 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | phi3:3.8b | 20.56 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | qwen2:7b | 12.29 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | gemma2:9b | 9.23 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | llava:7b | 13.42 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | llava:13b | 7.45 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | mistral:7b | 13.02 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | llama3.1:8b | 11.89 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | phi3:3.8b | 20.33 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | qwen2:7b | 12.59 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | gemma2:9b | 9.49 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | llava:7b | 13.51 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | llava:13b | 7.5 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.4.2 | mistral:7b | 20.39 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.4.2 | llama3.1:8b | 19.03 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.4.2 | phi3:3.8b | 32.16 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.4.2 | qwen2:7b | 19.98 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.4.2 | gemma2:9b | 15.13 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.4.2 | llava:7b | 21.15 |
macOS | Apple M3 | Apple M3 | 16.00 | macOS 14.3 (23D2057) | 0.4.2 | llava:13b | 11.9 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | mistral:7b | 12.98 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | llama3.1:8b | 12.02 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | phi3:3.8b | 19.45 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | qwen2:7b | 12.38 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | gemma2:9b | 9.39 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | llava:7b | 13.43 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.2 | llava:13b | 7.49 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | mistral:7b | 58.6 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | llama3.1:8b | 53.54 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | phi3:3.8b | 73.3 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | qwen2:7b | 50.87 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | gemma2:9b | 39.88 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | llava:7b | 59.97 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | llava:13b | 34.58 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | mistral:7b | 56.85 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | llama3.1:8b | 53.32 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | phi3:3.8b | 74.31 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | qwen2:7b | 51.98 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | gemma2:9b | 38.2 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | llava:7b | 57.28 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | llava:13b | 35.15 |
macOS | Apple M4 Max | Apple M4 Max | 128.00 | macOS 15.1.1 (24B2091) | 0.4.2 | mistral:7b | 78.68 |
macOS | Apple M4 Max | Apple M4 Max | 128.00 | macOS 15.1.1 (24B2091) | 0.4.2 | llama3.1:8b | 71.89 |
macOS | Apple M4 Max | Apple M4 Max | 128.00 | macOS 15.1.1 (24B2091) | 0.4.2 | phi3:3.8b | 100.34 |
macOS | Apple M4 Max | Apple M4 Max | 128.00 | macOS 15.1.1 (24B2091) | 0.4.2 | qwen2:7b | 75.75 |
macOS | Apple M4 Max | Apple M4 Max | 128.00 | macOS 15.1.1 (24B2091) | 0.4.2 | gemma2:9b | 54.41 |
macOS | Apple M4 Max | Apple M4 Max | 128.00 | macOS 15.1.1 (24B2091) | 0.4.2 | llava:7b | 82.19 |
macOS | Apple M4 Max | Apple M4 Max | 128.00 | macOS 15.1.1 (24B2091) | 0.4.2 | llava:13b | 48.7 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | mistral:7b | 57.31 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | llama3.1:8b | 52.29 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | phi3:3.8b | 72.82 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | qwen2:7b | 53.19 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | gemma2:9b | 38.16 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | llava:7b | 60.25 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | llava:13b | 33.4 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | mistral:7b | 46.91 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | llama3.1:8b | 43.38 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | phi3:3.8b | 66.46 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | qwen2:7b | 46.21 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | gemma2:9b | 33.97 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | llava:7b | 49.01 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | llava:13b | 28.03 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | mistral:7b | 46.28 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | llama3.1:8b | 43.13 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | phi3:3.8b | 64.66 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | qwen2:7b | 46.35 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | gemma2:9b | 34.06 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | llava:7b | 49.46 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.4.2 | llava:13b | 28.16 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.2 | mistral:7b | 21.75 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.2 | llama3.1:8b | 20.86 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.2 | phi3:3.8b | 32.63 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.2 | qwen2:7b | 21.17 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.2 | gemma2:9b | 16.04 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.2 | llava:7b | 22.67 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.2 | llava:13b | 11.89 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.2 | mistral:7b | 28.58 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.2 | llama3.1:8b | 26.59 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.2 | phi3:3.8b | 44.71 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.2 | qwen2:7b | 28.53 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.2 | gemma2:9b | 21 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.2 | llava:7b | 29.51 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.2 | llava:13b | 16.41 |
macOS | Apple M3 | Apple M3 | 24.00 | macOS 14.7 (23H124) | 0.4.2 | mistral:7b | 19.38 |
macOS | Apple M3 | Apple M3 | 24.00 | macOS 14.7 (23H124) | 0.4.2 | llama3.1:8b | 17.85 |
macOS | Apple M3 | Apple M3 | 24.00 | macOS 14.7 (23H124) | 0.4.2 | phi3:3.8b | 28.74 |
macOS | Apple M3 | Apple M3 | 24.00 | macOS 14.7 (23H124) | 0.4.2 | qwen2:7b | 17.16 |
macOS | Apple M3 | Apple M3 | 24.00 | macOS 14.7 (23H124) | 0.4.2 | gemma2:9b | 13.13 |
macOS | Apple M3 | Apple M3 | 24.00 | macOS 14.7 (23H124) | 0.4.2 | llava:7b | 18.94 |
macOS | Apple M3 | Apple M3 | 24.00 | macOS 14.7 (23H124) | 0.4.2 | llava:13b | 10.27 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.3 | mistral:7b | 27.89 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.3 | llama3.1:8b | 25.98 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.3 | phi3:3.8b | 42.14 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.3 | qwen2:7b | 27.68 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.3 | gemma2:9b | 20.3 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.3 | llava:7b | 28.87 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.3 | llava:13b | 16.38 |
macOS | Apple M4 Max | Apple M4 Max | 64.00 | macOS 15.1 (24B2082) | 0.4.3 | mistral:7b | 78.95 |
macOS | Apple M4 Max | Apple M4 Max | 64.00 | macOS 15.1 (24B2082) | 0.4.3 | llama3.1:8b | 72.37 |
macOS | Apple M4 Max | Apple M4 Max | 64.00 | macOS 15.1 (24B2082) | 0.4.3 | phi3:3.8b | 103.45 |
macOS | Apple M4 Max | Apple M4 Max | 64.00 | macOS 15.1 (24B2082) | 0.4.3 | qwen2:7b | 75.16 |
macOS | Apple M4 Max | Apple M4 Max | 64.00 | macOS 15.1 (24B2082) | 0.4.3 | gemma2:9b | 54.83 |
macOS | Apple M4 Max | Apple M4 Max | 64.00 | macOS 15.1 (24B2082) | 0.4.3 | llava:7b | 82.41 |
macOS | Apple M4 Max | Apple M4 Max | 64.00 | macOS 15.1 (24B2082) | 0.4.3 | llava:13b | 48.27 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.3 | mistral:7b | 41.95 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.3 | llama3.1:8b | 37.23 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.3 | phi3:3.8b | 60.65 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.3 | qwen2:7b | 39.06 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.3 | gemma2:9b | 29.39 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.3 | llava:7b | 45.9 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.3 | llava:13b | 24.46 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.4.3 | mistral:7b | 18.93 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.4.3 | llama3.1:8b | 16.04 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.4.3 | phi3:3.8b | 19.16 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.4.3 | qwen2:7b | 12.31 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.4.3 | gemma2:9b | 10.7 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.4.3 | llava:7b | 15.34 |
macOS | Apple M2 | Apple M2 | 16.00 | macOS 14.3 (23D56) | 0.4.3 | llava:13b | 8.59 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.3 | mistral:7b | 57.38 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.3 | llama3.1:8b | 53.04 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.3 | phi3:3.8b | 71.57 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.3 | qwen2:7b | 55.51 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.3 | gemma2:9b | 39.95 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.3 | llava:7b | 59.79 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.3 | llava:13b | 34.32 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.3 | mistral:7b | 12.6 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.3 | llama3.1:8b | 10.77 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.3 | phi3:3.8b | 19.77 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.3 | qwen2:7b | 11.4 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.3 | gemma2:9b | 8.28 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.3 | llava:7b | 12.04 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.3 | llava:13b | 6.41 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.4 | mistral:7b | 57.32 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.4 | llama3.1:8b | 52.36 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.4 | phi3:3.8b | 72.34 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.4 | qwen2:7b | 54.85 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.4 | gemma2:9b | 39.77 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.4 | llava:7b | 59.3 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.4 | llava:13b | 35.12 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.4 | mistral:7b | 46.57 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.4 | llama3.1:8b | 41.72 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.4 | phi3:3.8b | 62.3 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.4 | qwen2:7b | 44.99 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.4 | gemma2:9b | 32.91 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.4 | llava:7b | 48.46 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.4 | llava:13b | 28.1 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.3 | mistral:7b | 59.42 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.3 | llama3.1:8b | 53.07 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.3 | phi3:3.8b | 49.26 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.3 | qwen2:7b | 55.16 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.3 | gemma2:9b | 39.87 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.3 | llava:7b | 50.51 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.3 | llava:13b | 32.58 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | mistral:7b | 59.91 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | llama3.1:8b | 52.99 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | phi3:3.8b | 66.54 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | qwen2:7b | 55.11 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | gemma2:9b | 40.13 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | llava:7b | 58.94 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.2 | llava:13b | 35.19 |
macOS | Apple M4 | Apple M4 | 24.00 | macOS 15.1.1 (24B2091) | 0.4.5 | mistral:7b | 22.61 |
macOS | Apple M4 | Apple M4 | 24.00 | macOS 15.1.1 (24B2091) | 0.4.5 | llama3.1:8b | 21.31 |
macOS | Apple M4 | Apple M4 | 24.00 | macOS 15.1.1 (24B2091) | 0.4.5 | phi3:3.8b | 36.76 |
macOS | Apple M4 | Apple M4 | 24.00 | macOS 15.1.1 (24B2091) | 0.4.5 | qwen2:7b | 22.46 |
macOS | Apple M4 | Apple M4 | 24.00 | macOS 15.1.1 (24B2091) | 0.4.5 | gemma2:9b | 16.98 |
macOS | Apple M4 | Apple M4 | 24.00 | macOS 15.1.1 (24B2091) | 0.4.5 | llava:7b | 23.76 |
macOS | Apple M4 | Apple M4 | 24.00 | macOS 15.1.1 (24B2091) | 0.4.5 | llava:13b | 13.34 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.4.5 | mistral:7b | 51.23 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.4.5 | llama3.1:8b | 47.39 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.4.5 | phi3:3.8b | 70.55 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.4.5 | qwen2:7b | 50.6 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.4.5 | gemma2:9b | 36.29 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.4.5 | llava:7b | 52.11 |
macOS | Apple M3 Max | Apple M3 Max | 36.00 | macOS 14.3.1 (23D60) | 0.4.5 | llava:13b | 29.8 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.5 | mistral:7b | 58.18 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.5 | llama3.1:8b | 53.06 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.5 | phi3:3.8b | 73.24 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.5 | qwen2:7b | 56.57 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.5 | gemma2:9b | 40.02 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.5 | llava:7b | 61.19 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.5 | llava:13b | 34.53 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.5 | mistral:7b | 45.48 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.5 | llama3.1:8b | 41.17 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.5 | phi3:3.8b | 63.72 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.5 | qwen2:7b | 43.95 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.5 | gemma2:9b | 32.08 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.5 | llava:7b | 47.91 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.5 | llava:13b | 26.57 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.4 | mistral:7b | 36.03 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.4 | llama3.1:8b | 32.29 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.4 | phi3:3.8b | 51.8 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.4 | qwen2:7b | 34.36 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.4 | gemma2:9b | 25.93 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.4 | llava:7b | 36.99 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.4 | llava:13b | 20.94 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.4 | mistral:7b | 35.66 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.4 | llama3.1:8b | 32.51 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.4 | phi3:3.8b | 46.92 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.4 | qwen2:7b | 34.31 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.4 | gemma2:9b | 25.3 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.4 | llava:7b | 36.91 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.4.4 | llava:13b | 21 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.6 | mistral:7b | 13.05 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.6 | llama3.1:8b | 12.02 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.6 | phi3:3.8b | 20.07 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.6 | qwen2:7b | 12.69 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.6 | gemma2:9b | 9.79 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.6 | llava:7b | 13.57 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.4.6 | llava:13b | 7.31 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.4.6 | mistral:7b | 63.37 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.4.6 | llama3.1:8b | 53.09 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.4.6 | phi3:3.8b | 81.06 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.4.6 | qwen2:7b | 60.8 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.4.6 | gemma2:9b | 45.31 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.4.6 | llava:7b | 65.32 |
macOS | Apple M3 Max | Apple M3 Max | 64.00 | macOS 14.5 (23F79) | 0.4.6 | llava:13b | 38.09 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.7 | mistral:7b | 41.52 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.7 | llama3.1:8b | 36.18 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.7 | phi3:3.8b | 66.48 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.7 | qwen2:7b | 44.82 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.7 | gemma2:9b | 33.89 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.7 | llava:7b | 51.68 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.7 | llava:13b | 29.05 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.7 | mistral:7b | 22.19 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.7 | llama3.1:8b | 19.44 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.7 | phi3:3.8b | 36.45 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.7 | qwen2:7b | 21.62 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.7 | gemma2:9b | 16.37 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.7 | llava:7b | 22.8 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.4.7 | llava:13b | 12.98 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.4.4 | mistral:7b | 28.37 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.4.4 | llama3.1:8b | 24.67 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.4.4 | phi3:3.8b | 43.77 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.4.4 | qwen2:7b | 28.62 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.4.4 | gemma2:9b | 21.17 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.4.4 | llava:7b | 29.91 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.4.4 | llava:13b | 16.84 |
macOS | Apple M4 Pro | Apple M4 Pro | 48.00 | macOS 15.1.1 (24B2091) | 0.4.7 | mistral:7b | 46.98 |
macOS | Apple M4 Pro | Apple M4 Pro | 48.00 | macOS 15.1.1 (24B2091) | 0.4.7 | llama3.1:8b | 38.58 |
macOS | Apple M4 Pro | Apple M4 Pro | 48.00 | macOS 15.1.1 (24B2091) | 0.4.7 | phi3:3.8b | 66.95 |
macOS | Apple M4 Pro | Apple M4 Pro | 48.00 | macOS 15.1.1 (24B2091) | 0.4.7 | qwen2:7b | 45.56 |
macOS | Apple M4 Pro | Apple M4 Pro | 48.00 | macOS 15.1.1 (24B2091) | 0.4.7 | gemma2:9b | 34.07 |
macOS | Apple M4 Pro | Apple M4 Pro | 48.00 | macOS 15.1.1 (24B2091) | 0.4.7 | llava:7b | 48.3 |
macOS | Apple M4 Pro | Apple M4 Pro | 48.00 | macOS 15.1.1 (24B2091) | 0.4.7 | llava:13b | 27.79 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.7 | mistral:7b | 44.62 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.7 | llama3.1:8b | 34.16 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.7 | phi3:3.8b | 64.37 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.7 | qwen2:7b | 43.11 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.7 | gemma2:9b | 31.37 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.7 | llava:7b | 47.29 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.4.7 | llava:13b | 26.34 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.7 | mistral:7b | 59.72 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.7 | llama3.1:8b | 45.44 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.7 | phi3:3.8b | 72.03 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.7 | qwen2:7b | 57.57 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.7 | gemma2:9b | 41.96 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.7 | llava:7b | 62.48 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.4.7 | llava:13b | 36.66 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.7 | mistral:7b | 28.51 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.7 | llama3.1:8b | 24.81 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.7 | phi3:3.8b | 43.66 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.7 | qwen2:7b | 28.03 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.7 | gemma2:9b | 21.04 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.7 | llava:7b | 29.19 |
macOS | Apple M3 Pro | Apple M3 Pro | 18.00 | macOS 14.5 (23F79) | 0.4.7 | llava:13b | 16.57 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.5.1 | mistral:7b | 46.96 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.5.1 | llama3.1:8b | 38.61 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.5.1 | phi3:3.8b | 66.83 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.5.1 | qwen2:7b | 46.11 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.5.1 | gemma2:9b | 34.02 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.5.1 | llava:7b | 48.96 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.5.1 | llava:13b | 26.73 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.5.1 | mistral:7b | 46.74 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.5.1 | llama3.1:8b | 38.73 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.5.1 | phi3:3.8b | 58.54 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.5.1 | qwen2:7b | 46.24 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.5.1 | gemma2:9b | 34.53 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.5.1 | llava:7b | 48.69 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.5.1 | llava:13b | 28.39 |
macOS | Apple M3 Max | Apple M3 Max | 96.00 | macOS 15.2 (24C5089c) | 0.4.7 | marco-o1:7b | 45.82 |
macOS | Apple M3 Max | Apple M3 Max | 96.00 | macOS 15.2 (24C5089c) | 0.4.7 | llama3.2:3b | 83.01 |
macOS | Apple M3 Max | Apple M3 Max | 96.00 | macOS 15.2 (24C5089c) | 0.4.7 | llama3.3:70b | 5.68 |
macOS | Apple M4 Max | Apple M4 Max | 128.00 | macOS 15.1.1 (24B2091) | 0.4.7 | mistral:7b | 77.45 |
macOS | Apple M4 Max | Apple M4 Max | 128.00 | macOS 15.1.1 (24B2091) | 0.4.7 | llama3.1:8b | 54.63 |
macOS | Apple M4 Max | Apple M4 Max | 128.00 | macOS 15.1.1 (24B2091) | 0.4.7 | phi3:3.8b | 52.17 |
macOS | Apple M4 Max | Apple M4 Max | 128.00 | macOS 15.1.1 (24B2091) | 0.4.7 | qwen2:7b | 37.92 |
macOS | Apple M4 Max | Apple M4 Max | 128.00 | macOS 15.1.1 (24B2091) | 0.4.7 | gemma2:9b | 27.36 |
macOS | Apple M4 Max | Apple M4 Max | 128.00 | macOS 15.1.1 (24B2091) | 0.4.7 | llava:7b | 39.42 |
macOS | Apple M4 Max | Apple M4 Max | 128.00 | macOS 15.1.1 (24B2091) | 0.4.7 | llava:13b | 22.07 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.14 | mistral:7b | 28.16 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.14 | llama3.1:8b | 24.78 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.14 | phi3:3.8b | 40.49 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.14 | qwen2:7b | 28.22 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.14 | gemma2:9b | 21.11 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.14 | llava:7b | 29.54 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.3.14 | llava:13b | 16.84 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.5.1 | mistral:7b | 49.01 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.5.1 | llama3.1:8b | 34.99 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.5.1 | phi3:3.8b | 69.8 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.5.1 | qwen2:7b | 44.92 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.5.1 | gemma2:9b | 34.45 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.5.1 | llava:7b | 55.52 |
macOS | Apple M1 Max | Apple M1 Max | 64.00 | macOS 14.4.1 (23E224) | 0.5.1 | llava:13b | 28.57 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.3.12 | mistral:7b | 46.66 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.3.12 | llama3.1:8b | 35.09 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.3.12 | phi3:3.8b | 66.99 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.3.12 | qwen2:7b | 44.7 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.3.12 | gemma2:9b | 33.03 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.3.12 | llava:7b | 49.07 |
macOS | Apple M4 Pro | Apple M4 Pro | 24.00 | macOS 15.1 (24B2082) | 0.3.12 | llava:13b | 27.85 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | mistral:7b | 57.59 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | llama3.1:8b | 43.56 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | phi3:3.8b | 74.73 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | qwen2:7b | 56.19 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | gemma2:9b | 40.64 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | llava:7b | 60.13 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | llava:13b | 35.85 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | mistral:7b | 57.2 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | llama3.1:8b | 43.47 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | phi3:3.8b | 70.57 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | qwen2:7b | 54.5 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | gemma2:9b | 39.55 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | llava:7b | 59.31 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.4.0 | llava:13b | 34.44 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.5.1 | mistral:7b | 57.41 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.5.1 | llama3.1:8b | 43.6 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.5.1 | phi3:3.8b | 73 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.5.1 | qwen2:7b | 54.71 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.5.1 | gemma2:9b | 39.96 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.5.1 | llava:7b | 59.57 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.5.1 | llava:13b | 35.39 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.5.1 | mistral:7b | 28.68 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.5.1 | llama3.1:8b | 25.08 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.5.1 | phi3:3.8b | 44.25 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.5.1 | qwen2:7b | 28.55 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.5.1 | gemma2:9b | 20.93 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.5.1 | llava:7b | 29.32 |
macOS | Apple M3 Pro | Apple M3 Pro | 36.00 | macOS 14.6.1 (23G93) | 0.5.1 | llava:13b | 16.67 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.5.1 | mistral:7b | 19.86 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.5.1 | llama3.1:8b | 14.85 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.5.1 | phi3:3.8b | 30.59 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.5.1 | qwen2:7b | 18.63 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.5.1 | gemma2:9b | 13.74 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.5.1 | llava:7b | 20.53 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.5.1 | llava:13b | 11.55 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.5.1 | mistral:7b | 11.58 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.5.1 | llama3.1:8b | 8.78 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.5.1 | phi3:3.8b | 15.96 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.5.1 | qwen2:7b | 8.03 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.5.1 | gemma2:9b | 5.36 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.5.1 | llava:7b | 9.13 |
macOS | Apple M1 | Apple M1 | 16.00 | macOS 14.4.1 (23E224) | 0.5.1 | llava:13b | 4.45 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.5.3 | mistral:7b | 48.55 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.5.3 | llama3.1:8b | 40.35 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.5.3 | phi3:3.8b | 71.93 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.5.3 | qwen2:7b | 48.78 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.5.3 | gemma2:9b | 36.94 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.5.3 | llava:7b | 52.76 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.5.3 | llava:13b | 29.56 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.5.1 | mistral:7b | 33.6 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.5.1 | llama3.1:8b | 25.72 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.5.1 | phi3:3.8b | 47.08 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.5.1 | qwen2:7b | 32.84 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.5.1 | gemma2:9b | 24.24 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.5.1 | llava:7b | 34.17 |
macOS | Apple M1 Pro | Apple M1 Pro | 16.00 | macOS 14.4 (23E214) | 0.5.1 | llava:13b | 12.28 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.5.4 | mistral:7b | 35.98 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.5.4 | llama3.1:8b | 29.35 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.5.4 | phi3:3.8b | 53.11 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.5.4 | qwen2:7b | 34.63 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.5.4 | gemma2:9b | 25.83 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.5.4 | llava:7b | 37.73 |
macOS | Apple M2 Pro | Apple M2 Pro | 16.00 | macOS 14.4.1 (23E224) | 0.5.4 | llava:13b | 20.93 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.5.4 | mistral:7b | 36.54 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.5.4 | llama3.1:8b | 30.55 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.5.4 | phi3:3.8b | 48.06 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.5.4 | qwen2:7b | 35.8 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.5.4 | gemma2:9b | 26.5 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.5.4 | llava:7b | 38.11 |
macOS | Apple M2 Pro | Apple M2 Pro | 32.00 | macOS 14.4.1 (23E224) | 0.5.4 | llava:13b | 21.48 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.5.4 | mistral:7b | 65.79 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.5.4 | llama3.1:8b | 47.15 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.5.4 | phi3:3.8b | 89.88 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.5.4 | qwen2:7b | 64.73 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.5.4 | gemma2:9b | 46.74 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.5.4 | llava:7b | 69.05 |
macOS | Apple M3 Max | Apple M3 Max | 128.00 | macOS 14.5 (23F79) | 0.5.4 | llava:13b | 39.47 |
macOS | Apple M4 Pro | Apple M4 Pro | 48.00 | macOS 15.1.1 (24B2091) | 0.5.3 | mistral:7b | 48.5 |
macOS | Apple M4 Pro | Apple M4 Pro | 48.00 | macOS 15.1.1 (24B2091) | 0.5.3 | llama3.1:8b | 40.32 |
macOS | Apple M4 Pro | Apple M4 Pro | 48.00 | macOS 15.1.1 (24B2091) | 0.5.3 | phi3:3.8b | 69.17 |
macOS | Apple M4 Pro | Apple M4 Pro | 48.00 | macOS 15.1.1 (24B2091) | 0.5.3 | qwen2:7b | 46.88 |
macOS | Apple M4 Pro | Apple M4 Pro | 48.00 | macOS 15.1.1 (24B2091) | 0.5.3 | gemma2:9b | 35.73 |
macOS | Apple M4 Pro | Apple M4 Pro | 48.00 | macOS 15.1.1 (24B2091) | 0.5.3 | llava:7b | 51.29 |
macOS | Apple M4 Pro | Apple M4 Pro | 48.00 | macOS 15.1.1 (24B2091) | 0.5.3 | llava:13b | 28.39 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.5.3 | mistral:7b | 47.47 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.5.3 | llama3.1:8b | 38.79 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.5.3 | phi3:3.8b | 65.64 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.5.3 | qwen2:7b | 46.84 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.5.3 | gemma2:9b | 34.42 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.5.3 | llava:7b | 50.31 |
macOS | Apple M4 Pro | Apple M4 Pro | 64.00 | macOS 15.1 (24B2082) | 0.5.3 | llava:13b | 28.71 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.5.4 | mistral:7b | 46.97 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.5.4 | llama3.1:8b | 33.54 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.5.4 | phi3:3.8b | 69.12 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.5.4 | qwen2:7b | 43.83 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.5.4 | gemma2:9b | 33.08 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.5.4 | llava:7b | 52.07 |
macOS | Apple M1 Max | Apple M1 Max | 32.00 | macOS 14.4.1 (23E224) | 0.5.4 | llava:13b | 26.05 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.5.4 | mistral:7b | 22.78 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.5.4 | llama3.1:8b | 19.95 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.5.4 | phi3:3.8b | 37.11 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.5.4 | qwen2:7b | 22.33 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.5.4 | gemma2:9b | 17.14 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.5.4 | llava:7b | 23.39 |
macOS | Apple M4 | Apple M4 | 16.00 | macOS 15.1 (24B2083) | 0.5.4 | llava:13b | 13.23 |