Results for Linux

Select Models:

systemcpugpumemoryos_versionollama_versionmodel_namethroughput
LinuxunknownNVIDIA GH200 144G HBM3e621.29Ubuntu 24.04.1 LTS0.3.14llama3.1:8b199.37
LinuxunknownNVIDIA GH200 144G HBM3e621.29Ubuntu 24.04.1 LTS0.3.13llama3.1:8b197.16
LinuxunknownNVIDIA GH200 480GB573.80"Ubuntu 22.04.5 LTS"0.3.14llama3.1:8b196.85
LinuxNeoverse-V2NVIDIA GH200 480GB573.31"Ubuntu 22.04.5 LTS"0.4.0llama3.1:8b161.53
LinuxIntel(R) Xeon(R) Bronze 3408UNVIDIA H100 80GB HBM315.33Ubuntu 24.04.1 LTS0.3.10llama3.1:8b146.93
LinuxIntel(R) Xeon(R) Platinum 8352Y CPU @ 2.20GHzNVIDIA H100 PCIe2015.51Ubuntu 22.04.4 LTS0.3.11llama3.1:8b146.07
LinuxAMD Ryzen 9 7950X 16-Core ProcessorNVIDIA GeForce RTX 409061.95"Ubuntu 22.04.5 LTS"0.3.14llama3.1:8b145.86
LinuxAMD Ryzen 9 9950X 16-Core ProcessorNVIDIA GeForce RTX 409091.95Ubuntu 24.04.1 LTS0.3.12llama3.1:8b145.39
LinuxAMD Ryzen 9 9950X 16-Core ProcessorNVIDIA GeForce RTX 409091.95Ubuntu 24.04.1 LTS0.3.12llama3.1:8b145.36
LinuxAMD Ryzen Threadripper PRO 7985WX 64-CoresNVIDIA GeForce RTX 4090754.98Ubuntu 24.04.1 LTS0.3.13llama3.1:8b144.4
LinuxAMD Ryzen Threadripper PRO 7985WX 64-CoresNVIDIA GeForce RTX 4090754.98Ubuntu 24.04.1 LTS0.3.13llama3.1:8b144.27
LinuxAMD Ryzen Threadripper PRO 7985WX 64-CoresNVIDIA GeForce RTX 4090754.98Ubuntu 24.04.1 LTS0.3.13llama3.1:8b144.07
LinuxAMD Ryzen 9 7900 12-Core ProcessorNVIDIA GeForce RTX 409030.47Ubuntu 24.04.1 LTS0.3.12llama3.1:8b142.51
LinuxAMD Ryzen 9 7950X 16-Core ProcessorNVIDIA GeForce RTX 4090125.01Ubuntu 24.04.1 LTS0.3.11llama3.1:8b142.32
LinuxIntel(R) Xeon(R) Platinum 8352Y CPU @ 2.20GHzNVIDIA H100 PCIe2015.51Ubuntu 22.04.4 LTS0.3.11llama3.1:8b141.94
LinuxAMD Ryzen 9 7950X 16-Core ProcessorNVIDIA GeForce RTX 4090125.01Ubuntu 24.04.1 LTS0.4.4llama3.1:8b141.8
LinuxunknownNVIDIA GH200 480GB573.80Ubuntu 22.04.4 LTS0.3.0llama3.1:8b141.37
LinuxAMD Ryzen 9 7950X3D 16-Core ProcessorNVIDIA GeForce RTX 409015.23Ubuntu 22.04.3 LTS0.3.12llama3.1:8b141.35
LinuxAMD Ryzen 9 7950X3D 16-Core ProcessorNVIDIA GeForce RTX 409015.23Ubuntu 22.04.3 LTS0.3.12llama3.1:8b140.59
LinuxAMD Ryzen 9 9950X 16-Core ProcessorNVIDIA GeForce RTX 409091.95Ubuntu 24.04.1 LTS0.3.12llama3.1:8b140.4
Linux13th Gen Intel(R) Core(TM) i9-13900NVIDIA GeForce RTX 4090125.53Ubuntu 22.04.5 LTS0.3.14llama3.1:8b140.27
LinuxIntel(R) Xeon(R) Platinum 8480+NVIDIA H100 80GB HBM3221.18Ubuntu 22.04.5 LTS0.4.0llama3.1:8b139.09
LinuxIntel(R) Core(TM) i9-14900KSNVIDIA GeForce RTX 409094.07Ubuntu 24.04.1 LTS0.5.4llama3.1:8b138.47
LinuxAMD Ryzen 9 7950X 16-Core ProcessorNVIDIA GeForce RTX 3090187.79Ubuntu 24.04 LTS0.3.4llama3.1:8b137.77
LinuxAMD Ryzen 9 9900X 12-Core ProcessorNVIDIA GeForce RTX 409030.99Manjaro Linux0.3.10llama3.1:8b137.41
LinuxAMD Ryzen 9 9900X 12-Core ProcessorNVIDIA GeForce RTX 409030.99Manjaro Linux0.3.10llama3.1:8b136.14
LinuxAMD Ryzen 7 8700G w/ Radeon 780M GraphicsNVIDIA GeForce RTX 409062.37Ubuntu 24.04.1 LTS0.5.1llama3.1:8b136.1
LinuxAMD Ryzen Threadripper PRO 5955WX 16-CoresNVIDIA GeForce RTX 4090251.54Debian GNU/Linux 12 (bookworm)0.3.13llama3.1:8b135.54
Linux13th Gen Intel(R) Core(TM) i9-13900NVIDIA GeForce RTX 4090125.53Ubuntu 22.04.5 LTS0.3.14llama3.1:8b135.43
LinuxIntel(R) Core(TM) i9-14900KSNVIDIA GeForce RTX 409046.93"Ubuntu 22.04.5 LTS"0.4.4llama3.1:8b135.22
Linux12th Gen Intel(R) Core(TM) i5-12600KFNVIDIA GeForce RTX 4090 D62.61Ubuntu 22.04.5 LTS0.4.1llama3.1:8b135.06
LinuxAMD Ryzen Threadripper PRO 5965WX 24-CoresNVIDIA GeForce RTX 4090125.60"Fedora Linux 41 (Workstation Edition)"0.5.1llama3.1:8b134.62
LinuxIntel(R) Core(TM) i7-14700NVIDIA GeForce RTX 409062.54Ubuntu 22.04.5 LTS0.3.14llama3.1:8b132.76
LinuxAMD Ryzen Threadripper PRO 5965WX 24-CoresNVIDIA GeForce RTX 4090125.60"Fedora Linux 41 (Workstation Edition)"0.5.1llama3.1:8b132.41
LinuxAMD Ryzen 9 9950X 16-Core ProcessorNVIDIA GeForce RTX 409091.95Ubuntu 24.04.1 LTS0.3.12llama3.1:8b132.07
Linux13th Gen Intel(R) Core(TM) i9-13900KFNVIDIA GeForce RTX 4090125.63Ubuntu 22.04.5 LTS0.4.1llama3.1:8b131.87
LinuxAMD Ryzen 9 7950X3D 16-Core ProcessorNVIDIA GeForce RTX 409015.23Ubuntu 22.04.3 LTS0.3.12llama3.1:8b128.22
LinuxAMD Ryzen Threadripper PRO 7975WX 32-CoresNVIDIA GeForce RTX 309023.44Ubuntu 22.04.5 LTS0.4.3llama3.1:8b128.17
LinuxAMD Ryzen 9 9950X 16-Core ProcessorNVIDIA GeForce RTX 409091.95Ubuntu 24.04.1 LTS0.3.12llama3.1:8b128.13
Linux13th Gen Intel(R) Core(TM) i7-13700KFNVIDIA GeForce RTX 409031.26Ubuntu 22.04.2 LTS0.5.4llama3.1:8b127.51
LinuxIntel(R) Core(TM) i9-14900KFNVIDIA GeForce RTX 3090125.61Pop!_OS 22.04 LTS0.3.12llama3.1:8b127.43
LinuxIntel CorporationNVIDIA GeForce RTX 40902015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b127.05
LinuxIntel CorporationNVIDIA GeForce RTX 40902015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b126.98
LinuxIntel CorporationNVIDIA GeForce RTX 40902015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b126.62
LinuxIntel CorporationNVIDIA GeForce RTX 40902015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b126.43
LinuxIntel CorporationNVIDIA GeForce RTX 40902015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b126.31
LinuxIntel CorporationNVIDIA GeForce RTX 40902015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b126.01
LinuxIntel(R) Xeon(R) Platinum 8470NVIDIA H100 80GB HBM31007.34Ubuntu 24.04 LTS0.2.8llama3.1:8b125.99
LinuxIntel CorporationNVIDIA GeForce RTX 40902015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b125.13
LinuxIntel(R) Core(TM) i9-14900KNVIDIA GeForce RTX 4090125.57Ubuntu 22.04.2 LTS0.3.6llama3.1:8b124.7
LinuxAMD EPYC 7513 32-Core ProcessorNVIDIA A100 80GB PCIe1007.60"Oracle Linux Server 8.10"0.3.2llama3.1:8b124.38
LinuxAMD EPYC 7V13 64-Core ProcessorNVIDIA A100 80GB PCIe216.21Ubuntu 22.04.4 LTS0.3.5llama3.1:8b124.07
LinuxAMD EPYC 7513 32-Core ProcessorNVIDIA A100 80GB PCIe1007.60"Oracle Linux Server 8.10"0.3.2llama3.1:8b123.54
LinuxAMD EPYC 7513 32-Core ProcessorNVIDIA A100-SXM4-80GB88.36Ubuntu 22.04.4 LTS0.3.4llama3.1:8b122.99
LinuxAMD EPYC 7V13 64-Core ProcessorNVIDIA A100 80GB PCIe216.25Ubuntu 22.04.4 LTS0.3.6llama3.1:8b122.93
LinuxAMD Ryzen 5 5500NVIDIA GeForce RTX 3080 Ti15.51Pop!_OS 22.04 LTS0.3.8llama3.1:8b122.83
LinuxAMD Ryzen 7 7800X3D 8-Core ProcessorNVIDIA GeForce RTX 409030.91Ubuntu 24.04.1 LTS0.3.12llama3.1:8b122.5
Linux13th Gen Intel(R) Core(TM) i9-13900KFNVIDIA GeForce RTX 409062.63Ubuntu 24.04.1 LTS0.4.2llama3.1:8b122.04
LinuxIntel(R) Xeon(R) Gold 5412UNVIDIA RTX 6000 Ada Generation124.96"AlmaLinux 9.5 (Teal Serval)"0.5.4llama3.1:8b121.98
LinuxAMD Ryzen 9 9900X 12-Core ProcessorNVIDIA GeForce RTX 309091.94Ubuntu 24.04.1 LTS0.4.1llama3.1:8b121.95
LinuxAMD Ryzen 9 7950X 16-Core ProcessorNVIDIA GeForce RTX 309062.51Ubuntu 23.100.3.8llama3.1:8b121.78
LinuxAMD Ryzen 7 7800X3D 8-Core ProcessorNVIDIA GeForce RTX 409030.91Ubuntu 24.04.1 LTS0.3.12llama3.1:8b121.7
LinuxAMD EPYC 7V13 64-Core ProcessorNVIDIA A100 80GB PCIe216.25Ubuntu 22.04.4 LTS0.3.6llama3.1:8b121.16
LinuxIntel(R) Core(TM) i9-14900KNVIDIA GeForce RTX 309030.61Ubuntu 24.100.5.4llama3.1:8b120.83
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 306062.63Ubuntu 24.04.1 LTS0.3.14llama3.1:8b120.3
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 306062.63Ubuntu 24.04.1 LTS0.3.14llama3.1:8b120.27
LinuxAMD EPYC 7V13 64-Core ProcessorNVIDIA A100 80GB PCIe216.25Ubuntu 22.04.4 LTS0.3.6llama3.1:8b120.19
LinuxAMD Ryzen 7 7800X3D 8-Core ProcessorNVIDIA GeForce RTX 409030.91Ubuntu 24.04.1 LTS0.3.12llama3.1:8b119.93
LinuxIntel(R) Core(TM) i9-14900KNVIDIA GeForce RTX 309030.61Ubuntu 24.100.5.4llama3.1:8b119.71
LinuxIntel CorporationNVIDIA GeForce RTX 40902015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b119.45
LinuxAMD EPYC 7513 32-Core ProcessorNVIDIA A100 80GB PCIe1007.60"Oracle Linux Server 8.10"0.3.2llama3.1:8b118.72
LinuxAMD Ryzen 9 5900X 12-Core ProcessorNVIDIA GeForce RTX 309062.71Ubuntu 23.100.5.4llama3.1:8b118.34
LinuxIntel Xeon Processor (Icelake)NVIDIA GeForce RTX 409015.61Ubuntu 22.04.5 LTS0.4.7llama3.1:8b117.98
LinuxAMD Ryzen 9 5950X 16-Core ProcessorNVIDIA GeForce RTX 3080 Ti62.72Pop!_OS 22.04 LTS0.4.2llama3.1:8b116.47
LinuxIntel(R) Xeon(R) Silver 4410YNVIDIA RTX 6000 Ada Generation251.41"Ubuntu 22.04.3 LTS"0.5.4llama3.1:8b114.79
LinuxAMD EPYC 9174F 16-Core ProcessorNVIDIA L40S251.27Ubuntu 22.04.5 LTS0.5.4llama3.1:8b114.77
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 306062.63Ubuntu 24.04.1 LTS0.3.14llama3.1:8b114.71
LinuxIntel(R) Xeon(R) Silver 4410YNVIDIA RTX 6000 Ada Generation251.41"Ubuntu 22.04.3 LTS"0.5.4llama3.1:8b114.35
LinuxAMD Ryzen 9 7900 12-Core ProcessorNVIDIA GeForce RTX 4080124.93Ubuntu 24.100.5.4llama3.1:8b114.35
LinuxAMD Ryzen 5 5600X 6-Core ProcessorNVIDIA GeForce RTX 309031.27"NixOS 24.05 (Uakari)"0.3.12llama3.1:8b114.28
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 306062.63Ubuntu 24.04.1 LTS0.3.14llama3.1:8b114.06
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 309031.26Ubuntu 22.04.5 LTS0.3.13llama3.1:8b113.94
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 309031.26Ubuntu 22.04.5 LTS0.3.13llama3.1:8b113.9
LinuxAMD EPYC 9174F 16-Core ProcessorNVIDIA L40S251.27Ubuntu 22.04.5 LTS0.5.4llama3.1:8b113.82
LinuxAMD EPYC 9174F 16-Core ProcessorNVIDIA L40S251.27Ubuntu 22.04.5 LTS0.5.4llama3.1:8b113.77
LinuxIntel(R) Core(TM) i9-14900KNVIDIA GeForce RTX 309062.54Ubuntu 24.04 LTS0.4.6llama3.1:8b113.71
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 309031.26Ubuntu 22.04.5 LTS0.3.13llama3.1:8b113.63
LinuxAMD Ryzen 9 7950X3D 16-Core ProcessorNVIDIA GeForce RTX 4080 SUPER30.95Ubuntu 22.04.5 LTS0.3.14llama3.1:8b113.25
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 309031.26Ubuntu 22.04.5 LTS0.3.13llama3.1:8b113.01
Linux13th Gen Intel(R) Core(TM) i5-13600KFNVIDIA GeForce RTX 408031.18"NixOS 24.11 (Vicuna)"0.3.12llama3.1:8b112.96
Linux12th Gen Intel(R) Core(TM) i9-12900KFNVIDIA GeForce RTX 309023.47Ubuntu 22.04.4 LTS0.3.11llama3.1:8b112.78
LinuxAMD Ryzen 9 5950X 16-Core ProcessorNVIDIA GeForce RTX 309094.29Ubuntu 24.04.1 LTS0.3.14llama3.1:8b112.78
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 309031.26Ubuntu 22.04.5 LTS0.3.13llama3.1:8b112.66
LinuxAMD EPYC 9174F 16-Core ProcessorNVIDIA L40S251.27Ubuntu 22.04.5 LTS0.5.4llama3.1:8b112.62
LinuxAMD EPYC 7R13 ProcessorNVIDIA L40S30.90"Amazon Linux 2"0.3.13llama3.1:8b112.56
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 309031.26Ubuntu 22.04.5 LTS0.3.13llama3.1:8b112.5
LinuxIntel(R) Core(TM) i7-4790K CPU @ 4.00GHzNVIDIA GeForce RTX 40907.68Ubuntu 22.04.5 LTS0.3.14llama3.1:8b112.22
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 309031.26Ubuntu 22.04.5 LTS0.3.13llama3.1:8b112.15
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 306031.26Ubuntu 20.04 LTS0.3.13llama3.1:8b112.13
LinuxIntel(R) Xeon(R) Gold 6248R CPU @ 3.00GHzNVIDIA A100 80GB PCIe62.61"Debian GNU/Linux 12 (bookworm)"0.3.8llama3.1:8b112.03
LinuxAMD Ryzen 9 7900 12-Core ProcessorNVIDIA GeForce RTX 4080124.93Ubuntu 24.100.5.1llama3.1:8b111.85
LinuxIntel(R) Xeon(R) Gold 6248R CPU @ 3.00GHzNVIDIA A100 80GB PCIe62.61"Debian GNU/Linux 12 (bookworm)"0.3.8llama3.1:8b111.76
LinuxAMD Ryzen 9 7900X 12-Core ProcessorNVIDIA GeForce RTX 308061.93Ubuntu 24.04.1 LTS0.3.12llama3.1:8b111.41
LinuxIntel(R) Xeon(R) Silver 4410YNVIDIA RTX 6000 Ada Generation251.41"Ubuntu 22.04.3 LTS"0.5.4llama3.1:8b111.33
LinuxIntel(R) Xeon(R) Silver 4410YNVIDIA RTX 6000 Ada Generation251.41"Ubuntu 22.04.3 LTS"0.5.4llama3.1:8b111.32
LinuxAMD Ryzen 9 7900X 12-Core ProcessorNVIDIA GeForce RTX 308061.93Ubuntu 24.04.1 LTS0.4.4llama3.1:8b111.3
LinuxAMD Ryzen 9 7900X 12-Core ProcessorNVIDIA GeForce RTX 308061.93Ubuntu 24.04.1 LTS0.3.12llama3.1:8b111.25
LinuxAMD EPYC 9174F 16-Core ProcessorNVIDIA L40S251.27Ubuntu 22.04.5 LTS0.5.4llama3.1:8b110.73
LinuxAMD EPYC 9174F 16-Core ProcessorNVIDIA L40S251.27Ubuntu 22.04.5 LTS0.5.4llama3.1:8b110.54
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 309031.26Ubuntu 22.04.5 LTS0.3.13llama3.1:8b110.51
LinuxAMD Ryzen Threadripper PRO 3955WX 16-CoresNVIDIA GeForce RTX 3090251.52Ubuntu 22.04.4 LTS0.3.8llama3.1:8b110.36
LinuxAMD Ryzen 9 5950X 16-Core ProcessorNVIDIA GeForce RTX 309094.29Ubuntu 24.04.1 LTS0.3.14llama3.1:8b110.34
LinuxAMD Ryzen 7 7800X3D 8-Core ProcessorNVIDIA GeForce RTX 4080 SUPER15.18Ubuntu 22.04.3 LTS0.4.3llama3.1:8b110.17
LinuxAMD Ryzen Threadripper PRO 3955WX 16-CoresNVIDIA GeForce RTX 3090125.72Ubuntu 24.04.1 LTS0.3.14llama3.1:8b110.13
LinuxINTEL(R) XEON(R) GOLD 6548Y+NVIDIA L40S251.69Ubuntu 22.04.4 LTS0.3.10llama3.1:8b109.97
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 309031.26Ubuntu 22.04.5 LTS0.3.13llama3.1:8b109.85
LinuxIntel(R) Core(TM) i7-6700 CPU @ 3.40GHzNVIDIA GeForce RTX 409031.30Ubuntu 22.04.5 LTS0.3.14llama3.1:8b109.78
LinuxIntel(R) Xeon(R) Silver 4410YNVIDIA RTX 6000 Ada Generation251.41"Ubuntu 22.04.3 LTS"0.5.4llama3.1:8b109.46
LinuxAMD Ryzen Threadripper PRO 3955WX 16-CoresNVIDIA GeForce RTX 3090125.72Ubuntu 24.04.1 LTS0.3.14llama3.1:8b109.21
LinuxAMD Ryzen 9 9950X 16-Core ProcessorNVIDIA GeForce RTX 409091.95Ubuntu 24.04.1 LTS0.3.12llama3.1:8b109.07
LinuxAMD Ryzen 9 5900X 12-Core ProcessorNVIDIA GeForce RTX 308031.26"Arch Linux"0.5.4llama3.1:8b108.96
LinuxIntel(R) Xeon(R) Platinum 8452YNVIDIA H100 80GB HBM31007.37Ubuntu 24.04.1 LTS0.5.1llama3.1:8b108.91
LinuxIntel(R) Xeon(R) Silver 4410YNVIDIA RTX 6000 Ada Generation251.41"Ubuntu 22.04.3 LTS"0.5.4llama3.1:8b108.47
Linux12th Gen Intel(R) Core(TM) i7-12700KFBasic Render Driver31.26Ubuntu 24.04.1 LTS0.5.4llama3.1:8b108.2
LinuxAMD Ryzen 9 7900X 12-Core ProcessorNVIDIA GeForce RTX 309093.52Manjaro Linux0.5.1llama3.1:8b108.16
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 309031.26Ubuntu 22.04.5 LTS0.3.13llama3.1:8b107.87
LinuxAMD Ryzen 9 5950X 16-Core ProcessorNVIDIA GeForce RTX 3080 Ti31.30Ubuntu 24.04.1 LTS0.5.4llama3.1:8b107.31
LinuxAMD Ryzen Threadripper 3960X 24-Core ProcessorNVIDIA GeForce RTX 3090 Ti125.63Ubuntu 24.04.1 LTS0.4.6llama3.1:8b107.12
LinuxIntel(R) Xeon(R) Silver 4410YNVIDIA RTX 6000 Ada Generation251.41"Ubuntu 22.04.3 LTS"0.5.4llama3.1:8b106.97
LinuxAMD Ryzen Threadripper 3960X 24-Core ProcessorNVIDIA GeForce RTX 3090 Ti125.63Ubuntu 24.04.1 LTS0.4.6llama3.1:8b106.76
LinuxAMD Ryzen 9 5950X 16-Core ProcessorNVIDIA GeForce RTX 4070 Ti SUPER30.79Ubuntu 24.04.1 LTS0.3.11llama3.1:8b106.02
LinuxAMD Ryzen Threadripper PRO 3945WX 12-CoresNVIDIA GeForce RTX 3090251.51Ubuntu 24.04 LTS0.3.13llama3.1:8b105.79
LinuxAMD Ryzen 9 5950X 16-Core ProcessorNVIDIA GeForce RTX 4070 Ti SUPER18.35Ubuntu 24.04.1 LTS0.3.11llama3.1:8b105.77
Linux12th Gen Intel(R) Core(TM) i9-12900KFNVIDIA GeForce RTX 309023.47Ubuntu 22.04.4 LTS0.3.9llama3.1:8b105.73
LinuxIntel CorporationNVIDIA L40S2015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b105.5
LinuxIntel CorporationNVIDIA GeForce RTX 40902015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b105.38
LinuxAMD Ryzen Threadripper PRO 3955WX 16-CoresNVIDIA L4062.75Ubuntu 24.04.1 LTS0.3.9llama3.1:8b105.35
LinuxAMD Ryzen Threadripper PRO 3955WX 16-CoresNVIDIA L4062.75Ubuntu 24.04.1 LTS0.3.9llama3.1:8b105.26
Linux12th Gen Intel(R) Core(TM) i9-12900KFNVIDIA GeForce RTX 309011.68Ubuntu 22.04.4 LTS0.3.9llama3.1:8b105.16
LinuxAMD Ryzen Threadripper PRO 3955WX 16-CoresNVIDIA L4062.75Ubuntu 24.04.1 LTS0.3.9llama3.1:8b104.94
LinuxIntel(R) Core(TM) i7-14700KFNVIDIA GeForce RTX 3090125.62Ubuntu 24.04.1 LTS0.4.5llama3.1:8b104.79
LinuxAMD EPYC 7742 64-Core ProcessorNVIDIA GeForce RTX 30901007.67Ubuntu 20.04.6 LTS0.4.3llama3.1:8b104.65
LinuxAMD Ryzen Threadripper PRO 3955WX 16-CoresNVIDIA GeForce RTX 3090125.72Ubuntu 24.04.1 LTS0.3.14llama3.1:8b104.46
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 309031.26Ubuntu 22.04.5 LTS0.3.13llama3.1:8b104.36
Linux12th Gen Intel(R) Core(TM) i9-12900KNVIDIA GeForce RTX 308031.06Ubuntu 22.04.5 LTS0.3.6llama3.1:8b104.13
LinuxAMD Ryzen 9 5950X 16-Core ProcessorNVIDIA GeForce RTX 309094.29Ubuntu 24.04.1 LTS0.4.2llama3.1:8b104.04
Linux12th Gen Intel(R) Core(TM) i9-12900KFNVIDIA GeForce RTX 309023.47Ubuntu 22.04.4 LTS0.3.9llama3.1:8b103.97
LinuxAMD Ryzen 9 9950X 16-Core ProcessorNVIDIA GeForce RTX 409091.95Ubuntu 24.04.1 LTS0.3.12llama3.1:8b103.86
LinuxAMD Ryzen 9 9950X 16-Core ProcessorNVIDIA GeForce RTX 409091.95Ubuntu 24.04.1 LTS0.3.12llama3.1:8b103.82
Linux12th Gen Intel(R) Core(TM) i7-1265UNVIDIA GeForce RTX 309030.79Debian GNU/Linux trixie/sid0.3.4llama3.1:8b103.06
LinuxIntel(R) Core(TM) i9-10900KF CPU @ 3.70GHzNVIDIA GeForce RTX 309031.24Debian GNU/Linux 12 (bookworm)0.3.0llama3.1:8b102.3
LinuxAMD Ryzen 9 9950X 16-Core ProcessorNVIDIA GeForce RTX 409091.95Ubuntu 24.04.1 LTS0.3.12llama3.1:8b102.11
LinuxAMD Ryzen 9 9950X 16-Core ProcessorNVIDIA GeForce RTX 409091.95Ubuntu 24.04.1 LTS0.3.12llama3.1:8b101.92
LinuxAMD EPYC 7742 64-Core ProcessorNVIDIA GeForce RTX 30901007.67Ubuntu 20.04.6 LTS0.4.3llama3.1:8b101.86
LinuxAMD EPYC 7763 64-Core ProcessorNVIDIA RTX A600056.98Ubuntu 22.04.5 LTS0.4.2llama3.1:8b101.65
LinuxINTEL(R) XEON(R) GOLD 6526YNVIDIA L40S376.42Debian GNU/Linux 12 (bookworm)0.5.5llama3.1:8b101.58
LinuxAMD Ryzen 7 8700F 8-Core ProcessorNVIDIA GeForce RTX 4070 Ti SUPER46.82"Ubuntu 22.04.5 LTS"0.4.0llama3.1:8b101.56
Linux13th Gen Intel(R) Core(TM) i9-13900KFNVIDIA GeForce RTX 4080125.53Ubuntu 22.04.4 LTS0.3.6llama3.1:8b101.53
LinuxAMD Ryzen Threadripper 1900X 8-Core ProcessorNVIDIA GeForce RTX 309015.62Ubuntu 24.04.1 LTS0.5.4llama3.1:8b101.27
LinuxIntel(R) Core(TM) i9-9900X CPU @ 3.50GHzNVIDIA GeForce RTX 309046.73Ubuntu 22.04.5 LTS0.5.0llama3.1:8b101.2
LinuxAMD Ryzen 9 9950X 16-Core ProcessorNVIDIA GeForce RTX 409091.95Ubuntu 24.04.1 LTS0.3.12llama3.1:8b101.08
LinuxIntel(R) Core(TM) i7-4790K CPU @ 4.00GHzNVIDIA GeForce RTX 409015.57Manjaro Linux0.3.10llama3.1:8b101.02
LinuxAMD Ryzen 9 9950X 16-Core ProcessorNVIDIA GeForce RTX 409091.95Ubuntu 24.04.1 LTS0.3.12llama3.1:8b100.66
LinuxIntel(R) Core(TM) i5-9400F CPU @ 2.90GHzNVIDIA GeForce RTX 309023.39Ubuntu 24.04.1 LTS0.5.7llama3.1:8b100.34
LinuxIntel(R) Core(TM) i5-9400F CPU @ 2.90GHzNVIDIA GeForce RTX 30907.67Ubuntu 24.04.1 LTS0.5.7llama3.1:8b99.84
LinuxIntel(R) Core(TM) i9-7960X CPU @ 2.80GHzNVIDIA GeForce RTX 309093.97Ubuntu 22.04.4 LTS0.3.3llama3.1:8b99.65
LinuxAMD Ryzen 9 9950X 16-Core ProcessorNVIDIA GeForce RTX 409091.95Ubuntu 24.04.1 LTS0.3.12llama3.1:8b99.58
LinuxAMD Ryzen 9 9950X 16-Core ProcessorAdvanced Micro Devices, Inc. [AMD/ATI]46.68Linux Mint 220.3.6llama3.1:8b99.57
LinuxAMD Ryzen 9 9950X 16-Core ProcessorAdvanced Micro Devices, Inc. [AMD/ATI]46.68Linux Mint 220.3.10llama3.1:8b99.5
LinuxAMD Ryzen 9 9950X 16-Core ProcessorNavi 31 [Radeon RX 7900 XT/7900 XTX/7900M]62.43Linux Mint 220.3.10llama3.1:8b99.27
LinuxAMD Ryzen 9 9950X 16-Core ProcessorNavi 31 [Radeon RX 7900 XT/7900 XTX/7900M]62.43Linux Mint 220.3.10llama3.1:8b98.98
LinuxAMD Ryzen 9 9950X 16-Core ProcessorAdvanced Micro Devices, Inc. [AMD/ATI]46.68Linux Mint 220.3.10llama3.1:8b98.85
LinuxIntel(R) Xeon(R) Gold 6226 CPU @ 2.70GHzTesla V100S-PCIE-32GB1007.57"Oracle Linux Server 8.10"0.3.2llama3.1:8b98.28
LinuxIntel(R) Core(TM) i7-14700NVIDIA GeForce RTX 4070 Ti SUPER31.05Manjaro Linux0.3.12llama3.1:8b97.87
LinuxIntel(R) Core(TM) i7-14700NVIDIA GeForce RTX 4070 Ti SUPER31.05Manjaro Linux0.3.12llama3.1:8b97.72
LinuxIntel(R) Xeon(R) Gold 6226 CPU @ 2.70GHzTesla V100S-PCIE-32GB1007.57"Oracle Linux Server 8.10"0.3.2llama3.1:8b97.71
LinuxIntel(R) Core(TM) i5-9400F CPU @ 2.90GHzNVIDIA GeForce RTX 309023.39Ubuntu 24.04.1 LTS0.5.7llama3.1:8b97.6
LinuxIntel(R) Xeon(R) Gold 6226 CPU @ 2.70GHzTesla V100S-PCIE-32GB1007.57"Oracle Linux Server 8.10"0.3.2llama3.1:8b97.43
LinuxIntel(R) Xeon(R) Platinum 8452YNVIDIA H100 80GB HBM31007.37Ubuntu 24.04.1 LTS0.4.1llama3.1:8b97.24
LinuxIntel(R) Core(TM) i5-9400F CPU @ 2.90GHzNVIDIA GeForce RTX 30907.67Ubuntu 24.04.1 LTS0.5.7llama3.1:8b97.19
LinuxAMD EPYC 7543P 32-Core ProcessorNVIDIA RTX A5000503.56"Ubuntu 22.04.5 LTS"0.4.0llama3.1:8b96.34
LinuxAMD EPYC 7543P 32-Core ProcessorNVIDIA RTX A5000503.56"Ubuntu 22.04.5 LTS"0.4.0llama3.1:8b96.33
LinuxAMD EPYC 7543P 32-Core ProcessorNVIDIA RTX A5000503.56"Ubuntu 22.04.5 LTS"0.4.0llama3.1:8b96.26
LinuxIntel(R) Core(TM) i5-9400F CPU @ 2.90GHzNVIDIA GeForce RTX 30907.67Ubuntu 24.04.1 LTS0.5.7llama3.1:8b96.21
LinuxAMD Ryzen 9 5900X 12-Core ProcessorNVIDIA GeForce RTX 308031.28Ubuntu 20.04.6 LTS0.1.48llama3.1:8b96.06
LinuxAMD Ryzen 9 5950X 16-Core ProcessorNavi 31 [Radeon RX 7900 XT/7900 XTX/7900 GRE/7900M]31.23EndeavourOS Linux0.3.12llama3.1:8b95.77
LinuxAMD Ryzen 7 5700X 8-Core ProcessorNVIDIA GeForce RTX 308078.45Ubuntu 22.04.5 LTS0.5.4llama3.1:8b95.2
LinuxAMD Ryzen 9 5950X 16-Core ProcessorNavi 31 [Radeon RX 7900 XT/7900 XTX/7900 GRE/7900M]62.70Nobara Linux 40 (KDE Plasma)0.3.12llama3.1:8b95.16
LinuxIntel(R) Xeon(R) Gold 5315Y CPU @ 3.20GHzNVIDIA RTX A600044.07Ubuntu 22.04.4 LTS0.3.5llama3.1:8b94.99
LinuxQEMU Virtual CPU version 2.5+NVIDIA A4031.06"Rocky Linux 9.4 (Blue Onyx)"0.3.14llama3.1:8b94.97
LinuxIntel(R) Core(TM) i5-6600K CPU @ 3.50GHzNVIDIA GeForce RTX 309031.29Ubuntu 24.04.1 LTS0.5.4llama3.1:8b93.92
LinuxAMD Ryzen 9 7950X 16-Core ProcessorNVIDIA GeForce RTX 4070 Ti SUPER30.47"Ubuntu 22.04.5 LTS"0.5.4-0-g2ddc32d-dirtyllama3.1:8b92.58
LinuxAMD Ryzen 9 5950X 16-Core ProcessorNVIDIA GeForce RTX 3080 Ti31.30Ubuntu 24.04.1 LTS0.5.4llama3.1:8b92.45
LinuxAMD Ryzen 7 5800X3D 8-Core ProcessorNVIDIA GeForce RTX 3070 Ti62.72CachyOS0.5.4llama3.1:8b92.24
LinuxAMD Ryzen 7 5800X3D 8-Core ProcessorNVIDIA GeForce RTX 3070 Ti62.72CachyOS0.5.5llama3.1:8b92.11
LinuxAMD Ryzen 7 5800X3D 8-Core ProcessorNVIDIA GeForce RTX 3070 Ti62.72CachyOS0.5.5llama3.1:8b92.1
LinuxAMD Ryzen 7 7800X3D 8-Core ProcessorNVIDIA GeForce RTX 409030.91Ubuntu 24.04.1 LTS0.3.12llama3.1:8b91.24
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 309031.26Ubuntu 22.04.5 LTS0.3.13llama3.1:8b91.09
LinuxAMD Ryzen 9 7950X 16-Core ProcessorNVIDIA GeForce RTX 4070 Ti SUPER30.47"Ubuntu 22.04.5 LTS"0.5.4-0-g2ddc32d-dirtyllama3.1:8b90.81
LinuxIntel(R) Xeon(R) Gold 6342 CPU @ 2.80GHzNVIDIA A40503.53"Ubuntu 22.04.4 LTS"0.3.3llama3.1:8b89.77
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 3090125.61Ubuntu 24.04.1 LTS0.4.6llama3.1:8b89.71
LinuxAMD Ryzen 5 7600X 6-Core ProcessorNVIDIA GeForce RTX 407030.50EndeavourOS Linux0.3.12llama3.1:8b88.85
LinuxAMD EPYC 7343 16-Core ProcessorNVIDIA RTX A5000377.73Ubuntu 22.04.5 LTS0.5.3llama3.1:8b88.69
LinuxAMD EPYC 7282 16-Core ProcessorNVIDIA RTX A500062.79Ubuntu 24.04.1 LTS0.5.4llama3.1:8b88.17
LinuxAMD EPYC 7V13 64-Core ProcessorAldebaran/MI200 [Instinct MI210]503.21"Rocky Linux 9.1 (Blue Onyx)"0.3.9llama3.1:8b88.11
LinuxIntel(R) Xeon(R) w9-3495XNVIDIA RTX 5000 Ada Generation30.56Ubuntu 22.04.5 LTS0.5.4llama3.1:8b88.05
LinuxIntel(R) Core(TM) i7-4790K CPU @ 4.00GHzNVIDIA GeForce RTX 409015.57Manjaro Linux0.3.10llama3.1:8b87.97
LinuxIntel(R) Xeon(R) w9-3495XNVIDIA RTX 5000 Ada Generation282.42Ubuntu 22.04.5 LTS0.5.4llama3.1:8b87.31
LinuxIntel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHzNVIDIA GeForce RTX 309062.79Ubuntu 22.04.4 LTS0.2.7llama3.1:8b87.24
LinuxIntel(R) Xeon(R) w9-3495XNVIDIA RTX 5000 Ada Generation30.56Ubuntu 22.04.5 LTS0.5.4llama3.1:8b87.2
LinuxIntel(R) Xeon(R) w9-3495XNVIDIA RTX 5000 Ada Generation282.42Ubuntu 22.04.5 LTS0.5.4llama3.1:8b87.17
LinuxAMD Ryzen 9 5900X 12-Core ProcessorNVIDIA GeForce RTX 4070 SUPER15.58Ubuntu 22.04.5 LTS0.3.12llama3.1:8b87.14
LinuxIntel(R) Xeon(R) w9-3495XNVIDIA RTX 5000 Ada Generation30.56Ubuntu 22.04.5 LTS0.5.4llama3.1:8b87.11
LinuxIntel(R) Xeon(R) w9-3495XNVIDIA RTX 5000 Ada Generation30.56Ubuntu 22.04.5 LTS0.5.4llama3.1:8b87.05
LinuxIntel(R) Xeon(R) w9-3495XNVIDIA RTX 5000 Ada Generation30.56Ubuntu 22.04.5 LTS0.5.4llama3.1:8b87.02
LinuxAMD Ryzen 9 5950X 16-Core ProcessorNVIDIA GeForce RTX 3080 Ti31.30Ubuntu 24.04.1 LTS0.5.4llama3.1:8b86.9
LinuxAMD Ryzen 9 7900X 12-Core Processorno_gpu61.92Arch Linux0.5.5llama3.1:8b86.34
LinuxAMD Ryzen 9 5900X 12-Core ProcessorNVIDIA GeForce RTX 407031.26Debian GNU/Linux 12 (bookworm)0.3.9llama3.1:8b86.27
LinuxIntel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHzNVIDIA GeForce RTX 309062.79Ubuntu 22.04.4 LTS0.2.7llama3.1:8b86.26
Linux13th Gen Intel(R) Core(TM) i5-13500NVIDIA GeForce RTX 4070 SUPER31.08"Fedora Linux 40 (Workstation Edition)"0.3.11llama3.1:8b85.39
LinuxAMD EPYC 9354 32-Core ProcessorIntegrated Matrox G200eW3 Graphics Controller755.42Ubuntu 24.04.1 LTS0.4.5llama3.1:8b84.86
LinuxIntel(R) Xeon(R) w9-3495XNVIDIA RTX 5000 Ada Generation30.56Ubuntu 22.04.5 LTS0.5.4llama3.1:8b84.34
LinuxAMD Ryzen 9 5900X 12-Core ProcessorNVIDIA GeForce RTX 409031.23Ubuntu 23.040.3.9llama3.1:8b84.3
LinuxIntel(R) Xeon(R) w9-3495XNVIDIA RTX 5000 Ada Generation30.56Ubuntu 22.04.5 LTS0.5.4llama3.1:8b84.17
Linux13th Gen Intel(R) Core(TM) i5-13500NVIDIA GeForce RTX 4070 SUPER31.08"Fedora Linux 40 (Workstation Edition)"0.3.11llama3.1:8b84.03
LinuxAMD Ryzen 5 7600 6-Core ProcessorNVIDIA GeForce RTX 3070 Ti30.96Ubuntu 24.04.1 LTS0.5.5llama3.1:8b83.91
LinuxIntel Xeon Processor (Skylake, IBRS)NVIDIA A4094.29Ubuntu 22.04.4 LTS0.4.7llama3.1:8b83.87
LinuxAMD EPYC 7702P 64-Core ProcessorAdvanced Micro Devices, Inc. [AMD/ATI]377.71Ubuntu 22.04.2 LTS0.3.6llama3.1:8b83.79
LinuxAMD Ryzen 7 5700G with Radeon GraphicsNavi 31 [Radeon RX 7900 XT/7900 XTX/7900 GRE/7900M]62.66Ubuntu 24.04.1 LTS0.5.4llama3.1:8b83.78
LinuxAMD Ryzen 7 8700G w/ Radeon 780M GraphicsNVIDIA GeForce RTX 407060.49Ubuntu 24.04.1 LTS0.5.4llama3.1:8b83.75
LinuxAMD Ryzen 5 7600 6-Core ProcessorNVIDIA GeForce RTX 3070 Ti30.96Ubuntu 24.04.1 LTS0.5.5llama3.1:8b83.74
LinuxIntel(R) Xeon(R) w9-3495XNVIDIA RTX 5000 Ada Generation282.42Ubuntu 22.04.5 LTS0.5.4llama3.1:8b83.69
LinuxIntel(R) Xeon(R) w9-3495XNVIDIA RTX 5000 Ada Generation282.42Ubuntu 22.04.5 LTS0.5.4llama3.1:8b83.64
LinuxAMD Ryzen 7 5700G with Radeon GraphicsNavi 31 [Radeon RX 7900 XT/7900 XTX/7900 GRE/7900M]62.66Ubuntu 24.04.1 LTS0.5.4llama3.1:8b83.59
LinuxIntel Xeon Processor (Skylake, IBRS)NVIDIA A4094.29Ubuntu 22.04.4 LTS0.4.7llama3.1:8b83.56
LinuxIntel Xeon Processor (Skylake, IBRS)NVIDIA A4094.29Ubuntu 22.04.4 LTS0.4.7llama3.1:8b83.45
LinuxIntel(R) Xeon(R) w9-3495XNVIDIA RTX 5000 Ada Generation30.56Ubuntu 22.04.5 LTS0.5.4llama3.1:8b83.35
LinuxAMD EPYC 9354 32-Core ProcessorIntegrated Matrox G200eW3 Graphics Controller755.42Ubuntu 24.04.1 LTS0.4.5llama3.1:8b83.27
LinuxAMD EPYC 9354 32-Core ProcessorIntegrated Matrox G200eW3 Graphics Controller755.42Ubuntu 24.04.1 LTS0.4.5llama3.1:8b83.26
LinuxIntel(R) Core(TM) i7-10700 CPU @ 2.90GHzNVIDIA GeForce RTX 408031.31Ubuntu 24.04.1 LTS0.4.0llama3.1:8b83.18
LinuxIntel(R) Core(TM) i7-10700 CPU @ 2.90GHzNVIDIA GeForce RTX 408031.31Ubuntu 24.04.1 LTS0.4.0llama3.1:8b83.09
Linux13th Gen Intel(R) Core(TM) i5-13500NVIDIA GeForce RTX 4070 SUPER31.08"Fedora Linux 40 (Workstation Edition)"0.3.11llama3.1:8b82.77
LinuxAMD EPYC 7513 32-Core ProcessorNVIDIA A100 80GB PCIe1007.60"Oracle Linux Server 8.10"0.3.2llama3.1:8b82.37
LinuxAMD Ryzen 5 5600 6-Core ProcessorNVIDIA GeForce RTX 4070 SUPER31.26Ubuntu 22.04.3 LTS0.4.7llama3.1:8b81.9
LinuxAMD EPYC 9354 32-Core ProcessorIntegrated Matrox G200eW3 Graphics Controller755.42Ubuntu 24.04.1 LTS0.4.5llama3.1:8b81.72
LinuxIntel(R) Xeon(R) W-2133 CPU @ 3.60GHzNVIDIA RTX A450062.52Ubuntu 22.04.4 LTS0.3.8llama3.1:8b81.24
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce RTX 309015.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b81.18
LinuxAMD Ryzen 5 5600 6-Core ProcessorNVIDIA GeForce RTX 4070 SUPER31.26Ubuntu 22.04.3 LTS0.4.7llama3.1:8b81.04
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce RTX 309015.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b80.97
LinuxIntel(R) Xeon(R) Gold 6130 CPU @ 2.10GHzTesla V100-SXM2-32GB376.55Debian GNU/Linux 12 (bookworm)0.5.1llama3.1:8b80.93
LinuxIntel(R) Xeon(R) W-2133 CPU @ 3.60GHzNVIDIA RTX A450023.20Debian GNU/Linux 12 (bookworm)0.3.8llama3.1:8b80.89
LinuxIntel(R) Xeon(R) Gold 6130 CPU @ 2.10GHzTesla V100-SXM2-32GB376.55Debian GNU/Linux 12 (bookworm)0.5.1llama3.1:8b80.87
LinuxIntel(R) Xeon(R) W-2133 CPU @ 3.60GHzNVIDIA RTX A4500125.52Ubuntu 22.04.4 LTS0.3.8llama3.1:8b80.86
LinuxAMD Ryzen 5 7500F 6-Core ProcessorNVIDIA GeForce RTX 407015.20Pop!_OS 22.04 LTS0.5.4llama3.1:8b80.41
LinuxAMD Ryzen 7 3700X 8-Core ProcessorNVIDIA GeForce RTX 4070 SUPER62.69Ubuntu 24.04.1 LTS0.3.9llama3.1:8b80.23
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce RTX 309015.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b79.9
LinuxAMD Ryzen 7 3700X 8-Core ProcessorNVIDIA GeForce RTX 4070 SUPER62.69Ubuntu 24.04.1 LTS0.3.9llama3.1:8b79.9
LinuxAMD Ryzen 7 3700X 8-Core ProcessorNVIDIA GeForce RTX 4070 SUPER62.69Ubuntu 24.04.1 LTS0.3.9llama3.1:8b79.82
LinuxAMD Ryzen 9 5950X 16-Core ProcessorNavi 31 [Radeon RX 7900 XT/7900 XTX/7900M]62.72Ubuntu 24.04.1 LTS0.5.4llama3.1:8b78.7
LinuxAMD Ryzen 9 5950X 16-Core ProcessorNVIDIA GeForce RTX 309094.29Ubuntu 24.04.1 LTS0.3.13llama3.1:8b77.83
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER62.72Ubuntu 24.04.1 LTS0.3.12llama3.1:8b76.01
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER62.72Ubuntu 24.04.1 LTS0.3.12llama3.1:8b75.97
LinuxIntel(R) Xeon(R) Silver 4116 CPU @ 2.10GHzNVIDIA A4062.79Ubuntu 22.04.4 LTS0.3.8llama3.1:8b75.32
LinuxIntel(R) Xeon(R) Gold 6130 CPU @ 2.10GHzTesla V100-SXM2-32GB29.36Ubuntu 22.04.4 LTS0.3.4llama3.1:8b75.1
LinuxAMD Eng Sample: 100-000000020-02_30/20_NNVIDIA A40251.55Debian GNU/Linux 12 (bookworm)0.5.1llama3.1:8b74.72
LinuxAMD Eng Sample: 100-000000020-02_30/20_NNVIDIA A40251.55Debian GNU/Linux 12 (bookworm)0.5.1llama3.1:8b74.5
LinuxIntel(R) Xeon(R) Gold 6148 CPU @ 2.40GHzNVIDIA RTX A4500376.54Debian GNU/Linux 12 (bookworm)0.3.8llama3.1:8b74.4
LinuxIntel(R) Xeon(R) Gold 6138 CPU @ 2.00GHzNVIDIA RTXA5000-24Q78.54Debian GNU/Linux 12 (bookworm)0.2.7llama3.1:8b74.36
LinuxAMD EPYC 7R32NVIDIA A10G15.43Ubuntu 20.04.6 LTS0.3.9llama3.1:8b74.16
LinuxIntel(R) Core(TM) i7-4790K CPU @ 4.00GHzNVIDIA GeForce RTX 2080 Ti31.29Arch Linux0.3.12llama3.1:8b74.14
LinuxIntel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHzTesla V100-PCIE-16GB688.54Debian GNU/Linux 12 (bookworm)0.5.1llama3.1:8b74.07
LinuxAMD Ryzen 9 7900X 12-Core ProcessorRaphael60.91Ubuntu 24.100.3.14llama3.1:8b74.03
LinuxIntel(R) Xeon(R) CPU E3-1231 v3 @ 3.40GHzNavi 31 [Radeon RX 7900 XT/7900 XTX/7900 GRE/7900M]15.58Ubuntu 24.04.1 LTS0.5.4llama3.1:8b73.64
LinuxIntel(R) Xeon(R) CPU E5-2658 0 @ 2.10GHzNVIDIA GeForce RTX 309062.85Ubuntu 22.04.4 LTS0.3.11llama3.1:8b73.59
LinuxIntel(R) Core(TM) i7-7700 CPU @ 3.60GHzNVIDIA GeForce RTX 407062.73Ubuntu 22.04.5 LTS0.3.12llama3.1:8b73.22
LinuxIntel(R) Core(TM) i7-7700 CPU @ 3.60GHzNVIDIA GeForce RTX 407062.73Ubuntu 22.04.5 LTS0.3.12llama3.1:8b73.11
LinuxIntel(R) Core(TM) i7-7700 CPU @ 3.60GHzNVIDIA GeForce RTX 407062.73Ubuntu 22.04.5 LTS0.3.12llama3.1:8b73.09
LinuxIntel(R) Core(TM) i7-7700 CPU @ 3.60GHzNVIDIA GeForce RTX 407062.73Ubuntu 22.04.5 LTS0.3.12llama3.1:8b72.99
LinuxIntel(R) Core(TM) i7-7700 CPU @ 3.60GHzNVIDIA GeForce RTX 407062.73Ubuntu 22.04.5 LTS0.3.12llama3.1:8b72.95
LinuxAMD Ryzen 9 7950X 16-Core ProcessorBasic Render Driver157.20Ubuntu 24.04.1 LTS0.3.9llama3.1:8b72.69
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b72.45
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b72.36
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b72.12
LinuxIntel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHzTesla V100-PCIE-16GB688.54Debian GNU/Linux 12 (bookworm)0.5.1llama3.1:8b72.11
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b72.09
LinuxIntel(R) Core(TM) i7-7700 CPU @ 3.60GHzNVIDIA GeForce RTX 407062.73Ubuntu 22.04.5 LTS0.3.12llama3.1:8b72.07
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b72.07
LinuxIntel(R) Xeon(R) CPU D-1541 @ 2.10GHzNVIDIA GeForce RTX 2080 Ti31.24Ubuntu 22.04.5 LTS0.3.13llama3.1:8b72.06
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b72.06
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b72
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b72
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b71.99
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b71.96
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b71.93
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b71.91
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b71.86
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b71.8
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b71.8
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b71.77
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b71.75
LinuxIntel(R) Xeon(R) CPU D-1541 @ 2.10GHzNVIDIA GeForce RTX 2080 Ti31.24Ubuntu 22.04.5 LTS0.3.13llama3.1:8b71.65
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b71.64
LinuxIntel(R) Xeon(R) Gold 6252 CPU @ 2.10GHzNVIDIA A10-24Q95.92Ubuntu 22.04.5 LTS0.3.13llama3.1:8b71.12
LinuxAMD Ryzen 5 2600 Six-Core ProcessorNVIDIA GeForce RTX 2080 Ti31.27Pop!_OS 22.04 LTS0.4.4llama3.1:8b71.12
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b71.08
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b70.9
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b70.82
LinuxIntel(R) Xeon(R) Gold 6252 CPU @ 2.10GHzNVIDIA A10-24Q95.92Ubuntu 22.04.5 LTS0.3.13llama3.1:8b70.68
Linux13th Gen Intel(R) Core(TM) i9-13900Kunknown62.37Manjaro Linux0.3.10llama3.1:8b70.64
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b70.53
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b69.77
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b69.48
LinuxAMD Ryzen 5 5600X 6-Core ProcessorNVIDIA GeForce RTX 307015.54Ubuntu 24.04.1 LTS0.5.1llama3.1:8b69.48
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b69.26
LinuxIntel(R) Xeon(R) Gold 6248R CPU @ 3.00GHzNVIDIA A100 80GB PCIe62.61"Debian GNU/Linux 12 (bookworm)"0.3.8llama3.1:8b69.04
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b68.86
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b68.73
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b68.52
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 4070 SUPER31.28Ubuntu 22.04.2 LTS0.3.14llama3.1:8b68.49
LinuxAMD EPYC 7513 32-Core ProcessorNVIDIA A800 80GB PCIe1007.60"Oracle Linux Server 8.10"0.3.2llama3.1:8b67.97
LinuxAMD Ryzen 7 7700X 8-Core ProcessorBasic Render Driver15.18Ubuntu 24.04.1 LTS0.3.11llama3.1:8b67.79
LinuxunknownQuadro RTX 500031.23Ubuntu 22.04.4 LTS0.2.8llama3.1:8b67.37
LinuxIntel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHzTesla V100-PCIE-16GB688.54Debian GNU/Linux 12 (bookworm)0.5.1llama3.1:8b67.25
LinuxAMD Ryzen 7 3700X 8-Core ProcessorNVIDIA GeForce RTX 407015.58Ubuntu 22.04.5 LTS0.4.2llama3.1:8b67.12
LinuxAMD Ryzen 7 3700X 8-Core ProcessorNVIDIA GeForce RTX 407015.58Ubuntu 22.04.5 LTS0.4.2llama3.1:8b66.78
LinuxAMD Ryzen 7 7700X 8-Core ProcessorBasic Render Driver15.18Ubuntu 24.04.1 LTS0.3.11llama3.1:8b66.67
LinuxIntel Xeon Processor (Cascadelake)NVIDIA GeForce RTX 2080 Ti15.61Ubuntu 22.04.5 LTS0.4.7llama3.1:8b66.67
LinuxAMD Ryzen 7 7700X 8-Core ProcessorBasic Render Driver15.18Ubuntu 24.04.1 LTS0.5.4llama3.1:8b66.52
LinuxIntel Xeon Processor (Cascadelake)NVIDIA GeForce RTX 2080 Ti15.61Ubuntu 22.04.5 LTS0.4.7llama3.1:8b66.5
LinuxIntel(R) Core(TM) i7-4790K CPU @ 4.00GHzNVIDIA GeForce RTX 307015.48"Arch Linux"0.3.6llama3.1:8b66.23
LinuxIntel(R) Core(TM) i7-4790K CPU @ 4.00GHzNVIDIA GeForce RTX 307015.48"Arch Linux"0.3.6llama3.1:8b66.22
LinuxAMD Ryzen 9 5900X 12-Core ProcessorNavi 21 [Radeon RX 6800/6800 XT / 6900 XT]62.67Ubuntu 22.04.5 LTS0.3.10llama3.1:8b66.16
LinuxAMD Ryzen 7 3700X 8-Core ProcessorNVIDIA GeForce RTX 407015.58Ubuntu 22.04.5 LTS0.4.2llama3.1:8b66.09
LinuxAMD Ryzen 9 5900X 12-Core ProcessorNavi 21 [Radeon RX 6800/6800 XT / 6900 XT]31.23Ubuntu 24.04.1 LTS0.3.12llama3.1:8b66.03
LinuxIntel(R) Core(TM) i7-4790K CPU @ 4.00GHzNVIDIA GeForce RTX 307015.48"Arch Linux"0.3.6llama3.1:8b66.02
LinuxIntel(R) Core(TM) i9-10850K CPU @ 3.60GHzNVIDIA GeForce RTX 3060 Ti31.26Linux Mint 220.3.12llama3.1:8b65.94
LinuxIntel(R) Core(TM) Ultra 9 185HNVIDIA GeForce RTX 4080 Laptop GPU15.33Ubuntu 22.04.3 LTS0.4.4llama3.1:8b65.41
LinuxIntel(R) Core(TM) i7-3930K CPU @ 3.20GHzNVIDIA GeForce RTX 2080 Ti31.30Ubuntu 24.04.1 LTS0.3.13llama3.1:8b65.34
LinuxAMD Ryzen 5 5600X 6-Core ProcessorNVIDIA RTX A400031.26Debian GNU/Linux 12 (bookworm)0.5.1llama3.1:8b64
LinuxAMD Ryzen 5 5600X 6-Core ProcessorNVIDIA RTX A400031.26Debian GNU/Linux 12 (bookworm)0.5.1llama3.1:8b63.94
LinuxAMD Ryzen 5 5600X 6-Core ProcessorNVIDIA RTX A400031.26Debian GNU/Linux 12 (bookworm)0.5.1llama3.1:8b63.89
LinuxAMD Ryzen 5 5600X 6-Core ProcessorNVIDIA RTX A400031.26Debian GNU/Linux 12 (bookworm)0.5.1llama3.1:8b63.79
LinuxIntel(R) Core(TM) i7-8700 CPU @ 3.20GHzNVIDIA GeForce RTX 2070 SUPER31.27Ubuntu 22.04.5 LTS0.4.2llama3.1:8b63.71
LinuxAMD Ryzen 7 7800X3D 8-Core Processorno_gpu30.54Debian GNU/Linux 12 (bookworm)0.3.12llama3.1:8b63.63
LinuxAMD Ryzen 5 5600X 6-Core ProcessorNVIDIA RTX A400031.26Debian GNU/Linux 12 (bookworm)0.5.1llama3.1:8b63.61
LinuxIntel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHzNVIDIA GeForce RTX 2080 Ti503.75Ubuntu 24.04.1 LTS0.4.2llama3.1:8b63.57
LinuxAMD Ryzen 7 7800X3D 8-Core Processorno_gpu30.54Debian GNU/Linux 12 (bookworm)0.3.12llama3.1:8b62.94
LinuxAMD Ryzen 7 5700G with Radeon GraphicsNVIDIA GeForce RTX 306030.72Pop!_OS 22.04 LTS0.3.14llama3.1:8b62.71
LinuxAMD Ryzen 7 5700G with Radeon GraphicsNVIDIA GeForce RTX 306030.72Pop!_OS 22.04 LTS0.3.14llama3.1:8b62.61
LinuxAMD Ryzen 7 5700G with Radeon GraphicsNVIDIA GeForce RTX 306030.72Pop!_OS 22.04 LTS0.3.14llama3.1:8b62.52
Linux13th Gen Intel(R) Core(TM) i3-13100NVIDIA RTX 4000 Ada Generation31.15Ubuntu 24.04.1 LTS0.5.4llama3.1:8b61.37
LinuxAMD Ryzen 9 3950X 16-Core Processorno_gpu62.71Fedora release 40 (Forty)0.3.12llama3.1:8b61.21
LinuxIntel(R) Core(TM) i5-9400F CPU @ 2.90GHzNVIDIA GeForce RTX 2070 SUPER31.26Ubuntu 24.04.1 LTS0.3.14llama3.1:8b61.21
Linux13th Gen Intel(R) Core(TM) i3-13100NVIDIA RTX 4000 Ada Generation31.15Ubuntu 24.04.1 LTS0.5.4llama3.1:8b60.94
LinuxIntel(R) Xeon(R) CPU E5-2698 v4 @ 2.20GHzQuadro RTX 8000377.77Debian GNU/Linux 12 (bookworm)0.5.1llama3.1:8b60.93
LinuxIntel(R) Core(TM) i9-10900K CPU @ 3.70GHzNVIDIA GeForce RTX 2070 SUPER62.70Ubuntu 24.04.1 LTS0.4.7llama3.1:8b60.75
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 306031.26Ubuntu 20.04 LTS0.3.12llama3.1:8b60.73
LinuxIntel(R) Xeon(R) CPU E5-2698 v4 @ 2.20GHzQuadro RTX 8000377.77Debian GNU/Linux 12 (bookworm)0.5.1llama3.1:8b60.38
LinuxIntel CorporationNVIDIA GeForce RTX 40902015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b60.19
Linux13th Gen Intel(R) Core(TM) i5-13500NVIDIA GeForce RTX 4070 SUPER15.50Ubuntu 22.04.5 LTS0.3.14llama3.1:8b60.17
LinuxAMD Ryzen 5 3600 6-Core ProcessorNVIDIA GeForce RTX 307015.54Ubuntu 24.04.1 LTS0.3.3llama3.1:8b60.17
LinuxIntel(R) Core(TM) i9-10900K CPU @ 3.70GHzNVIDIA GeForce RTX 2070 SUPER62.70Ubuntu 24.04.1 LTS0.4.7llama3.1:8b60.17
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 306062.63Ubuntu 24.04.1 LTS0.3.13llama3.1:8b59.77
LinuxIntel CorporationNVIDIA GeForce RTX 40902015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b59.57
Linux11th Gen Intel(R) Core(TM) i5-11600K @ 3.90GHzNVIDIA GeForce RTX 4060 Ti62.65Ubuntu 22.04.4 LTS0.3.6llama3.1:8b59.41
LinuxAMD Ryzen Threadripper 1950X 16-Core ProcessorNVIDIA GeForce RTX 3060 Ti61.28Debian GNU/Linux 12 (bookworm)0.5.4llama3.1:8b59.21
LinuxAMD Ryzen 5 3600 6-Core ProcessorNVIDIA GeForce RTX 306046.97Ubuntu 24.04.1 LTS0.3.12llama3.1:8b58.78
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 306031.26Ubuntu 20.04 LTS0.3.12llama3.1:8b58.53
LinuxAMD Ryzen 5 3600 6-Core ProcessorNVIDIA CMP 30HX31.25Ubuntu Oracular Oriole (development branch)0.3.0llama3.1:8b58.43
LinuxAMD Ryzen 7 2700X Eight-Core ProcessorNVIDIA GeForce RTX 207031.26Pop!_OS 22.04 LTS0.3.6llama3.1:8b58.33
LinuxAMD Ryzen 9 5950X 16-Core ProcessorNVIDIA RTX A400062.71Arch Linux0.3.12llama3.1:8b57.75
LinuxIntel CorporationNVIDIA GeForce RTX 40902015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b57.71
Linux13th Gen Intel(R) Core(TM) i7-13850HXNVIDIA RTX 3500 Ada Generation Laptop GPU16.00Ubuntu 24.04.1 LTS0.5.4llama3.1:8b57.22
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 309031.26Ubuntu 22.04.5 LTS0.3.13llama3.1:8b57.09
Linux13th Gen Intel(R) Core(TM) i7-13850HXNVIDIA RTX 3500 Ada Generation Laptop GPU16.00Ubuntu 24.04.1 LTS0.5.4llama3.1:8b56.97
LinuxAMD Ryzen 5 2600 Six-Core ProcessorNavi 21 [Radeon RX 6800/6800 XT / 6900 XT]31.27Pop!_OS 22.04 LTS0.5.4llama3.1:8b56.96
LinuxAMD Ryzen 5 2600 Six-Core ProcessorNavi 21 [Radeon RX 6800/6800 XT / 6900 XT]31.27Pop!_OS 22.04 LTS0.5.4llama3.1:8b56.85
LinuxAMD Ryzen 9 5900X 12-Core ProcessorNavi 22 [Radeon RX 6700/6700 XT/6750 XT / 6800M/6850M XT]62.69Linux Mint 220.3.12llama3.1:8b56.6
LinuxIntel CorporationNVIDIA GeForce RTX 40902015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b56.39
LinuxIntel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHzNVIDIA RTX A4000251.60"Fedora Linux 41 (Workstation Edition)"0.5.1llama3.1:8b56.09
LinuxIntel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHzVega 20 [Radeon Pro VII/Radeon Instinct MI50 32GB]125.76Ubuntu 24.04.1 LTS0.3.12llama3.1:8b56.03
LinuxIntel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHzVega 20 [Radeon Pro VII/Radeon Instinct MI50 32GB]125.76Ubuntu 24.04.1 LTS0.3.12llama3.1:8b55.57
LinuxIntel(R) Core(TM) i7-6800K CPU @ 3.40GHzNVIDIA TITAN Xp62.71Ubuntu 24.04.1 LTS0.3.14llama3.1:8b55.51
LinuxIntel(R) Xeon(R) CPU X5650 @ 2.67GHzNVIDIA GeForce RTX 208031.34Ubuntu 22.04.5 LTS0.1.32llama3.1:8b55.16
LinuxIntel(R) Xeon(R) CPU X5650 @ 2.67GHzNVIDIA GeForce RTX 208031.34Ubuntu 22.04.5 LTS0.1.32llama3.1:8b54.96
LinuxIntel CorporationNVIDIA GeForce RTX 40902015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b54.77
LinuxAMD Ryzen 9 5900X 12-Core ProcessorNavi 22 [Radeon RX 6700/6700 XT/6750 XT / 6800M/6850M XT]62.73Ubuntu 22.04.5 LTS0.3.10llama3.1:8b54.34
LinuxAMD Ryzen 9 5900X 12-Core ProcessorNVIDIA GeForce RTX 4060 Ti62.80Ubuntu 22.04.5 LTS0.3.13llama3.1:8b54.29
LinuxIntel(R) Core(TM) i9-14900KNVIDIA GeForce RTX 4060 Ti62.53"Fedora Linux 41 (Workstation Edition)"0.4.1llama3.1:8b54.14
LinuxAMD Ryzen 9 5900X 12-Core ProcessorNVIDIA GeForce RTX 4060 Ti62.80Ubuntu 22.04.5 LTS0.3.13llama3.1:8b53.54
LinuxAMD Ryzen 5 3600 6-Core ProcessorNVIDIA GeForce RTX 306031.26RebornOS Linux0.3.12llama3.1:8b53.42
LinuxIntel CorporationNVIDIA GeForce RTX 40902015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b53.38
LinuxIntel CorporationNVIDIA GeForce RTX 40902015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b53.36
Linux13th Gen Intel(R) Core(TM) i9-13950HXNVIDIA RTX 3500 Ada Generation Laptop GPU47.04Ubuntu 22.04.3 LTS0.4.6llama3.1:8b53.18
LinuxIntel(R) Core(TM) i7-7800X CPU @ 3.50GHzNVIDIA GeForce RTX 3060125.50Ubuntu 24.04.1 LTS0.3.3llama3.1:8b52.94
LinuxIntel CorporationNVIDIA GeForce RTX 40902015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b52.72
LinuxIntel(R) Xeon(R) CPU E5-2697 v3 @ 2.60GHzNVIDIA GeForce RTX 306015.45Ubuntu 24.04.1 LTS0.4.2llama3.1:8b52.72
LinuxAMD Ryzen 5 3600 6-Core ProcessorNavi 32 [Radeon RX 7700 XT / 7800 XT]62.72Linux Mint 220.5.4llama3.1:8b52.7
LinuxIntel(R) Xeon(R) CPU E5-2697 v3 @ 2.60GHzNVIDIA GeForce RTX 306015.45Ubuntu 24.04.1 LTS0.4.1llama3.1:8b52.43
LinuxAMD Ryzen 9 5900X 12-Core Processorunknown30.26Ubuntu 24.100.4.0llama3.1:8b52.21
LinuxAMD Ryzen 7 3700X 8-Core ProcessorNVIDIA GeForce RTX 306062.70Ubuntu 24.04.1 LTS0.4.1llama3.1:8b51.91
Linux Intel(R) Core(TM) i5-10400 CPU @ 2.90GHzNVIDIA GeForce RTX 306031.22Linux Mint 220.3.3llama3.1:8b51.78
LinuxIntel(R) Xeon(R) CPU E5-2609 v4 @ 1.70GHzNVIDIA RTX A4000377.78Ubuntu 22.04.4 LTS0.3.4llama3.1:8b51.47
LinuxAMD Ryzen 7 3700X 8-Core ProcessorNVIDIA GeForce RTX 4060 Ti31.26Ubuntu 24.04.1 LTS0.4.6llama3.1:8b51.35
LinuxIntel(R) Core(TM) i7-14700KNVIDIA GeForce RTX 4060 Ti61.32Ubuntu 22.04.5 LTS0.3.14llama3.1:8b51.08
LinuxIntel(R) Core(TM) i7-14700KNVIDIA GeForce RTX 4060 Ti61.32Ubuntu 22.04.5 LTS0.3.14llama3.1:8b51.07
LinuxQEMU Virtual CPU version 2.5+Navi 22 [Radeon RX 6700/6700 XT/6750 XT / 6800M/6850M XT]23.43Ubuntu 22.04.4 LTS0.2.8llama3.1:8b50.52
LinuxIntel(R) Xeon(R) Silver 4215R CPU @ 3.20GHzQuadro RTX 400029.35Ubuntu 22.04.4 LTS0.3.3llama3.1:8b50.23
LinuxAMD Ryzen Threadripper PRO 3955WX 16-CoresQuadro RTX 4000157.01Ubuntu 22.04.5 LTS0.5.6llama3.1:8b50.15
LinuxQEMU Virtual CPU version 2.5+Navi 22 [Radeon RX 6700/6700 XT/6750 XT / 6800M/6850M XT]23.43Ubuntu 22.04.4 LTS0.2.8llama3.1:8b50.08
LinuxQEMU Virtual CPU version 2.5+Navi 22 [Radeon RX 6700/6700 XT/6750 XT / 6800M/6850M XT]23.43Ubuntu 22.04.4 LTS0.3.4llama3.1:8b50.08
LinuxQEMU Virtual CPU version 2.5+Navi 22 [Radeon RX 6700/6700 XT/6750 XT / 6800M/6850M XT]23.43Ubuntu 22.04.4 LTS0.3.4llama3.1:8b49.96
LinuxIntel(R) Core(TM) i7-4790 CPU @ 3.60GHzNVIDIA GeForce GTX 1080 Ti15.47Ubuntu 24.04.1 LTS0.3.10llama3.1:8b49.02
LinuxIntel(R) Core(TM) i7-4790 CPU @ 3.60GHzNVIDIA GeForce GTX 1080 Ti15.47Ubuntu 24.04.1 LTS0.3.10llama3.1:8b48.38
Linux13th Gen Intel(R) Core(TM) i5-13500NVIDIA RTX 4000 SFF Ada Generation62.60Ubuntu 22.04.4 LTS0.5.3llama3.1:8b48.37
LinuxAMD Ryzen 5 7500F 6-Core ProcessorNVIDIA GeForce RTX 4060 Ti7.76Ubuntu 24.04.1 LTS0.4.5llama3.1:8b48.35
LinuxAMD EPYC-Rome ProcessorNVIDIA L431.34Debian GNU/Linux 12 (bookworm)0.3.10llama3.1:8b48.01
Linux13th Gen Intel(R) Core(TM) i5-13500NVIDIA RTX 4000 SFF Ada Generation62.35"AlmaLinux 9.5 (Teal Serval)"0.5.4llama3.1:8b48.01
LinuxAMD EPYC-Rome ProcessorNVIDIA L431.34Debian GNU/Linux 12 (bookworm)0.3.10llama3.1:8b47.81
LinuxAMD Ryzen 5 5600X 6-Core ProcessorNVIDIA GeForce RTX 406031.26Debian GNU/Linux 12 (bookworm)0.5.1llama3.1:8b47.5
Linux13th Gen Intel(R) Core(TM) i7-13700HNVIDIA GeForce RTX 4070 Laptop GPU62.49Ubuntu 22.04.5 LTS0.3.12llama3.1:8b47.03
LinuxAMD EPYC 7532 32-Core ProcessorTesla P40125.64Ubuntu 24.04.1 LTS0.3.14llama3.1:8b46.89
Linux13th Gen Intel(R) Core(TM) i5-13500NVIDIA RTX 4000 SFF Ada Generation62.35"AlmaLinux 9.5 (Teal Serval)"0.5.4llama3.1:8b46.76
Linux13th Gen Intel(R) Core(TM) i7-13700HNVIDIA GeForce RTX 4070 Laptop GPU62.49Ubuntu 22.04.5 LTS0.3.12llama3.1:8b46.75
Linux13th Gen Intel(R) Core(TM) i5-13500NVIDIA RTX 4000 SFF Ada Generation62.35"AlmaLinux 9.5 (Teal Serval)"0.5.4llama3.1:8b46.62
LinuxIntel(R) Core(TM) i7-9700KF CPU @ 3.60GHzTesla P4031.27Ubuntu 22.04.5 LTS0.3.2llama3.1:8b46.35
LinuxIntel(R) Core(TM) Ultra 9 185HNVIDIA GeForce RTX 4070 Laptop GPU30.94Ubuntu 24.04.1 LTS0.3.11llama3.1:8b46.11
LinuxIntel(R) Core(TM) Ultra 7 155HNVIDIA GeForce RTX 4070 Laptop GPU15.62Ubuntu 22.04.5 LTS0.3.13llama3.1:8b46.07
LinuxIntel(R) Xeon(R) Silver 4410YNVIDIA L41007.65Ubuntu 24.04.1 LTS0.5.4llama3.1:8b46.03
LinuxIntel(R) Xeon(R) Silver 4410YNVIDIA L41007.65Ubuntu 24.04.1 LTS0.5.4llama3.1:8b45.91
LinuxAMD EPYC-Rome ProcessorTesla P4015.61Ubuntu 24.04.1 LTS0.3.14llama3.1:8b45.88
LinuxIntel(R) Core(TM) i7-6900K CPU @ 3.20GHzTesla P40125.69Ubuntu 23.100.3.3llama3.1:8b45.77
LinuxIntel(R) Core(TM) i5-10400F CPU @ 2.90GHzNavi 10 [Radeon RX 5600 OEM/5600 XT / 5700/5700 XT]15.42Ubuntu 22.04.4 LTS0.3.3llama3.1:8b45.63
LinuxIntel(R) Core(TM) i7-6900K CPU @ 3.20GHzTesla P40125.69Ubuntu 23.100.3.3llama3.1:8b45.6
LinuxIntel(R) Core(TM) i7-6900K CPU @ 3.20GHzTesla P40125.69Ubuntu 23.100.3.3llama3.1:8b45.48
LinuxIntel CorporationNVIDIA L40S2015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b45.33
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce GTX 1080 Ti15.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b45.07
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce GTX 1080 Ti15.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b44.91
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce GTX 1080 Ti15.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b44.9
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce GTX 1080 Ti15.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b44.69
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce GTX 1080 Ti15.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b44.53
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce GTX 1080 Ti15.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b44.52
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce GTX 1080 Ti15.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b44.34
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce GTX 1080 Ti15.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b44.33
LinuxIntel(R) Core(TM) i9-10900K CPU @ 3.70GHzNavi 22 [Radeon RX 6700/6700 XT/6750 XT / 6800M/6850M XT]62.35"Red Hat Enterprise Linux 9.5 (Plow)"0.5.4llama3.1:8b44.33
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce GTX 1080 Ti15.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b44.31
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce GTX 1080 Ti15.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b44.3
LinuxAMD Ryzen 9 7900 12-Core ProcessorNVIDIA RTX A2000 12GB32.00Ubuntu 24.04 LTS0.3.6llama3.1:8b44.24
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce GTX 1080 Ti15.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b44.21
LinuxIntel(R) Core(TM) Ultra 7 155HNVIDIA GeForce RTX 4070 Laptop GPU24.46Ubuntu 24.04.1 LTS0.4.2llama3.1:8b43.89
LinuxAMD Ryzen 9 7940HX with Radeon GraphicsNVIDIA GeForce RTX 4070 Laptop GPU23.08Ubuntu 24.04.1 LTS0.4.5llama3.1:8b43.71
LinuxIntel(R) Core(TM) Ultra 7 155HNVIDIA GeForce RTX 4060 Laptop GPU30.80Ubuntu 24.04.1 LTS0.5.1llama3.1:8b43.63
Linux13th Gen Intel(R) Core(TM) i7-13800HENVIDIA RTX 2000 Ada Generation Embedded GPU31.12Ubuntu 24.04.1 LTS0.5.4llama3.1:8b43.63
Linux13th Gen Intel(R) Core(TM) i7-13800HENVIDIA RTX 2000 Ada Generation Embedded GPU31.12Ubuntu 24.04.1 LTS0.5.4llama3.1:8b43.59
Linux13th Gen Intel(R) Core(TM) i7-13800HENVIDIA RTX 2000 Ada Generation Embedded GPU31.12Ubuntu 24.04.1 LTS0.5.4llama3.1:8b43.56
LinuxAMD Ryzen 9 3950X 16-Core ProcessorNVIDIA GeForce RTX 406031.30Ubuntu 24.04.1 LTS0.5.4llama3.1:8b43.4
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce GTX 1080 Ti15.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b43.39
LinuxAMD Ryzen Threadripper PRO 7975WX 32-CoresTesla P4015.58Ubuntu 24.04.1 LTS0.5.1llama3.1:8b42.98
LinuxAMD Ryzen 9 5950X 16-Core ProcessorTesla P4062.69CachyOS0.3.14llama3.1:8b42.61
Linux13th Gen Intel(R) Core(TM) i7-13800HENVIDIA RTX 2000 Ada Generation Embedded GPU31.12Ubuntu 24.04.1 LTS0.5.4llama3.1:8b42.44
LinuxIntel CorporationNVIDIA L40S2015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b42.27
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce GTX 1080 Ti15.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b42.24
LinuxAMD Ryzen 9 5900X 12-Core ProcessorNVIDIA GeForce GTX 1080 Ti30.26Ubuntu 24.100.4.0llama3.1:8b42.02
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce GTX 1080 Ti15.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b42.01
LinuxIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzTesla T415.33"Ubuntu 22.04.5 LTS"0.3.14llama3.1:8b41.61
LinuxIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzTesla T462.10Ubuntu 24.04.1 LTS0.3.10llama3.1:8b41.36
LinuxIntel CorporationNVIDIA L40S2015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b41.3
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce GTX 1080 Ti15.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b41.26
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce GTX 1080 Ti15.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b41.04
Linux13th Gen Intel(R) Core(TM) i7-13800HENVIDIA RTX 2000 Ada Generation Embedded GPU31.12Ubuntu 24.04.1 LTS0.5.4llama3.1:8b41
LinuxIntel CorporationNVIDIA GeForce RTX 40902015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b40.96
Linux13th Gen Intel(R) Core(TM) i7-13800HENVIDIA RTX 2000 Ada Generation Embedded GPU31.12Ubuntu 24.04.1 LTS0.5.4llama3.1:8b40.7
LinuxIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzTesla T462.10Ubuntu 24.04.1 LTS0.3.10llama3.1:8b40.64
Linux13th Gen Intel(R) Core(TM) i7-13800HENVIDIA RTX 2000 Ada Generation Embedded GPU31.12Ubuntu 24.04.1 LTS0.5.4llama3.1:8b40.62
LinuxIntel(R) Xeon(R) Gold 6132 CPU @ 2.60GHzTesla P100-PCIE-12GB125.05"Red Hat Enterprise Linux 9.4 (Plow)"0.3.13llama3.1:8b40.59
LinuxIntel(R) Core(TM) i9-10850K CPU @ 3.60GHzCometLake-S GT2 [UHD Graphics 630]125.59"Debian GNU/Linux 12 (bookworm)"0.3.12llama3.1:8b40.58
LinuxIntel(R) Core(TM) i9-10900K CPU @ 3.70GHzNVIDIA GeForce RTX 406062.70Ubuntu 24.04.1 LTS0.4.7llama3.1:8b40.32
LinuxAMD Ryzen 7 3700X 8-Core ProcessorVega 10 XL/XT [Radeon RX Vega 56/64]31.26Ubuntu 24.04.1 LTS0.3.13llama3.1:8b40.18
Linux13th Gen Intel(R) Core(TM) i7-13800HENVIDIA RTX 2000 Ada Generation Embedded GPU31.12Ubuntu 24.04.1 LTS0.5.4llama3.1:8b40.13
LinuxIntel(R) Xeon(R) Gold 5120 CPU @ 2.20GHzTesla T4251.06"Ubuntu 22.04.5 LTS"0.3.13llama3.1:8b40.11
LinuxIntel(R) Xeon(R) Gold 5120 CPU @ 2.20GHzTesla T4251.06"Ubuntu 22.04.5 LTS"0.3.13llama3.1:8b40.09
Linux13th Gen Intel(R) Core(TM) i7-13800HENVIDIA RTX 2000 Ada Generation Embedded GPU31.12Ubuntu 24.04.1 LTS0.5.4llama3.1:8b40.07
Linux13th Gen Intel(R) Core(TM) i7-13800HENVIDIA RTX 2000 Ada Generation Embedded GPU31.12Ubuntu 24.04.1 LTS0.5.4llama3.1:8b40.06
Linux13th Gen Intel(R) Core(TM) i7-13800HENVIDIA RTX 2000 Ada Generation Embedded GPU31.12Ubuntu 24.04.1 LTS0.5.4llama3.1:8b40
Linux13th Gen Intel(R) Core(TM) i7-13800HENVIDIA RTX 2000 Ada Generation Embedded GPU31.12Ubuntu 24.04.1 LTS0.5.4llama3.1:8b39.96
Linux13th Gen Intel(R) Core(TM) i9-13900HNVIDIA GeForce RTX 4070 Laptop GPU31.17Ubuntu 22.04.5 LTS0.3.14llama3.1:8b39.89
LinuxIntel(R) Xeon(R) Gold 5120 CPU @ 2.20GHzTesla T4251.06"Ubuntu 22.04.5 LTS"0.3.13llama3.1:8b39.81
LinuxIntel(R) Xeon(R) w7-3455NVIDIA RTX A2000 12GB125.04Ubuntu 22.04.5 LTS0.3.14llama3.1:8b39.65
LinuxIntel(R) Xeon(R) CPU E5-2697 v3 @ 2.60GHzTesla P40125.77Debian GNU/Linux 12 (bookworm)0.5.1llama3.1:8b39.35
LinuxIntel(R) Core(TM) i3-4150 CPU @ 3.50GHzNVIDIA P102-1007.44Ubuntu 24.04.1 LTS0.3.13llama3.1:8b39.33
LinuxIntel(R) Core(TM) i7-7700K CPU @ 4.20GHzNVIDIA GeForce GTX 1080 Ti31.16Debian GNU/Linux 12 (bookworm)0.3.14llama3.1:8b39.33
LinuxIntel(R) Xeon(R) w7-3455NVIDIA RTX A2000 12GB125.04Ubuntu 22.04.5 LTS0.3.14llama3.1:8b39.21
LinuxIntel(R) Xeon(R) Gold 5120 CPU @ 2.20GHzTesla T4251.06"Ubuntu 22.04.5 LTS"0.3.13llama3.1:8b38.95
LinuxAMD Ryzen 7 7840HS w/ Radeon 780M GraphicsPhoenix192.15Gentoo Linux0.3.11llama3.1:8b38.94
Linux13th Gen Intel(R) Core(TM) i7-13800HENVIDIA RTX 2000 Ada Generation Embedded GPU31.12Ubuntu 24.04.1 LTS0.5.4llama3.1:8b38.87
LinuxAMD Ryzen 9 5900X 12-Core ProcessorNVIDIA GeForce GTX 108031.25Manjaro Linux0.3.9llama3.1:8b38.53
LinuxIntel(R) Xeon(R) Platinum 8168 CPU @ 2.70GHzGRID P40-8Q31.35Ubuntu 20.04.6 LTS0.3.10llama3.1:8b38.48
Linux13th Gen Intel(R) Core(TM) i7-13800HENVIDIA RTX 2000 Ada Generation Embedded GPU31.12Ubuntu 24.04.1 LTS0.5.4llama3.1:8b38.14
LinuxAMD Ryzen 9 5950X 16-Core Processorunknown62.69CachyOS0.3.14llama3.1:8b37.99
LinuxIntel(R) Xeon(R) CPU E5-2660 v4 @ 2.00GHzNVIDIA GeForce GTX 1080 Ti31.25Ubuntu 24.04.1 LTS0.5.4llama3.1:8b37.85
LinuxIntel(R) Xeon(R) CPU E5-2667 v4 @ 3.20GHzQuadro P500062.80Ubuntu 24.04.1 LTS0.3.12llama3.1:8b37.55
LinuxIntel(R) Core(TM) i7-7560U CPU @ 2.40GHzNVIDIA GeForce GTX 1080 Ti15.38Debian GNU/Linux trixie/sid0.3.4llama3.1:8b37.52
LinuxIntel(R) Xeon(R) Gold 6258R CPU @ 2.70GHzGRID T4-16C31.34Ubuntu 22.04.3 LTS0.3.0llama3.1:8b37.38
Linux13th Gen Intel(R) Core(TM) i7-13700HNVIDIA GeForce RTX 4050 Laptop GPU15.31Ubuntu 22.04.5 LTS0.3.12llama3.1:8b37.22
Linux13th Gen Intel(R) Core(TM) i7-13700HNVIDIA GeForce RTX 4050 Laptop GPU15.31Ubuntu 22.04.5 LTS0.3.12llama3.1:8b37.16
Linux13th Gen Intel(R) Core(TM) i7-13700HNVIDIA GeForce RTX 4050 Laptop GPU15.31Ubuntu 22.04.5 LTS0.3.12llama3.1:8b37.08
LinuxIntel(R) Xeon(R) CPU @ 2.20GHzTesla T412.67Ubuntu 22.04.3 LTS0.4.0llama3.1:8b37.08
LinuxAMD EPYC 7V12 64-Core ProcessorTesla T427.41Ubuntu 20.04.6 LTS0.5.1llama3.1:8b36.94
LinuxIntel(R) Core(TM) i7-8700K CPU @ 3.70GHzNVIDIA GeForce GTX 108062.76Ubuntu 22.04.5 LTS0.4.1llama3.1:8b36.83
LinuxIntel(R) Xeon(R) CPU @ 2.00GHzTesla T429.45Debian GNU/Linux 10 (buster)0.3.12llama3.1:8b36.75
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 309031.26Ubuntu 22.04.5 LTS0.3.13llama3.1:8b36.67
LinuxIntel(R) Xeon(R) Gold 6248R CPU @ 3.00GHzNVIDIA GeForce RTX 407093.66Ubuntu 24.04 LTS0.3.6llama3.1:8b36.29
LinuxIntel(R) Xeon(R) Gold 6134 CPU @ 3.20GHzTesla P100-SXM2-16GB157.03Debian GNU/Linux 12 (bookworm)0.5.1llama3.1:8b35.92
LinuxIntel(R) Core(TM) i7-6700 CPU @ 3.40GHzNVIDIA GeForce GTX 1070 Ti31.30Ubuntu 22.04.5 LTS0.3.14llama3.1:8b35.91
LinuxIntel(R) Core(TM) i7-5820K CPU @ 3.30GHzNVIDIA GeForce RTX 30807.66EndeavourOS Linux0.3.12llama3.1:8b35.9
LinuxIntel(R) Xeon(R) Gold 6134 CPU @ 3.20GHzTesla P100-SXM2-16GB157.03Debian GNU/Linux 12 (bookworm)0.5.1llama3.1:8b35.9
LinuxIntel(R) Xeon(R) CPU @ 2.20GHzTesla T450.99Ubuntu 22.04.3 LTS0.3.10llama3.1:8b35.65
LinuxIntel(R) Xeon(R) CPU E5-2667 v4 @ 3.20GHzQuadro P500031.30Ubuntu 24.04.1 LTS0.3.12llama3.1:8b35.35
LinuxAMD Ryzen 7 7800X3D 8-Core ProcessorTesla M40 24GB15.62Ubuntu 24.04.1 LTS0.3.10llama3.1:8b35.27
LinuxIntel(R) Xeon(R) CPU @ 2.20GHzTesla T412.67Ubuntu 22.04.3 LTS0.4.0llama3.1:8b35.09
LinuxIntel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHzTesla T414.26Ubuntu 24.04.1 LTS0.5.4llama3.1:8b34.95
LinuxIntel(R) Xeon(R) CPU @ 2.00GHzTesla T412.67Ubuntu 22.04.3 LTS0.4.1llama3.1:8b34.8
LinuxIntel(R) Xeon(R) CPU @ 2.00GHzTesla T412.67Ubuntu 22.04.3 LTS0.4.1llama3.1:8b34.75
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce RTX 309031.26Ubuntu 22.04.5 LTS0.3.13llama3.1:8b34.69
LinuxIntel(R) Xeon(R) CPU @ 2.20GHzTesla T412.67Ubuntu 22.04.3 LTS0.3.11llama3.1:8b34.59
LinuxIntel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHzTesla P40188.28"AlmaLinux 9.4 (Seafoam Ocelot)"0.4.1llama3.1:8b34.41
LinuxIntel(R) Xeon(R) Gold 6248R CPU @ 3.00GHzNVIDIA GeForce RTX 309093.66Ubuntu 24.04.1 LTS0.3.6llama3.1:8b33.98
LinuxIntel(R) Xeon(R) Gold 6240 CPU @ 2.60GHzTesla T462.79Ubuntu 22.04.4 LTS0.3.5llama3.1:8b33.03
LinuxIntel(R) Core(TM) Ultra 7 155HNVIDIA GeForce RTX 4070 Laptop GPU15.42Ubuntu 24.04 LTS0.3.6llama3.1:8b32.76
LinuxIntel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHzTesla P100-PCIE-16GB31.34Ubuntu 22.04.5 LTS0.4.6llama3.1:8b32.58
LinuxIntel(R) Xeon(R) W-1270 CPU @ 3.40GHzNVIDIA RTX A2000 Laptop GPU7.75Ubuntu 24.04.1 LTS0.5.2llama3.1:8b32.42
LinuxAMD FX(tm)-8120 Eight-Core ProcessorNVIDIA GeForce GTX 107015.60Arch Linux0.3.12llama3.1:8b32.14
LinuxIntel(R) Xeon(R) Gold 6240 CPU @ 2.60GHzTesla T462.79Ubuntu 22.04.4 LTS0.3.5llama3.1:8b31.32
LinuxAMD Ryzen 5 3600X 6-Core ProcessorNavi 10 [Radeon RX 5600 OEM/5600 XT / 5700/5700 XT]31.26Ubuntu 24.04.1 LTS0.5.1llama3.1:8b31.14
LinuxAMD Ryzen 5 3600X 6-Core ProcessorNavi 10 [Radeon RX 5600 OEM/5600 XT / 5700/5700 XT]31.26Ubuntu 24.04.1 LTS0.5.1llama3.1:8b30.88
LinuxAMD EPYC-Rome ProcessorNVIDIA A231.34Debian GNU/Linux 12 (bookworm)0.3.10llama3.1:8b30.8
LinuxAMD EPYC-Rome ProcessorNVIDIA A231.34Debian GNU/Linux 12 (bookworm)0.3.10llama3.1:8b30.58
LinuxAMD FX(tm)-8120 Eight-Core ProcessorNVIDIA GeForce GTX 107015.60Arch Linux0.3.12llama3.1:8b30.2
LinuxIntel(R) Xeon(R) CPU @ 2.20GHzTesla T414.64Debian GNU/Linux 12 (bookworm)0.5.1llama3.1:8b30.09
LinuxAMD Ryzen 7 7840HS w/ Radeon 780M GraphicsPhoenix192.15Gentoo Linux0.3.11llama3.1:8b30
LinuxIntel(R) Core(TM) i7-5930K CPU @ 3.50GHzNVIDIA GeForce GTX TITAN X125.71Ubuntu 24.04 LTS0.3.9llama3.1:8b29.97
LinuxARMv8 (M128-30)ASPEED Graphics Family1004.46"Fedora Linux 40 (Server Edition)"0.0.0llama3.1:8b29.72
LinuxIntel(R) Core(TM) i9-9900K CPU @ 3.60GHzVega 10 XGA [Radeon Pro Vega 48]62.68Linux Mint 220.5.4llama3.1:8b29.33
LinuxARMv8 (M128-30)ASPEED Graphics Family1004.46"Fedora Linux 40 (Server Edition)"0.0.0llama3.1:8b29.31
LinuxIntel Xeon Processor (Skylake, IBRS)NVIDIA A16440.69Ubuntu 22.04.4 LTS0.4.5llama3.1:8b28.93
LinuxARMv8 (M128-30)ASPEED Graphics Family1004.46"Fedora Linux 40 (Server Edition)"0.0.0llama3.1:8b28.89
LinuxIntel Xeon Processor (Skylake, IBRS)NVIDIA A16440.69Ubuntu 22.04.4 LTS0.4.5llama3.1:8b28.86
LinuxAMD EPYC-Milan ProcessorGD 5446125.29"Rocky Linux 9.4 (Blue Onyx)"0.3.11llama3.1:8b28.82
LinuxIntel CorporationNVIDIA GeForce RTX 40902015.53"Oracle Linux Server 8.10"0.3.2llama3.1:8b28.82
LinuxIntel(R) Core(TM) i7-9700K CPU @ 3.60GHzNVIDIA GeForce RTX 206031.25"Fedora Linux 41 (Workstation Edition)"0.5.6llama3.1:8b28.68
LinuxAMD Ryzen 7 7840HS w/ Radeon 780M GraphicsPhoenix192.15Gentoo Linux0.0.0llama3.1:8b28.65
LinuxIntel(R) Core(TM) i5-10400F CPU @ 2.90GHzNavi 10 [Radeon RX 5600 OEM/5600 XT / 5700/5700 XT]15.42Ubuntu 22.04.4 LTS0.3.3llama3.1:8b28.04
LinuxunknownVirtio GPU376.94Ubuntu 22.04.4 LTS0.0.0llama3.1:8b27.77
LinuxAMD Ryzen 7 5700X 8-Core ProcessorTesla M40 24GB31.26Ubuntu 24.04.1 LTS0.4.7llama3.1:8b27.43
LinuxARMv8 (M128-30)ASPEED Graphics Family1004.46"Fedora Linux 40 (Server Edition)"0.0.0llama3.1:8b26.71
LinuxARMv8 (M128-30)ASPEED Graphics Family1004.46"Fedora Linux 40 (Server Edition)"0.0.0llama3.1:8b25.42
LinuxAMD Ryzen 5 5600 6-Core ProcessorNVIDIA GeForce RTX 3060 Ti31.26Linux Mint 210.4.7llama3.1:8b25.26
LinuxIntel(R) Core(TM) i7-5820K CPU @ 3.30GHzNVIDIA GeForce RTX 30807.66EndeavourOS Linux0.3.12llama3.1:8b25.19
LinuxAMD Ryzen Threadripper 3970X 32-Core ProcessorNVIDIA GeForce RTX 2060125.65"Fedora Linux 41 (Workstation Edition)"0.5.4llama3.1:8b24.5
LinuxAMD Ryzen Threadripper 3970X 32-Core ProcessorNVIDIA GeForce RTX 2060125.65"Fedora Linux 41 (Workstation Edition)"0.5.4llama3.1:8b24.42
LinuxIntel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHzNVIDIA GeForce GTX 1660 Ti15.57Ubuntu 22.04.5 LTS0.3.12llama3.1:8b24.35
LinuxARMv8 (M128-30)ASPEED Graphics Family1004.46"Fedora Linux 40 (Server Edition)"0.0.0llama3.1:8b23.78
LinuxIntel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHzNVIDIA GeForce GTX 1660 Ti15.57Ubuntu 22.04.5 LTS0.3.12llama3.1:8b23.78
LinuxIntel(R) Core(TM) i7-8750H CPU @ 2.20GHzNVIDIA GeForce GTX 106015.49Ubuntu 24.04 LTS0.3.14llama3.1:8b23.67
LinuxIntel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHzTesla P431.34Ubuntu 24.04.1 LTS0.3.14llama3.1:8b23.36
LinuxIntel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHzTesla P47.75Ubuntu 24.04.1 LTS0.3.14llama3.1:8b23.26
LinuxAMD Ryzen 7 3750H with Radeon Vega Mobile GfxNVIDIA GeForce GTX 1660 Ti with Max-Q Design15.30Ubuntu 24.04.1 LTS0.3.14llama3.1:8b22.8
LinuxIntel(R) Core(TM) i5-3470 CPU @ 3.20GHzNVIDIA GeForce GTX 1660 SUPER10.70"Arch Linux"0.3.6llama3.1:8b22.25
LinuxIntel(R) Core(TM) i5-3470 CPU @ 3.20GHzNVIDIA GeForce GTX 1660 SUPER10.70"Arch Linux"0.3.6llama3.1:8b22.09
LinuxIntel(R) Xeon(R) CPU E3-1220 V2 @ 3.10GHzNVIDIA GeForce RTX 306031.30Ubuntu 24.04.1 LTS0.3.11llama3.1:8b22
LinuxIntel(R) Core(TM) i5-9400F CPU @ 2.90GHzNVIDIA GeForce GTX 16607.67Ubuntu 24.04.1 LTS0.5.7llama3.1:8b20.86
LinuxIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHzTesla P4251.75Ubuntu 24.04.1 LTS0.5.4llama3.1:8b20.19
LinuxAMD EPYC 7313P 16-Core ProcessorNVIDIA RTX 4000 Ada Generation251.56Ubuntu 22.04.4 LTS0.4.1llama3.1:8b19.87
LinuxAMD EPYC 7313P 16-Core ProcessorNVIDIA RTX 4000 Ada Generation251.56Ubuntu 22.04.4 LTS0.4.1llama3.1:8b19.85
LinuxAMD EPYC 7313P 16-Core ProcessorNVIDIA RTX 4000 Ada Generation251.56Ubuntu 22.04.4 LTS0.4.1llama3.1:8b19.85
LinuxAMD EPYC 7313P 16-Core ProcessorNVIDIA RTX 4000 Ada Generation251.56Ubuntu 22.04.4 LTS0.4.1llama3.1:8b19.8
LinuxAMD EPYC 7313P 16-Core ProcessorNVIDIA RTX 4000 Ada Generation251.56Ubuntu 22.04.4 LTS0.4.1llama3.1:8b19.61
LinuxIntel(R) Core(TM) i7-7700K CPU @ 4.20GHzNVIDIA GeForce GTX 1060 6GB31.29KDE neon 6.20.3.12llama3.1:8b18.91
LinuxIntel(R) Core(TM) i7-6700K CPU @ 4.00GHzNVIDIA GeForce GTX 980 Ti7.73Ubuntu 22.04.3 LTS0.3.10llama3.1:8b18.88
LinuxIntel(R) Core(TM) i5-10400F CPU @ 2.90GHzNavi 10 [Radeon RX 5600 OEM/5600 XT / 5700/5700 XT]15.42Ubuntu 22.04.4 LTS0.0.0llama3.1:8b18.66
LinuxIntel(R) Core(TM) i5-10400F CPU @ 2.90GHzNavi 10 [Radeon RX 5600 OEM/5600 XT / 5700/5700 XT]15.42Ubuntu 22.04.4 LTS0.0.0llama3.1:8b18.56
LinuxAMD EPYC 7502P 32-Core Processorbochs-drmdrmfb23.44Ubuntu 24.04.1 LTS0.3.14llama3.1:8b18.15
LinuxIntel(R) Xeon(R) CPU E3-1240 v6 @ 3.70GHzQuadro P200054.86Ubuntu 24.04 LTS0.3.3llama3.1:8b17.66
LinuxIntel(R) Xeon(R) Silver 4410Yunknown251.41"Ubuntu 22.04.3 LTS"0.5.4llama3.1:8b17.29
Linux12th Gen Intel(R) Core(TM) i7-12700KFNVIDIA GeForce GTX 166062.63Ubuntu 24.04.1 LTS0.3.14llama3.1:8b16.91
LinuxAMD EPYC 9754 128-Core ProcessorASPEED Graphics Family755.35Ubuntu 24.04.1 LTS0.5.4-19-g86a622cllama3.1:8b16.77
LinuxIntel(R) Xeon(R) CPU E3-1240 v6 @ 3.70GHzQuadro M400054.86Ubuntu 24.04 LTS0.3.3llama3.1:8b16.69
LinuxIntel(R) Xeon(R) Platinum 8275CL CPU @ 3.00GHzunknown91.88"Red Hat Enterprise Linux 8.10 (Ootpa)"0.4.1llama3.1:8b16.56
LinuxAMD EPYC 7402 24-Core ProcessorIntegrated Matrox G200eW3 Graphics Controller256.00"Debian GNU/Linux 12 (bookworm)"0.5.1llama3.1:8b16.26
LinuxAMD Ryzen AI 9 HX 370 w/ Radeon 890Mno_gpu27.01Ubuntu 24.04.1 LTS0.5.7llama3.1:8b16.02
LinuxAMD Ryzen AI 9 HX 370 w/ Radeon 890Mno_gpu27.01Ubuntu 24.04.1 LTS0.5.4llama3.1:8b15.92
LinuxQEMU Virtual CPU version 2.5+Tesla P47.34Ubuntu 24.04.1 LTS0.3.12llama3.1:8b15.55
LinuxIntel(R) Core(TM) Ultra 7 155HIntel Corporation62.35Ubuntu 22.04.4 LTS0.3.6-ipexllm-20240923llama3.1:8b15.49
LinuxIntel(R) Xeon(R) CPU E3-1240 v6 @ 3.70GHzQuadro P200054.86Ubuntu 24.04 LTS0.3.3llama3.1:8b15.22
LinuxIntel(R) Xeon(R) Gold 6354 CPU @ 3.00GHzASPEED Graphics Family125.56Ubuntu 22.04.4 LTS0.3.14llama3.1:8b15.02
LinuxIntel(R) Xeon(R) CPU E5-2623 v4 @ 2.60GHzQuadro M400029.35Ubuntu 22.04.4 LTS0.3.4llama3.1:8b14.88
LinuxIntel(R) Core(TM) i7-9700F CPU @ 3.00GHzNVIDIA GeForce GTX 1660 Ti15.59Ubuntu 24.04.1 LTS0.3.12llama3.1:8b14.85
LinuxAMD Ryzen AI 9 HX 370 w/ Radeon 890Mno_gpu26.97Arch Linux0.5.5llama3.1:8b14.81
LinuxAMD Ryzen 9 9950X 16-Core ProcessorAdvanced Micro Devices, Inc. [AMD/ATI]91.96Ubuntu 24.04.1 LTS0.3.11llama3.1:8b14.15
LinuxAMD Ryzen 9 9950X 16-Core ProcessorAdvanced Micro Devices, Inc. [AMD/ATI]91.96Ubuntu 24.04.1 LTS0.3.11llama3.1:8b14.11
LinuxAMD Ryzen 9 9950X 16-Core ProcessorAdvanced Micro Devices, Inc. [AMD/ATI]91.96Ubuntu 24.04.1 LTS0.3.11llama3.1:8b14.06
LinuxAMD Ryzen 9 9950X 16-Core ProcessorAdvanced Micro Devices, Inc. [AMD/ATI]91.96Ubuntu 24.04.1 LTS0.3.11llama3.1:8b14.03
LinuxIntel(R) Core(TM) i7-14700Kno_gpu62.41Debian GNU/Linux trixie/sid0.5.1llama3.1:8b13.62
LinuxIntel(R) Core(TM) i7-6700HQ CPU @ 2.60GHzNVIDIA GeForce GTX 10607.71Ubuntu 22.04.3 LTS0.3.10llama3.1:8b13.57
LinuxIntel(R) Core(TM) i9-14900Kno_gpu30.61Ubuntu 24.100.5.4llama3.1:8b12.76
LinuxIntel(R) Core(TM) i9-14900Kno_gpu62.53"Fedora Linux 41 (Workstation Edition)"0.4.1llama3.1:8b12.6
LinuxIntel(R) Xeon(R) Platinum 8260 CPU @ 2.40GHzno_gpu32.00"Debian GNU/Linux 12 (bookworm)"0.3.12llama3.1:8b12.33
LinuxAMD Ryzen 5 8600G w/ Radeon 760M GraphicsAdvanced Micro Devices, Inc. [AMD/ATI]60.48Ubuntu 22.04.5 LTS0.5.4llama3.1:8b12.12
LinuxIntel(R) Core(TM) i7-9700F CPU @ 3.00GHzNVIDIA GeForce GTX 1660 Ti15.59Ubuntu 24.04.1 LTS0.3.12llama3.1:8b12.04
LinuxAMD Ryzen 9 8945HS w/ Radeon 780M GraphicsPhoenix358.64Ubuntu 24.04.1 LTS0.4.6llama3.1:8b12.04
LinuxAMD Ryzen 7 7840U w/ Radeon 780M GraphicsPhoenix127.21Bazzite 41 (FROM Fedora Kinoite)0.0.0llama3.1:8b11.88
LinuxAMD Ryzen 7 7840U w/ Radeon 780M GraphicsPhoenix130.65"Fedora Linux 40 (Workstation Edition)"0.3.9llama3.1:8b11.72
LinuxIntel(R) Core(TM) i7-14700no_gpu31.03Debian GNU/Linux 12 (bookworm)0.4.0llama3.1:8b11.67
Linux12th Gen Intel(R) Core(TM) i5-12500no_gpu15.25Debian GNU/Linux 12 (bookworm)0.2.8llama3.1:8b11.48
LinuxIntel(R) Xeon(R) Gold 6246 CPU @ 3.30GHzSVGA II Adapter78.53Ubuntu 22.04.5 LTS0.5.4llama3.1:8b11.21
LinuxAMD Ryzen 9 7940HS w/ Radeon 780M GraphicsPhoenix189.87Ubuntu 24.100.3.9llama3.1:8b11.14
LinuxAMD EPYC 7V73X 64-Core Processorno_gpu125.78Debian GNU/Linux 12 (bookworm)0.4.2llama3.1:8b10.99
LinuxAMD Ryzen 7 7840U w/ Radeon 780M GraphicsPhoenix127.21Bazzite 41 (FROM Fedora Kinoite)0.0.0llama3.1:8b10.84
LinuxAMD Ryzen 7 7840U w/ Radeon 780M GraphicsPhoenix127.21Bazzite 41 (FROM Fedora Kinoite)0.0.0llama3.1:8b10.81
LinuxAMD Ryzen 9 7940HS w/ Radeon 780M GraphicsAdvanced Micro Devices, Inc. [AMD/ATI]30.56Ubuntu 22.04.5 LTS0.4.5llama3.1:8b10.79
LinuxIntel(R) Core(TM) i5-14600Kno_gpu31.12Debian GNU/Linux trixie/sid0.3.9llama3.1:8b10.26
LinuxAMD EPYC 7282 16-Core ProcessorEFI VGA251.61Ubuntu 22.04.5 LTS0.4.4llama3.1:8b10.06
LinuxIntel(R) Core(TM) i7-4790S CPU @ 3.20GHzTesla M6015.49"Ubuntu 22.04.5 LTS"0.5.4-0-g2ddc32d-dirtyllama3.1:8b10.04
LinuxIntel(R) Xeon(R) CPU E5-2697 v3 @ 2.60GHzNVIDIA GeForce GTX 97031.24Fedora Linux 40 (Workstation Edition)0.3.12llama3.1:8b9.79
LinuxIntel(R) Xeon(R) Gold 6246 CPU @ 3.30GHzSVGA II Adapter78.53Ubuntu 22.04.5 LTS0.5.4llama3.1:8b9.79
LinuxAMD Ryzen 9 5900X 12-Core ProcessorMicrosoft Corporation15.58Ubuntu 22.04.5 LTS0.3.10llama3.1:8b9.61
LinuxAMD Ryzen 7 5700G with Radeon GraphicsCezanne30.72Pop!_OS 22.04 LTS0.3.14llama3.1:8b9.58
LinuxAMD Ryzen 9 3900XT 12-Core Processorno_gpu62.74"Debian GNU/Linux 12 (bookworm)"0.4.2llama3.1:8b9.34
LinuxAMD Ryzen 9 3900X 12-Core Processorno_gpu31.24EndeavourOS Linux0.0.0llama3.1:8b9.14
Linux13th Gen Intel(R) Core(TM) i9-13900Raptor Lake-S GT1 [UHD Graphics 770]31.03Ubuntu 24.04 LTS0.3.6llama3.1:8b9.07
LinuxIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHzbochs-drmdrmfb39.87Ubuntu 24.04.1 LTS0.5.4llama3.1:8b9.06
LinuxAMD Ryzen 5 5600G with Radeon GraphicsCezanne125.10Ubuntu 22.04.5 LTS0.3.14llama3.1:8b9.01
LinuxAMD Ryzen 7 PRO 7840U w/ Radeon 780M Graphicsno_gpu58.50"Fedora Linux 41 (Workstation Edition Prerelease)"0.3.12llama3.1:8b8.97
Linux11th Gen Intel(R) Core(TM) i9-11900H @ 2.50GHzTigerLake-H GT1 [UHD Graphics]30.99Ubuntu 22.04.5 LTS0.5.4llama3.1:8b8.76
Linux11th Gen Intel(R) Core(TM) i9-11900H @ 2.50GHzTigerLake-H GT1 [UHD Graphics]30.99Ubuntu 22.04.5 LTS0.5.4llama3.1:8b8.72
Linux11th Gen Intel(R) Core(TM) i5-11400 @ 2.60GHzno_gpu24.00Debian GNU/Linux 12 (bookworm)0.3.11llama3.1:8b8.6
LinuxAMD Ryzen 7 4800H with Radeon GraphicsNVIDIA GeForce GTX 1650 Ti30.77Manjaro Linux0.3.6llama3.1:8b8.52
LinuxIntel(R) Xeon(R) CPU E5-2686 v4 @ 2.30GHzGD 544662.75Ubuntu 24.04.1 LTS0.3.10llama3.1:8b8.48
LinuxIntel(R) Core(TM) Ultra 7 165HMicrosoft Corporation15.35Ubuntu 20.04.6 LTS0.5.4llama3.1:8b8.39
LinuxIntel(R) Core(TM) Ultra 9 285HIntel Corporation62.32Ubuntu 22.04.5 LTS0.4.1llama3.1:8b8.3
LinuxAMD Ryzen 7 7700 8-Core ProcessorTesla M40 24GB30.47Ubuntu 22.04.5 LTS0.5.4llama3.1:8b8.3
LinuxIntel(R) Core(TM) Ultra 7 155HIntel Corporation62.35Ubuntu 22.04.4 LTS0.3.6-ipexllm-20240923llama3.1:8b8.21
Linux13th Gen Intel(R) Core(TM) i5-13400Intel Corporation15.17Ubuntu 22.04 LTS0.4.1llama3.1:8b8.13
LinuxAMD Ryzen 7 5800H with Radeon GraphicsNVIDIA GeForce RTX 3070 Laptop GPU58.70Nobara release 38 (Thirty Eight)0.5.4llama3.1:8b8.07
LinuxIntel(R) Xeon(R) CPU E5-2698 v3 @ 2.30GHzno_gpu125.79Debian GNU/Linux 12 (bookworm)0.3.13llama3.1:8b8.05
LinuxIntel(R) Xeon(R) CPU E5-2690 v2 @ 3.00GHzMGA G200EH251.84Ubuntu 24.04.1 LTS0.5.4llama3.1:8b7.96
LinuxIntel(R) Xeon(R) CPU E5-2698 v3 @ 2.30GHzno_gpu125.79Debian GNU/Linux 12 (bookworm)0.3.13llama3.1:8b7.95
LinuxIntel(R) Xeon(R) CPU E5-2698 v3 @ 2.30GHzno_gpu125.79Debian GNU/Linux 12 (bookworm)0.3.13llama3.1:8b7.86
LinuxAMD Ryzen 7 PRO 6850U with Radeon Graphicsno_gpu30.12"Fedora Linux 40 (Workstation Edition)"0.3.12llama3.1:8b7.76
LinuxIntel(R) Xeon(R) CPU E5-2698 v3 @ 2.30GHzno_gpu125.79Debian GNU/Linux 12 (bookworm)0.3.13llama3.1:8b7.72
LinuxAMD Ryzen 5 3600 6-Core ProcessorNVIDIA GeForce GTX 1650 SUPER46.97Ubuntu 24.04.1 LTS0.3.12llama3.1:8b7.68
LinuxAMD Ryzen 7 7840HS w/ Radeon 780M GraphicsPhoenix192.15Gentoo Linux0.0.0llama3.1:8b7.6
LinuxIntel(R) Xeon(R) Gold 6442YNVIDIA L40-6Q38.99Red Hat Enterprise Linux release 8.10 (Ootpa)0.3.14llama3.1:8b7.53
LinuxAMD Ryzen 3 PRO 5450U with Radeon GraphicsCezanne [Radeon Vega Series / Radeon Vega Mobile Series]14.96Ubuntu 24.04.1 LTS0.5.4llama3.1:8b7.52
LinuxAMD Ryzen 5 3600 6-Core ProcessorNVIDIA CMP 30HX31.25Ubuntu Oracular Oriole (development branch)0.2.8llama3.1:8b7.51
LinuxAMD Ryzen 7 7840HS w/ Radeon 780M GraphicsPhoenix192.15Gentoo Linux0.3.11llama3.1:8b7.4
LinuxAMD Ryzen 7 7840HS w/ Radeon 780M GraphicsPhoenix192.15Gentoo Linux0.0.0llama3.1:8b7.37
Linux11th Gen Intel(R) Core(TM) i7-11370H @ 3.30GHzno_gpu15.41openSUSE Tumbleweed0.0.0llama3.1:8b7.31
LinuxAMD Ryzen 7 1700 Eight-Core ProcessorNVIDIA GeForce GTX 98031.27Debian GNU/Linux 12 (bookworm)0.4.2llama3.1:8b7.28
LinuxAMD Ryzen 7 7840U w/ Radeon 780M GraphicsPhoenix130.66Ubuntu 24.04.1 LTS0.5.4llama3.1:8b7.24
Linux13th Gen Intel(R) Core(TM) i5-13400Intel Corporation15.17Ubuntu 22.04 LTS0.3.11llama3.1:8b7.23
LinuxAMD Ryzen 7 1700 Eight-Core ProcessorNVIDIA GeForce GTX 98031.27Debian GNU/Linux 12 (bookworm)0.4.2llama3.1:8b7.23
Linux12th Gen Intel(R) Core(TM) i7-1280Pno_gpu62.44"openSUSE Tumbleweed"0.0.0llama3.1:8b7.14
LinuxAMD Ryzen 5 8600G w/ Radeon 760M GraphicsAdvanced Micro Devices, Inc. [AMD/ATI]60.48Ubuntu 22.04.5 LTS0.5.4llama3.1:8b6.98
LinuxAMD Ryzen 7 5800H with Radeon GraphicsCezanne [Radeon Vega Series / Radeon Vega Mobile Series]16.00Ubuntu 22.04.5 LTS0.0.0llama3.1:8b6.95
LinuxAMD Ryzen 7 PRO 6850H with Radeon GraphicsRembrandt [Radeon 680M]25.22Ubuntu 24.04.1 LTS0.5.4llama3.1:8b6.92
LinuxIntel(R) Core(TM) Ultra 5 125HMeteor Lake-P [Intel Arc Graphics]31.02Ubuntu 24.04 LTS0.3.3llama3.1:8b6.86
LinuxAMD Ryzen 7 2700X Eight-Core ProcessorNVIDIA GeForce GT 103031.33"Debian GNU/Linux 12 (bookworm)"0.3.11llama3.1:8b6.83
LinuxAMD Ryzen 9 7900 12-Core Processorunknown30.47Ubuntu 24.04.1 LTS0.3.12llama3.1:8b6.78
LinuxAMD Ryzen 7 2700X Eight-Core ProcessorNVIDIA GeForce GT 103031.33"Debian GNU/Linux 12 (bookworm)"0.3.11llama3.1:8b6.77
LinuxIntel(R) Xeon(R) CPU E5-2696 v3 @ 2.30GHzPitcairn PRO [Radeon HD 7850 / R7 265 / R9 270 1024SP]251.74Debian GNU/Linux 12 (bookworm)0.3.12llama3.1:8b6.75
LinuxIntel(R) Xeon(R) CPU E5-2640 v4 @ 2.40GHzSVGA II Adapter62.39"AlmaLinux 8.10 (Cerulean Leopard)"0.3.3llama3.1:8b6.75
LinuxAMD Ryzen 5 5560U with Radeon GraphicsCezanne [Radeon Vega Series / Radeon Vega Mobile Series]15.03Ubuntu 24.04.1 LTS0.5.4llama3.1:8b6.75
LinuxAMD Ryzen 9 3900X 12-Core ProcessorNVIDIA GeForce GT 103031.28Fedora release 38 (Thirty Eight)0.0.0llama3.1:8b6.73
LinuxAMD Ryzen 5 5560U with Radeon GraphicsCezanne [Radeon Vega Series / Radeon Vega Mobile Series]15.03Ubuntu 24.04.1 LTS0.5.4llama3.1:8b6.69
Linux12th Gen Intel(R) Core(TM) i5-12450HAlder Lake-P GT1 [UHD Graphics]31.08Ubuntu 22.04.4 LTS0.5.4llama3.1:8b6.58
Linuxl3-cache1Orin (nvgpu)7.44Ubuntu 22.04.5 LTS0.5.4llama3.1:8b6.56
Linux12th Gen Intel(R) Core(TM) i7-1260PAlder Lake-P Integrated Graphics Controller62.50Ubuntu 22.04.4 LTS0.3.3llama3.1:8b6.54
LinuxIntel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHzQuadro K220062.69Debian GNU/Linux 12 (bookworm)0.3.12llama3.1:8b6.49
Linux12th Gen Intel(R) Core(TM) i5-12450HAlder Lake-P GT1 [UHD Graphics]31.08Ubuntu 22.04.4 LTS0.5.4llama3.1:8b6.49
LinuxIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHzbochs-drmdrmfb39.87Ubuntu 24.04.1 LTS0.5.4llama3.1:8b6.34
LinuxIntel(R) Core(TM) i7-10700 CPU @ 2.90GHzno_gpu24.00"Debian GNU/Linux 12 (bookworm)"0.3.11llama3.1:8b6.19
LinuxIntel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHzASPEED Graphics Family62.63Ubuntu 24.04.1 LTS0.4.4llama3.1:8b6.16
LinuxAMD Ryzen 7 5825U with Radeon Graphicsno_gpu38.00"Fedora Linux 40 (Server Edition)"0.3.12llama3.1:8b6.07
LinuxIntel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHzno_gpu64.00"Debian GNU/Linux 12 (bookworm)"0.5.4llama3.1:8b6.06
Linux13th Gen Intel(R) Core(TM) i5-1340PRaptor Lake-P [Iris Xe Graphics]62.64Ubuntu 24.04.1 LTS0.5.4llama3.1:8b6.04
Linux11th Gen Intel(R) Core(TM) i7-11800H @ 2.30GHzno_gpu15.37EndeavourOS Linux0.3.6llama3.1:8b6.01
LinuxIntel(R) Core(TM) i3-10100 CPU @ 3.60GHzno_gpu24.00"Debian GNU/Linux 12 (bookworm)"0.3.11llama3.1:8b5.99
LinuxIntel(R) Core(TM) i7-6800K CPU @ 3.40GHzEllesmere [Radeon RX 470/480/570/570X/580/580X/590]15.45Ubuntu 22.04.5 LTS0.5.4llama3.1:8b5.97
LinuxIntel(R) Xeon(R) Silver 4208 CPU @ 2.10GHzno_gpu15.62Debian GNU/Linux 12 (bookworm)0.3.13llama3.1:8b5.83
LinuxIntel(R) Core(TM) i5-9500T CPU @ 2.20GHzCoffeeLake-S GT2 [UHD Graphics 630]31.12Ubuntu 22.04.5 LTS0.4.2llama3.1:8b5.78
LinuxIntel(R) Xeon(R) Silver 4208 CPU @ 2.10GHzno_gpu15.62Debian GNU/Linux 12 (bookworm)0.3.13llama3.1:8b5.77
LinuxAMD Ryzen 7 3700X 8-Core ProcessorBasic Render Driver15.58Ubuntu 24.04.1 LTS0.3.12llama3.1:8b5.75
LinuxIntel(R) Xeon(R) Silver 4208 CPU @ 2.10GHzno_gpu15.62Debian GNU/Linux 12 (bookworm)0.3.13llama3.1:8b5.71
LinuxAMD Ryzen 7 8845HS w/ Radeon 780M GraphicsAdvanced Micro Devices, Inc. [AMD/ATI]30.67Pop!_OS 22.04 LTS0.4.2llama3.1:8b5.71
Linux11th Gen Intel(R) Core(TM) i7-11700 @ 2.50GHzIntel Corporation23.23Ubuntu 20.04.6 LTS0.5.1llama3.1:8b5.7
LinuxAMD Ryzen 7 1700 Eight-Core ProcessorNVIDIA GeForce GTX 98031.27Debian GNU/Linux 12 (bookworm)0.4.2llama3.1:8b5.69
LinuxIntel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHzbochs-drmdrmfb29.36Ubuntu 22.04.4 LTS0.3.4llama3.1:8b5.63
LinuxIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHzunknown62.78Debian GNU/Linux 12 (bookworm)0.5.4llama3.1:8b5.54
LinuxIntel(R) Core(TM) i7-6700HQ CPU @ 2.60GHzNVIDIA GeForce GTX 960M31.24Ubuntu 24.04.1 LTS0.5.7llama3.1:8b5.46
LinuxAMD Ryzen 7 8845HS w/ Radeon 780M GraphicsPhoenix324.00Ubuntu 24.100.4.6llama3.1:8b5.35
LinuxAMD Ryzen 7 PRO 4750G with Radeon GraphicsRenoir [Radeon RX Vega 6 (Ryzen 4000/5000 Mobile Series)]62.10Ubuntu 24.04.1 LTS0.5.4llama3.1:8b5.35
LinuxAMD Ryzen 7 PRO 4750G with Radeon GraphicsRenoir [Radeon RX Vega 6 (Ryzen 4000/5000 Mobile Series)]62.10Ubuntu 24.04.1 LTS0.4.1llama3.1:8b5.31
Linux11th Gen Intel(R) Core(TM) i5-11400H @ 2.70GHzNVIDIA GeForce RTX 3050 Ti Laptop GPU7.65Ubuntu 22.04.4 LTS0.3.12llama3.1:8b5.21
LinuxIntel(R) Core(TM) i5-8500 CPU @ 3.00GHzbochs-drmdrmfb15.62Ubuntu 24.04.1 LTS0.4.6llama3.1:8b5.12
LinuxIntel(R) Core(TM) i7-7700 CPU @ 3.60GHzno_gpu54.81Debian GNU/Linux 12 (bookworm)0.4.1llama3.1:8b5.09
LinuxIntel(R) Core(TM) i7-10850H CPU @ 2.70GHzMicrosoft Corporation15.43Ubuntu 22.04.5 LTS0.3.13llama3.1:8b5.05
LinuxIntel(R) Xeon(R) Gold 6226R CPU @ 2.90GHzbochs-drmdrmfb117.91Ubuntu 22.04.4 LTS0.3.4llama3.1:8b4.96
LinuxIntel(R) Xeon(R) CPU D-1528 @ 1.90GHzASPEED Graphics Family125.70Ubuntu 24.04.1 LTS0.3.14llama3.1:8b4.88
LinuxIntel(R) Core(TM) i7-7700K CPU @ 4.20GHzGP106 [GeForce GTX 1060 6GB]31.29KDE neon 6.10.3.12llama3.1:8b4.87
LinuxAMD Ryzen 7 7840U w/ Radeon 780M GraphicsPhoenix130.66Ubuntu 24.04.1 LTS0.5.1llama3.1:8b4.87
LinuxIntel(R) Core(TM) i7-4790S CPU @ 3.20GHzno_gpu15.49"Ubuntu 22.04.5 LTS"0.4.6llama3.1:8b4.77
LinuxIntel(R) Core(TM) i7-10850H CPU @ 2.70GHzCometLake-H GT2 [UHD Graphics]62.41Ubuntu 22.04.5 LTS0.5.1llama3.1:8b4.73
Linux11th Gen Intel(R) Core(TM) i7-1165G7 @ 2.80GHzTigerLake-LP GT2 [Iris Xe Graphics]31.14Manjaro Linux0.3.10llama3.1:8b4.7
LinuxIntel(R) Xeon(R) CPU E5-1650 v2 @ 3.50GHzTahiti LE [Radeon HD 7870 XT]31.31Pop!_OS 22.04 LTS0.5.4llama3.1:8b4.67
LinuxIntel(R) Core(TM) i5-4570 CPU @ 3.20GHzno_gpu15.51Debian GNU/Linux 12 (bookworm)0.4.1llama3.1:8b4.53
LinuxIntel(R) Core(TM) i7-10850H CPU @ 2.70GHzMicrosoft Corporation15.43Ubuntu 22.04.5 LTS0.3.13llama3.1:8b4.52
LinuxIntel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHzQuadro K220031.24Debian GNU/Linux 12 (bookworm)0.3.11llama3.1:8b4.38
LinuxIntel(R) Core(TM) i7-4790 CPU @ 3.60GHzno_gpu15.51Debian GNU/Linux 12 (bookworm)0.4.1llama3.1:8b4.24
LinuxIntel(R) Core(TM) i5-6500T CPU @ 2.50GHzno_gpu31.23"Ubuntu 22.04.5 LTS"0.5.2-0-g60f7556-dirtyllama3.1:8b4.24
LinuxIntel(R) N97Alder Lake-N [UHD Graphics]15.40Ubuntu 24.04.1 LTS0.5.4llama3.1:8b4.12
LinuxIntel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHzhyperv_drmdrmfb31.29Ubuntu 24.04.1 LTS0.5.7llama3.1:8b4.06
LinuxIntel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHzhyperv_drmdrmfb31.29Ubuntu 24.04.1 LTS0.5.7llama3.1:8b4.04
LinuxIntel(R) Core(TM) i7-8665U CPU @ 1.90GHzWhiskeyLake-U GT2 [UHD Graphics 620]30.69Ubuntu 22.04.5 LTS0.5.1llama3.1:8b4.03
LinuxIntel(R) Xeon(R) CPU E5-2640 0 @ 2.50GHzMGA G200EH125.84Ubuntu 24.04.1 LTS0.4.1llama3.1:8b4.01
LinuxIntel(R) Core(TM) i7-4790S CPU @ 3.20GHzTesla M6015.49"Ubuntu 22.04.5 LTS"0.4.6llama3.1:8b3.99
Linux12th Gen Intel(R) Core(TM) i5-1235Uno_gpu62.57Fedora Linux 40 (Forty)0.3.14llama3.1:8b3.92
Linux12th Gen Intel(R) Core(TM) i7-1265Uno_gpu15.47"Ubuntu 22.04.5 LTS"0.3.14llama3.1:8b3.87
LinuxAMD Ryzen 9 3900X 12-Core ProcessorNVIDIA GeForce GTX 108050.14Ubuntu 22.04.5 LTS0.4.0llama3.1:8b3.79
LinuxIntel(R) Core(TM) i7-4790S CPU @ 3.20GHzTesla M6015.49"Ubuntu 22.04.5 LTS"0.4.6llama3.1:8b3.79
Linux11th Gen Intel(R) Core(TM) i5-1135G7 @ 2.40GHzTigerLake-LP GT2 [Iris Xe Graphics]23.26Ubuntu 22.04.4 LTS0.3.9llama3.1:8b3.75
LinuxAMD Ryzen 5 PRO 2400GE w/ Radeon Vega GraphicsRaven Ridge [Radeon Vega Series / Radeon Vega Mobile Series]30.29Ubuntu 24.04.1 LTS0.4.1llama3.1:8b3.7
LinuxAMD Ryzen 5 5600X 6-Core ProcessorNVIDIA GeForce RTX 309031.27"NixOS 24.05 (Uakari)"0.3.12llama3.1:8b3.69
LinuxIntel(R) Xeon(R) CPU E5-1620 v2 @ 3.70GHzNVIDIA GeForce GTX 98015.58Ubuntu 22.04.5 LTS0.3.6llama3.1:8b3.67
LinuxIntel CorporationASPEED Graphics Family15.81Ubuntu 22.04 LTS0.5.4llama3.1:8b3.6
LinuxIntel(R) Core(TM) i7-10710U CPU @ 1.10GHzComet Lake UHD Graphics30.31Ubuntu 24.100.5.4llama3.1:8b3.46
LinuxIntel(R) Core(TM) i7-4790S CPU @ 3.20GHzTesla M6031.22"Ubuntu 22.04.5 LTS"0.4.6llama3.1:8b3.44
LinuxIntel(R) Core(TM) i7-8750H CPU @ 2.20GHzNVIDIA GeForce GTX 1050 Ti with Max-Q Design7.64"Debian GNU/Linux 12 (bookworm)"0.5.4llama3.1:8b3.05
LinuxIntel(R) Xeon(R) CPU E5-1620 v2 @ 3.70GHzQuadro K200023.41Ubuntu 24.04.1 LTS0.3.12llama3.1:8b2.92
LinuxIntel(R) Core(TM) i7-6700HQ CPU @ 2.60GHzNVIDIA GeForce GTX 960M15.57Ubuntu 24.04.1 LTS0.5.6llama3.1:8b2.84
LinuxAMD EPYC 9755 128-Core ProcessorASPEED Graphics Family1511.19Ubuntu 24.04.1 LTS0.3.14llama3.1:8b2.48
LinuxIntel(R) Core(TM) i7-4770HQ CPU @ 2.20GHzsimpledrmdrmfb15.50Ubuntu 24.04 LTS0.3.6llama3.1:8b2.45
LinuxQEMU Virtual CPU version 2.5+no_gpu15.62"Ubuntu 22.04.4 LTS"0.3.4llama3.1:8b2.27
LinuxIntel(R) Xeon(R) CPU E5-2686 v4 @ 2.30GHzTesla K8059.84Ubuntu 24.04 LTS0.3.10llama3.1:8b2.24
LinuxIntel(R) Core(TM) i5-5300U CPU @ 2.30GHzHD Graphics 55007.63Linux Mint 21.20.5.4llama3.1:8b2.19
LinuxQEMU Virtual CPU version 2.5+bochs-drmdrmfb15.61Ubuntu 22.04.4 LTS0.0.0llama3.1:8b2.17
LinuxCortex-A76no_gpu7.86Debian GNU/Linux 12 (bookworm)0.3.14llama3.1:8b1.99
LinuxQEMU Virtual CPU version 2.5+bochs-drmdrmfb15.61Ubuntu 22.04.4 LTS0.3.4llama3.1:8b1.93
LinuxIntel(R) Xeon(R) Gold 6442YSVGA II Adapter38.99Red Hat Enterprise Linux release 8.10 (Ootpa)0.3.14llama3.1:8b1.78
LinuxQEMU Virtual CPU version 2.5+bochs-drmdrmfb9.71Ubuntu 22.04.4 LTS0.3.9llama3.1:8b1.75
LinuxCortex-A76no_gpu7.86Debian GNU/Linux 12 (bookworm)0.4.1llama3.1:8b1.54
LinuxIntel(R) Xeon(R) CPU E5-2698 v3 @ 2.30GHzno_gpu125.79Debian GNU/Linux 12 (bookworm)0.3.14llama3.1:8b1.19
LinuxIntel(R) Xeon(R) Gold 6148 CPU @ 2.40GHzSVGA II Adapter251.88Ubuntu 24.04.1 LTS0.5.7llama3.1:8b1.1
LinuxIntel(R) Xeon(R) Gold 6148 CPU @ 2.40GHzSVGA II Adapter251.88Ubuntu 24.04.1 LTS0.5.7llama3.1:8b1.07
LinuxIntel(R) Xeon(R) CPU E5-2698 v3 @ 2.30GHzno_gpu125.79Debian GNU/Linux 12 (bookworm)0.3.14llama3.1:8b0.99
LinuxIntel(R) Core(TM) i5-2415M CPU @ 2.30GHz2nd Generation Core Processor Family Integrated Graphics Controller7.67Ubuntu 24.04.1 LTS0.4.1llama3.1:8b0.89
LinuxCortex-A72no_gpu7.68Debian GNU/Linux 12 (bookworm)0.4.1llama3.1:8b0.79
LinuxIntel(R) Xeon(R) CPU X5550 @ 2.67GHzJuniper XT [FirePro V5800]13.64Linux Mint 220.5.7llama3.1:8b0.13