Results for Linux

Select Models:

system	cpu	gpu	memory	os_version	ollama_version	model_name	throughput
Linux	AMD Ryzen 9 9950X 16-Core Processor	NVIDIA GeForce RTX 5090	187.27	Arch Linux	0.5.12	deepseek-r1:14b	122.26
Linux	AMD Ryzen 9 9950X 16-Core Processor	NVIDIA GeForce RTX 5090	187.27	Arch Linux	0.5.12	deepseek-r1:14b	121.39
Linux	AMD Ryzen 9 9950X 16-Core Processor	NVIDIA GeForce RTX 5090	187.27	Arch Linux	0.5.12	deepseek-r1:14b	119.71
Linux	AMD Ryzen 9 9950X 16-Core Processor	NVIDIA GeForce RTX 5090	187.27	Arch Linux	0.5.12	deepseek-r1:14b	119.62
Linux	AMD Ryzen 9 9950X 16-Core Processor	NVIDIA GeForce RTX 5090	187.27	Arch Linux	0.5.12	deepseek-r1:14b	118.66
Linux	AMD Ryzen 9 9950X 16-Core Processor	NVIDIA GeForce RTX 5090	187.27	Arch Linux	0.5.12	deepseek-r1:14b	117.47
Linux	AMD Ryzen 9 9950X 16-Core Processor	NVIDIA GeForce RTX 5090	187.27	Arch Linux	0.5.12	deepseek-r1:14b	117.12
Linux	AMD Ryzen 9 9950X 16-Core Processor	NVIDIA GeForce RTX 5090 D NVIDIA GeForce RTX 5090 D	60.43	Ubuntu 24.04.1 LTS	0.5.11	deepseek-r1:14b	116.94
Linux	AMD Ryzen 9 9950X 16-Core Processor	NVIDIA GeForce RTX 5090	187.27	Arch Linux	0.5.12	deepseek-r1:14b	116.43
Linux	AMD Ryzen Threadripper 7970X 32-Cores	NVIDIA GeForce RTX 5090	251.19	Pop!_OS 22.04 LTS	0.5.7	deepseek-r1:14b	115.06
Linux	unknown	NVIDIA GH200 480GB	573.55	Ubuntu 24.04.1 LTS	0.5.11	deepseek-r1:14b	114.15
Linux	unknown	NVIDIA GH200 480GB	573.55	Ubuntu 24.04.1 LTS	0.5.11	deepseek-r1:14b	114.13
Linux	unknown	NVIDIA GH200 480GB	573.55	Ubuntu 24.04.1 LTS	0.5.11	deepseek-r1:14b	114.03
Linux	unknown	NVIDIA GH200 480GB	525.68	"Debian GNU/Linux 12 (bookworm)"	0.5.12	deepseek-r1:14b	113.26
Linux	unknown	NVIDIA GH200 480GB	525.68	"Debian GNU/Linux 12 (bookworm)"	0.5.12	deepseek-r1:14b	112.89
Linux	unknown	NVIDIA GH200 480GB	525.68	"Debian GNU/Linux 12 (bookworm)"	0.5.12	deepseek-r1:14b	112.59
Linux	unknown	NVIDIA GH200 480GB	525.68	"Debian GNU/Linux 12 (bookworm)"	0.5.12	deepseek-r1:14b	111.66
Linux	Intel Corporation	NVIDIA H100 80GB HBM3 NVIDIA H100 80GB HBM3 NVIDIA H100 80GB HBM3 NVIDIA H100 80GB HBM3 NVIDIA H100 80GB HBM3 NVIDIA H100 80GB HBM3 NVIDIA H100 80GB HBM3 NVIDIA H100 80GB HBM3	2015.56	Ubuntu 22.04.5 LTS	0.5.7	deepseek-r1:14b	103.74
Linux	AMD EPYC 9124 16-Core Processor	NVIDIA H200 NVL	755.24	Debian GNU/Linux 12 (bookworm)	0.5.12	deepseek-r1:14b	97.48
Linux	AMD EPYC 9274F 24-Core Processor	NVIDIA H100 NVL NVIDIA H100 NVL NVIDIA H100 NVL NVIDIA H100 NVL NVIDIA H100 NVL	1133.42	Ubuntu 22.04.5 LTS	0.5.7	deepseek-r1:14b	95.23
Linux	AMD EPYC 9124 16-Core Processor	NVIDIA H100 80GB HBM3	503.60	Ubuntu 22.04.5 LTS	0.5.7	deepseek-r1:14b	90.85
Linux	AMD Ryzen 9 7900X 12-Core Processor	NVIDIA GeForce RTX 4090 NVIDIA GeForce RTX 4090	124.95	Ubuntu 22.04.5 LTS	0.5.11	deepseek-r1:14b	81.43
Linux	AMD Ryzen Threadripper 7970X 32-Cores	NVIDIA GeForce RTX 4090	251.19	Pop!_OS 22.04 LTS	0.5.7	deepseek-r1:14b	81.23
Linux	AMD Ryzen 9 7945HX with Radeon Graphics	NVIDIA GeForce RTX 4090	92.03	Pop!_OS 22.04 LTS	0.5.7	deepseek-r1:14b	81.11
Linux	AMD EPYC 7663 56-Core Processor	NVIDIA GeForce RTX 4090 NVIDIA GeForce RTX 4090 NVIDIA GeForce RTX 4090	251.54	Debian GNU/Linux 12 (bookworm)	0.5.11	deepseek-r1:14b	80.3
Linux	AMD EPYC 7663 56-Core Processor	NVIDIA GeForce RTX 4090 NVIDIA GeForce RTX 4090 NVIDIA GeForce RTX 4090	251.54	Debian GNU/Linux 12 (bookworm)	0.5.11	deepseek-r1:14b	80.15
Linux	unknown	NVIDIA GeForce RTX 4090 NVIDIA GeForce RTX 4070	125.60	Ubuntu 24.04.2 LTS	0.5.12	deepseek-r1:14b	79.19
Linux	13th Gen Intel(R) Core(TM) i9-13900K	NVIDIA GeForce RTX 4090	125.51	Ubuntu 22.04.4 LTS	0.5.7	deepseek-r1:14b	77.42
Linux	12th Gen Intel(R) Core(TM) i9-12900KF	NVIDIA GeForce RTX 4090 NVIDIA GeForce RTX 4090	62.58	Ubuntu 22.04.5 LTS	0.5.13	deepseek-r1:14b	76.22
Linux	12th Gen Intel(R) Core(TM) i9-12900KF	NVIDIA GeForce RTX 4090 NVIDIA GeForce RTX 4090	62.58	Ubuntu 22.04.5 LTS	0.5.12	deepseek-r1:14b	75.92
Linux	12th Gen Intel(R) Core(TM) i9-12900KF	NVIDIA GeForce RTX 4090 NVIDIA GeForce RTX 4090	62.58	Ubuntu 22.04.5 LTS	0.5.13	deepseek-r1:14b	75.81
Linux	13th Gen Intel(R) Core(TM) i9-13900K	NVIDIA GeForce RTX 4090	62.79	Ubuntu 22.04.5 LTS	0.5.7	deepseek-r1:14b	75.78
Linux	12th Gen Intel(R) Core(TM) i9-12900KF	NVIDIA GeForce RTX 4090 NVIDIA GeForce RTX 4090	62.58	Ubuntu 22.04.5 LTS	0.5.13	deepseek-r1:14b	75.71
Linux	unknown	NVIDIA GeForce RTX 4090	125.53	Ubuntu 24.04.2 LTS	0.5.11	deepseek-r1:14b	75.6
Linux	unknown	NVIDIA GeForce RTX 4090 NVIDIA GeForce RTX 4070	125.60	Ubuntu 24.04.2 LTS	0.5.11	deepseek-r1:14b	75.56
Linux	12th Gen Intel(R) Core(TM) i9-12900KF	NVIDIA GeForce RTX 4090 NVIDIA GeForce RTX 4090	62.58	Ubuntu 22.04.5 LTS	0.5.13	deepseek-r1:14b	75.01
Linux	Intel(R) Core(TM) i7-14700	NVIDIA GeForce RTX 4090	62.54	Ubuntu 22.04.5 LTS	0.3.14	deepseek-r1:14b	74.86
Linux	QEMU Virtual CPU version 2.5+	NVIDIA RTX 6000 Ada Generation	62.79	Debian GNU/Linux 12 (bookworm)	0.5.11	deepseek-r1:14b	73.42
Linux	QEMU Virtual CPU version 2.5+	NVIDIA RTX 6000 Ada Generation	31.34	Debian GNU/Linux 12 (bookworm)	0.5.11	deepseek-r1:14b	73.36
Linux	AMD EPYC 7V13 64-Core Processor	NVIDIA A100 80GB PCIe	865.92	Ubuntu 22.04.3 LTS	0.6.1	deepseek-r1:14b	72.41
Linux	AMD Ryzen 9 7950X3D 16-Core Processor	NVIDIA GeForce RTX 4090 NVIDIA GeForce RTX 4090	125.46	Debian GNU/Linux 12 (bookworm)	0.5.1	deepseek-r1:14b	72.28
Linux	AMD EPYC 7V13 64-Core Processor	NVIDIA A100 80GB PCIe	865.92	Ubuntu 22.04.3 LTS	0.6.1	deepseek-r1:14b	72.09
Linux	AMD EPYC 7V13 64-Core Processor	NVIDIA A100 80GB PCIe	865.92	Ubuntu 22.04.3 LTS	0.6.1	deepseek-r1:14b	71.67
Linux	AMD Ryzen 9 5900X 12-Core Processor	NVIDIA GeForce RTX 3090 NVIDIA GeForce RTX 3090	60.70	Ubuntu 24.10	0.6.0	deepseek-r1:14b	71.42
Linux	AMD Ryzen 9 9900X 12-Core Processor	NVIDIA GeForce RTX 5080	45.84	Ubuntu 24.04.1 LTS	0.5.11	deepseek-r1:14b	71.33
Linux	INTEL(R) XEON(R) SILVER 4510	NVIDIA GeForce RTX 5080	125.58	Ubuntu 22.04.3 LTS	0.5.4	deepseek-r1:14b	70.23
Linux	AMD Ryzen 7 3700X 8-Core Processor	NVIDIA GeForce RTX 4090	125.70	Ubuntu 22.04.5 LTS	0.3.14	deepseek-r1:14b	69.96
Linux	AMD Ryzen 9 5950X 16-Core Processor	NVIDIA GeForce RTX 3090	62.72	Gentoo Linux	git-8d8b9f83	deepseek-r1:14b	69.54
Linux	AMD Ryzen 9 9950X 16-Core Processor	NVIDIA GeForce RTX 3090	60.45	Fedora Linux 41 (KDE Plasma)	0.5.7	deepseek-r1:14b	69.35
Linux	Intel(R) Xeon(R) Gold 5412U	NVIDIA RTX 6000 Ada Generation	124.96	"AlmaLinux 9.5 (Teal Serval)"	0.5.4	deepseek-r1:14b	69.26
Linux	INTEL(R) XEON(R) GOLD 6530	NVIDIA GeForce RTX 4090	503.24	Ubuntu 24.04.1 LTS	0.5.7	deepseek-r1:14b	68.65
Linux	AMD Ryzen 5 5600X 6-Core Processor	NVIDIA GeForce RTX 3090	125.70	Ubuntu 24.10	0.5.12	deepseek-r1:14b	67.72
Linux	AMD Ryzen 9 5950X 16-Core Processor	NVIDIA GeForce RTX 3090	62.75	Ubuntu 22.04.3 LTS	0.5.7-0-ga420a45-dirty	deepseek-r1:14b	66.36
Linux	INTEL(R) XEON(R) SILVER 4510	NVIDIA GeForce RTX 5070 Ti	125.58	Ubuntu 22.04.3 LTS	0.5.4	deepseek-r1:14b	66.16
Linux	AMD Ryzen 5 9600X 6-Core Processor	NVIDIA GeForce RTX 3090	30.49	Arch Linux	0.5.7	deepseek-r1:14b	65.74
Linux	11th Gen Intel(R) Core(TM) i9-11900K @ 3.50GHz	NVIDIA GeForce RTX 3090	62.58	Ubuntu 20.04.6 LTS	0.5.7	deepseek-r1:14b	65.66
Linux	AMD Ryzen 5 9600X 6-Core Processor	NVIDIA GeForce RTX 3090	30.49	Arch Linux	0.5.7	deepseek-r1:14b	65.35
Linux	AMD Ryzen 5 9600X 6-Core Processor	NVIDIA GeForce RTX 3090	30.49	Arch Linux	0.5.12	deepseek-r1:14b	65.31
Linux	AMD Ryzen 5 9600X 6-Core Processor	NVIDIA GeForce RTX 3090	30.49	Arch Linux	0.5.7	deepseek-r1:14b	65.31
Linux	AMD Ryzen 5 9600X 6-Core Processor	NVIDIA GeForce RTX 3090	30.49	Arch Linux	0.5.12	deepseek-r1:14b	65.22
Linux	AMD Ryzen 5 9600X 6-Core Processor	NVIDIA GeForce RTX 3090	30.49	Arch Linux	0.5.7	deepseek-r1:14b	65.1
Linux	AMD Ryzen 5 9600X 6-Core Processor	NVIDIA GeForce RTX 3090	30.49	Arch Linux	0.5.7	deepseek-r1:14b	65.08
Linux	AMD Ryzen 5 9600X 6-Core Processor	NVIDIA GeForce RTX 3090	30.49	Arch Linux	0.5.7	deepseek-r1:14b	65.07
Linux	AMD Ryzen 5 9600X 6-Core Processor	NVIDIA GeForce RTX 3090	30.49	Arch Linux	0.5.7	deepseek-r1:14b	65
Linux	AMD Ryzen 5 9600X 6-Core Processor	NVIDIA GeForce RTX 3090	30.49	Arch Linux	0.5.7	deepseek-r1:14b	64.82
Linux	AMD Ryzen 5 9600X 6-Core Processor	NVIDIA GeForce RTX 3090	30.49	Arch Linux	0.5.7	deepseek-r1:14b	64.65
Linux	Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz	NVIDIA GeForce RTX 4090	62.64	Ubuntu 22.04.5 LTS	0.5.7	deepseek-r1:14b	64.62
Linux	AMD Ryzen 5 9600X 6-Core Processor	NVIDIA GeForce RTX 3090	30.49	Arch Linux	0.5.7	deepseek-r1:14b	64.42
Linux	AMD Ryzen 5 9600X 6-Core Processor	NVIDIA GeForce RTX 3090	30.49	Arch Linux	0.5.7	deepseek-r1:14b	64.16
Linux	Intel(R) Xeon(R) Silver 4310 CPU @ 2.10GHz	NVIDIA A800 80GB PCIe	251.09	"CentOS Linux 7 (Core)"	0.5.7	deepseek-r1:14b	64.15
Linux	Intel(R) Xeon(R) Platinum 8350C CPU @ 2.60GHz	NVIDIA A100 80GB PCIe	62.78	Ubuntu 20.04.3 LTS	0.4.2	deepseek-r1:14b	63.68
Linux	AMD Ryzen 5 9600X 6-Core Processor	NVIDIA GeForce RTX 3090	30.49	Arch Linux	0.5.7	deepseek-r1:14b	62.79
Linux	Intel(R) Core(TM) i9-14900K	NVIDIA GeForce RTX 4080 SUPER	15.62	Debian GNU/Linux 12 (bookworm)	0.3.8	deepseek-r1:14b	62.65
Linux	unknown	NVIDIA GeForce RTX 4080 SUPER	93.41	"Arch Linux"	0.5.12	deepseek-r1:14b	62.39
Linux	AMD Ryzen 9 3950X 16-Core Processor	NVIDIA GeForce RTX 3090 NVIDIA GeForce RTX 3090	62.74	Ubuntu 24.04.2 LTS	0.5.11	deepseek-r1:14b	62.11
Linux	AMD EPYC 7502 32-Core Processor	NVIDIA GeForce RTX 3090 NVIDIA GeForce RTX 3090	251.54	Ubuntu 24.04.2 LTS	0.5.13	deepseek-r1:14b	61.65
Linux	unknown	NVIDIA GeForce RTX 3090 NVIDIA GeForce RTX 3090 NVIDIA GeForce RTX 3080 Ti	251.54	Ubuntu 24.04.2 LTS	0.5.10	deepseek-r1:14b	61.14
Linux	INTEL(R) XEON(R) SILVER 4510	NVIDIA GeForce RTX 4080 SUPER	125.58	Ubuntu 22.04.3 LTS	0.5.4	deepseek-r1:14b	60.57
Linux	AMD Ryzen Threadripper 3970X 32-Core Processor	NVIDIA GeForce RTX 3090 NVIDIA GeForce RTX 3090	251.54	Ubuntu 24.04.2 LTS	0.5.11	deepseek-r1:14b	60.43
Linux	Intel(R) Core(TM) i7-10700K CPU @ 3.80GHz	NVIDIA GeForce RTX 3090	30.46	Ubuntu 24.10	0.5.11	deepseek-r1:14b	59.65
Linux	INTEL(R) XEON(R) SILVER 4510	NVIDIA GeForce RTX 4080 SUPER	125.58	Ubuntu 22.04.3 LTS	0.5.4	deepseek-r1:14b	59.53
Linux	INTEL(R) XEON(R) SILVER 4510	NVIDIA GeForce RTX 4080 SUPER	125.58	Ubuntu 22.04.3 LTS	0.5.4	deepseek-r1:14b	59.29
Linux	INTEL(R) XEON(R) SILVER 4510	NVIDIA GeForce RTX 4080 SUPER	125.58	Ubuntu 22.04.3 LTS	0.5.4	deepseek-r1:14b	59.17
Linux	INTEL(R) XEON(R) SILVER 4510	NVIDIA GeForce RTX 4080 SUPER	125.58	Ubuntu 22.04.3 LTS	0.5.4	deepseek-r1:14b	59.08
Linux	INTEL(R) XEON(R) SILVER 4510	NVIDIA GeForce RTX 4080 SUPER	125.58	Ubuntu 22.04.3 LTS	0.5.4	deepseek-r1:14b	59.04
Linux	INTEL(R) XEON(R) PLATINUM 8580	NVIDIA L40S	251.38	Ubuntu 22.04.5 LTS	0.5.7	deepseek-r1:14b	59.02
Linux	AMD EPYC 7502 32-Core Processor	NVIDIA GeForce RTX 3090 NVIDIA GeForce RTX 3090	251.54	Ubuntu 24.04.2 LTS	0.5.13	deepseek-r1:14b	58.86
Linux	unknown	NVIDIA GeForce RTX 4080 SUPER	30.45	"Arch Linux"	0.5.12	deepseek-r1:14b	58.36
Linux	AMD EPYC 9124 16-Core Processor	NVIDIA L40S NVIDIA L40S	251.58	Ubuntu 24.04.1 LTS	0.5.7	deepseek-r1:14b	57.77
Linux	AMD Ryzen 7 2700X Eight-Core Processor	NVIDIA GeForce RTX 3090 NVIDIA GeForce RTX 3060	62.72	Linux Mint 21	0.5.7	deepseek-r1:14b	57.21
Linux	Intel(R) Xeon(R) Gold 6348 CPU @ 2.60GHz	NVIDIA A100 80GB PCIe NVIDIA A100 80GB PCIe NVIDIA A100 80GB PCIe NVIDIA A100 80GB PCIe NVIDIA A100 80GB PCIe NVIDIA A100 80GB PCIe NVIDIA A100 80GB PCIe NVIDIA A100 80GB PCIe	1007.52	Ubuntu 22.04.4 LTS	0.5.11	deepseek-r1:14b	56.81
Linux	AMD Ryzen 9 9950X 16-Core Processor	NVIDIA GeForce RTX 4080 SUPER	60.43	"Arch Linux"	0.5.7	deepseek-r1:14b	56.46
Linux	AMD Ryzen 5 5600 6-Core Processor	NVIDIA RTX A6000	15.54	Ubuntu 22.04.4 LTS	0.5.4	deepseek-r1:14b	55.25
Linux	Intel(R) Xeon(R) Gold 6438M	NVIDIA L40S NVIDIA L40S NVIDIA L40S NVIDIA L40S	503.37	Ubuntu 24.04.2 LTS	0.5.7	deepseek-r1:14b	55.09
Linux	AMD Ryzen 5 5600X 6-Core Processor	NVIDIA GeForce RTX 4080 SUPER	15.59	Ubuntu 24.04.1 LTS	0.5.7	deepseek-r1:14b	55.09
Linux	AMD EPYC 7763 64-Core Processor	NVIDIA RTX A5000	251.53	Ubuntu 22.04.3 LTS	0.5.4	deepseek-r1:14b	53.82
Linux	Intel(R) Xeon(R) Gold 6438M	NVIDIA L40S NVIDIA L40S NVIDIA L40S NVIDIA L40S	503.37	Ubuntu 24.04.2 LTS	0.5.7	deepseek-r1:14b	52.43
Linux	AMD Ryzen 9 5950X 16-Core Processor	Navi 31 [Radeon RX 7900 XT/7900 XTX/7900 GRE/7900M]	125.72	Linux Mint 22.1	0.5.11	deepseek-r1:14b	51.71
Linux	AMD Ryzen 9 5950X 16-Core Processor	Navi 31 [Radeon RX 7900 XT/7900 XTX/7900 GRE/7900M]	125.72	Linux Mint 22.1	0.5.11	deepseek-r1:14b	51.65
Linux	Intel(R) Xeon(R) Gold 6242 CPU @ 2.80GHz	Quadro RTX 6000 NVIDIA RTX A6000	250.31	Ubuntu 22.04.2 LTS	0.5.12	deepseek-r1:14b	51.6
Linux	Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz	NVIDIA GeForce RTX 3090 NVIDIA GeForce RTX 3090	62.74	Ubuntu 22.04.5 LTS	0.5.11	deepseek-r1:14b	49.18
Linux	Intel(R) Xeon(R) w9-3495X	NVIDIA RTX 5000 Ada Generation NVIDIA RTX 5000 Ada Generation	64.00	Ubuntu 22.04.5 LTS	0.5.11	deepseek-r1:14b	49.1
Linux	Intel(R) Xeon(R) CPU E5-2686 v4 @ 2.30GHz	Tesla V100-SXM2-16GB Tesla V100-SXM2-16GB Tesla V100-SXM2-16GB Tesla V100-SXM2-16GB Tesla V100-SXM2-16GB Tesla V100-SXM2-16GB Tesla V100-SXM2-16GB Tesla V100-SXM2-16GB	480.22	Ubuntu 22.04.5 LTS	0.5.9	deepseek-r1:14b	48.83
Linux	AMD Ryzen 9 5950X 16-Core Processor	Navi 31 [Radeon RX 7900 XT/7900 XTX/7900 GRE/7900M]	125.72	Linux Mint 22.1	0.5.11	deepseek-r1:14b	48.44
Linux	AMD Ryzen 9 5950X 16-Core Processor	Navi 31 [Radeon RX 7900 XT/7900 XTX/7900 GRE/7900M]	125.72	Linux Mint 22.1	0.5.11	deepseek-r1:14b	48.4
Linux	AMD EPYC 7702 64-Core Processor	Tesla V100-PCIE-32GB	2011.72	Ubuntu 22.04.5 LTS	0.5.7	deepseek-r1:14b	48.4
Linux	AMD Ryzen 7 5800X3D 8-Core Processor	no_gpu	31.27	Arch Linux	0.5.7	deepseek-r1:14b	48.19
Linux	AMD Ryzen 9 5900X 12-Core Processor	NVIDIA GeForce RTX 3090 NVIDIA GeForce RTX 3090	60.70	Ubuntu 24.10	0.5.13	deepseek-r1:14b	48.01
Linux	Intel(R) Xeon(R) Gold 6448H	NVIDIA A30	2015.54	Debian GNU/Linux 12 (bookworm)	0.5.7	deepseek-r1:14b	47.32
Linux	AMD Ryzen 7 5800X 8-Core Processor	NVIDIA GeForce RTX 2080 Ti	19.07	Ubuntu 22.04.5 LTS	0.5.7	deepseek-r1:14b	47.17
Linux	AMD Ryzen 7 8700G w/ Radeon 780M Graphics	NVIDIA GeForce RTX 4070	60.49	Ubuntu 24.04.1 LTS	0.5.7	deepseek-r1:14b	46.26
Linux	unknown	NVIDIA GeForce RTX 4090 NVIDIA GeForce RTX 4070	125.60	Ubuntu 24.04.2 LTS	0.5.12	deepseek-r1:14b	45.14
Linux	AMD Ryzen Threadripper 1950X 16-Core Processor	NVIDIA GeForce RTX 2080 Ti NVIDIA GeForce RTX 2080 Ti	62.63	"Debian GNU/Linux 12 (bookworm)"	0.5.7	deepseek-r1:14b	44.16
Linux	unknown	NVIDIA GeForce RTX 4070 NVIDIA GeForce RTX 3070 Ti	125.60	Ubuntu 24.04.2 LTS	0.3.13	deepseek-r1:14b	44.07
Linux	AMD Ryzen 5 3600 6-Core Processor	NVIDIA GeForce RTX 4070	62.70	Ubuntu 24.04.2 LTS	0.5.11	deepseek-r1:14b	43.03
Linux	unknown	NVIDIA GeForce RTX 4070 NVIDIA GeForce RTX 3070 Ti	125.60	Ubuntu 24.04.2 LTS	0.3.13	deepseek-r1:14b	42.39
Linux	Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz	NVIDIA GeForce RTX 2080 Ti NVIDIA GeForce RTX 2080 Ti NVIDIA GeForce RTX 2080 Ti NVIDIA GeForce RTX 2080 Ti	187.54	Ubuntu 24.04.1 LTS	0.5.12	deepseek-r1:14b	41.53
Linux	Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz	NVIDIA GeForce RTX 2080 Ti NVIDIA GeForce RTX 2080 Ti NVIDIA GeForce RTX 2080 Ti NVIDIA GeForce RTX 2080 Ti	187.54	Ubuntu 24.04.1 LTS	0.5.12	deepseek-r1:14b	41.5
Linux	AMD EPYC 7R32	NVIDIA A10G	62.09	"Amazon Linux 2023.6.20250115"	0.5.7	deepseek-r1:14b	41.37
Linux	AMD EPYC 7R32	NVIDIA A10G	62.09	"Amazon Linux 2023.6.20250115"	0.5.7	deepseek-r1:14b	41.26
Linux	AMD EPYC 7R32	NVIDIA A10G	15.41	"Amazon Linux 2023.6.20250115"	0.5.7	deepseek-r1:14b	40.9
Linux	AMD EPYC 7R32	NVIDIA A10G	30.97	"Amazon Linux 2023.6.20250115"	0.5.7	deepseek-r1:14b	40.88
Linux	Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz	NVIDIA GeForce RTX 4070 SUPER	31.28	Ubuntu 22.04.2 LTS	0.5.7	deepseek-r1:14b	40.49
Linux	Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz	NVIDIA GeForce RTX 4070 SUPER	31.28	Ubuntu 22.04.2 LTS	0.5.7	deepseek-r1:14b	40.48
Linux	Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz	NVIDIA GeForce RTX 2080 Ti	15.58	"Ubuntu 22.04.5 LTS"	0.5.7-0-ga420a45-dirty	deepseek-r1:14b	40.48
Linux	Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz	NVIDIA GeForce RTX 4070 SUPER	31.28	Ubuntu 22.04.2 LTS	0.5.7	deepseek-r1:14b	40.36
Linux	Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz	NVIDIA GeForce RTX 4070 SUPER	31.28	Ubuntu 22.04.2 LTS	0.5.7	deepseek-r1:14b	40.33
Linux	Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz	NVIDIA GeForce RTX 4070 SUPER	31.28	Ubuntu 22.04.2 LTS	0.5.7	deepseek-r1:14b	40.31
Linux	Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz	NVIDIA GeForce RTX 4070 SUPER	31.28	Ubuntu 22.04.2 LTS	0.5.7	deepseek-r1:14b	40.02
Linux	Intel(R) Xeon(R) Platinum 8358 CPU @ 2.60GHz	NVIDIA A10 NVIDIA A10	471.67	"Oracle Linux Server 9.5"	0.5.13	deepseek-r1:14b	39.99
Linux	Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz	NVIDIA GeForce RTX 4070 SUPER	31.28	Ubuntu 22.04.2 LTS	0.5.7	deepseek-r1:14b	39.99
Linux	Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz	NVIDIA GeForce RTX 4070 SUPER	31.28	Ubuntu 22.04.2 LTS	0.5.7	deepseek-r1:14b	39.98
Linux	Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz	NVIDIA GeForce RTX 4070 SUPER	31.28	Ubuntu 22.04.2 LTS	0.5.7	deepseek-r1:14b	39.82
Linux	Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz	NVIDIA GeForce RTX 4070 SUPER	31.28	Ubuntu 22.04.2 LTS	0.5.7	deepseek-r1:14b	39.73
Linux	Intel(R) Core(TM) i9-10900X CPU @ 3.70GHz	NVIDIA RTX A4500 NVIDIA GeForce RTX 2080 SUPER	125.51	Ubuntu 24.04.2 LTS	0.5.7	deepseek-r1:14b	39.62
Linux	Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz	NVIDIA GeForce RTX 2080 Ti	125.69	Ubuntu 22.04.3 LTS	0.5.7	deepseek-r1:14b	39.61
Linux	Intel(R) Xeon(R) Platinum 8358 CPU @ 2.60GHz	NVIDIA A10	235.43	"Oracle Linux Server 9.5"	0.5.13	deepseek-r1:14b	39.33
Linux	Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz	NVIDIA GeForce RTX 4070 SUPER	31.28	Ubuntu 22.04.2 LTS	0.5.7	deepseek-r1:14b	39.22
Linux	Intel(R) Xeon(R) Gold 6342 CPU @ 2.80GHz	NVIDIA A10	7.50	"Rocky Linux 9.4 (Blue Onyx)"	0.5.7	deepseek-r1:14b	39.17
Linux	Intel(R) Xeon(R) Gold 6342 CPU @ 2.80GHz	NVIDIA A10	31.09	"Rocky Linux 9.4 (Blue Onyx)"	0.5.7	deepseek-r1:14b	38.84
Linux	Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz	NVIDIA GeForce RTX 4070 SUPER	31.28	Ubuntu 22.04.2 LTS	0.5.7	deepseek-r1:14b	38.84
Linux	Intel(R) Xeon(R) Gold 6342 CPU @ 2.80GHz	NVIDIA A10	62.30	"Rocky Linux 9.4 (Blue Onyx)"	0.5.7	deepseek-r1:14b	38.74
Linux	Intel(R) Xeon(R) Gold 6342 CPU @ 2.80GHz	NVIDIA A10	62.30	"Rocky Linux 9.4 (Blue Onyx)"	0.5.7	deepseek-r1:14b	38.57
Linux	Intel(R) Xeon(R) Gold 6342 CPU @ 2.80GHz	NVIDIA A10	62.30	"Rocky Linux 9.4 (Blue Onyx)"	0.5.7	deepseek-r1:14b	38.47
Linux	Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz	NVIDIA GeForce RTX 4070 SUPER	31.28	Ubuntu 22.04.2 LTS	0.5.7	deepseek-r1:14b	37.84
Linux	AMD Ryzen 9 5950X 16-Core Processor	Navi 32 [Radeon RX 7700 XT / 7800 XT]	125.72	Linux Mint 22.1	0.5.11	deepseek-r1:14b	36.76
Linux	AMD Ryzen 9 5950X 16-Core Processor	Navi 32 [Radeon RX 7700 XT / 7800 XT]	125.72	Linux Mint 22.1	0.5.11	deepseek-r1:14b	36.68
Linux	AMD Ryzen 9 5950X 16-Core Processor	Navi 32 [Radeon RX 7700 XT / 7800 XT]	125.72	Linux Mint 22.1	0.5.7	deepseek-r1:14b	36.55
Linux	unknown	unknown	62.42	Ubuntu 24.04.2 LTS	0.5.7	deepseek-r1:14b	35.33
Linux	AMD Ryzen 7 3700X 8-Core Processor	NVIDIA GeForce RTX 3060 Ti NVIDIA GeForce RTX 3070	31.29	Pop!_OS 22.04 LTS	0.5.7	deepseek-r1:14b	35.12
Linux	unknown	unknown	62.42	Ubuntu 24.04.2 LTS	0.5.7	deepseek-r1:14b	35.07
Linux	unknown	unknown	62.42	Ubuntu 24.04.2 LTS	0.5.7	deepseek-r1:14b	34.97
Linux	AMD Ryzen 7 5700X 8-Core Processor	Navi 21 [Radeon RX 6800/6800 XT / 6900 XT]	31.26	Ubuntu 24.04.2 LTS	0.5.7	deepseek-r1:14b	34.9
Linux	unknown	unknown	62.42	Ubuntu 24.04.2 LTS	0.5.12	deepseek-r1:14b	34.69
Linux	unknown	unknown	62.42	Ubuntu 24.04.2 LTS	0.5.7	deepseek-r1:14b	34.47
Linux	12th Gen Intel(R) Core(TM) i9-12900K	NVIDIA RTX A4000	31.18	Ubuntu 24.04.1 LTS	0.5.7	deepseek-r1:14b	34.33
Linux	AMD Ryzen 7 3700X 8-Core Processor	NVIDIA GeForce RTX 3060 Ti NVIDIA GeForce RTX 3070	31.29	Pop!_OS 22.04 LTS	0.5.7	deepseek-r1:14b	34.29
Linux	AMD EPYC 7502 32-Core Processor	NVIDIA GeForce RTX 3090 NVIDIA GeForce RTX 3090	251.54	Ubuntu 24.04.2 LTS	0.5.13	deepseek-r1:14b	33.97
Linux	AMD Ryzen 5 9600X 6-Core Processor	NVIDIA GeForce RTX 3090	30.49	Arch Linux	0.5.7	deepseek-r1:14b	33.49
Linux	unknown	unknown	62.42	Ubuntu 24.04.2 LTS	0.5.7	deepseek-r1:14b	33.44
Linux	unknown	unknown	62.42	Ubuntu 24.04.2 LTS	0.5.11	deepseek-r1:14b	33.03
Linux	AMD Ryzen 9 7950X 16-Core Processor	NVIDIA GeForce RTX 3060 NVIDIA GeForce RTX 3060	124.95	Ubuntu 24.04.2 LTS	0.5.1	deepseek-r1:14b	32.88
Linux	AMD EPYC 7713P 64-Core Processor	NVIDIA RTX 4000 Ada Generation NVIDIA RTX 4000 Ada Generation NVIDIA RTX 4000 Ada Generation	251.59	Ubuntu 20.04.6 LTS	0.5.7	deepseek-r1:14b	32.68
Linux	AMD Ryzen 9 7950X 16-Core Processor	NVIDIA GeForce RTX 3060	124.95	Ubuntu 24.04.1 LTS	0.5.1	deepseek-r1:14b	32.63
Linux	AMD Ryzen 7 5700X 8-Core Processor	NVIDIA GeForce RTX 3080	78.45	Ubuntu 22.04.5 LTS	0.5.7	deepseek-r1:14b	32.24
Linux	AMD Ryzen 7 5700X 8-Core Processor	NVIDIA GeForce RTX 3080	78.45	Ubuntu 22.04.5 LTS	0.5.7	deepseek-r1:14b	32.17
Linux	AMD Ryzen 9 5950X 16-Core Processor	NVIDIA GeForce RTX 3060	62.70	Debian GNU/Linux 12 (bookworm)	0.3.9	deepseek-r1:14b	32.12
Linux	Intel(R) Xeon(R) w7-3445	NVIDIA RTX A4500 NVIDIA RTX 4000 Ada Generation NVIDIA RTX 4000 Ada Generation NVIDIA RTX 4000 Ada Generation	62.79	Debian GNU/Linux 12 (bookworm)	0.5.12	deepseek-r1:14b	32.07
Linux	AMD Ryzen 7 7700X 8-Core Processor	NVIDIA GeForce RTX 3060 NVIDIA GeForce RTX 3060	30.46	Ubuntu 24.04.2 LTS	0.5.12	deepseek-r1:14b	32.01
Linux	AMD Ryzen 7 5700G with Radeon Graphics	NVIDIA GeForce RTX 3060	30.64	Ubuntu 24.04 LTS	0.5.7	deepseek-r1:14b	31.75
Linux	AMD Ryzen 9 5950X 16-Core Processor	NVIDIA GeForce RTX 3060	62.70	Debian GNU/Linux 12 (bookworm)	0.5.7	deepseek-r1:14b	31.63
Linux	AMD Ryzen 9 5900X 12-Core Processor	Navi 21 [Radeon RX 6800/6800 XT / 6900 XT]	62.72	Arch Linux	0.5.7	deepseek-r1:14b	31.14
Linux	unknown	NVIDIA RTX 4000 Ada Generation	62.22	Ubuntu 24.04.2 LTS	0.5.12	deepseek-r1:14b	30.97
Linux	unknown	NVIDIA RTX 4000 Ada Generation	62.22	Ubuntu 24.04.2 LTS	0.5.12	deepseek-r1:14b	30.97
Linux	unknown	NVIDIA RTX 4000 Ada Generation	62.22	Ubuntu 24.04.2 LTS	0.5.12	deepseek-r1:14b	30.57
Linux	Intel Xeon E3-12xx v2 (Ivy Bridge)	NVIDIA RTX A4000	31.34	"Ubuntu 22.04.5 LTS"	0.5.7-0-ga420a45-dirty	deepseek-r1:14b	30.49
Linux	Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz	NVIDIA GeForce RTX 3060	15.56	Debian GNU/Linux 12 (bookworm)	0.5.7	deepseek-r1:14b	30.29
Linux	Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz	NVIDIA GeForce RTX 3060	15.56	Debian GNU/Linux 12 (bookworm)	0.5.7	deepseek-r1:14b	30.22
Linux	unknown	NVIDIA GeForce RTX 3060 NVIDIA GeForce RTX 3060 NVIDIA GeForce RTX 3060 NVIDIA GeForce RTX 3060	125.63	Ubuntu 24.04.1 LTS	0.5.7	deepseek-r1:14b	30.14
Linux	Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz	NVIDIA GeForce RTX 3060	15.56	Debian GNU/Linux 12 (bookworm)	0.5.7	deepseek-r1:14b	30
Linux	Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz	NVIDIA GeForce RTX 3060	15.56	Debian GNU/Linux 12 (bookworm)	0.5.7	deepseek-r1:14b	29.76
Linux	unknown	NVIDIA GeForce RTX 3060	15.51	Ubuntu 24.04.2 LTS	0.5.12	deepseek-r1:14b	29.16
Linux	Neoverse-V2	no_gpu	503.12	"Gentoo Linux"	0.0.0	deepseek-r1:14b	28.86
Linux	Neoverse-V2	no_gpu	503.12	"Gentoo Linux"	0.0.0	deepseek-r1:14b	28.64
Linux	Neoverse-V2	no_gpu	503.12	"Gentoo Linux"	0.0.0	deepseek-r1:14b	28.63
Linux	Neoverse-V2	no_gpu	503.12	"Gentoo Linux"	0.0.0	deepseek-r1:14b	28.62
Linux	Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz	NVIDIA GeForce RTX 3060 NVIDIA GeForce RTX 3070	15.56	Ubuntu 24.04.2 LTS	0.5.7	deepseek-r1:14b	28.54
Linux	Neoverse-V2	no_gpu	503.12	"Gentoo Linux"	0.0.0	deepseek-r1:14b	28.48
Linux	Neoverse-V2	no_gpu	503.12	"Gentoo Linux"	0.0.0	deepseek-r1:14b	28.41
Linux	Neoverse-V2	no_gpu	503.12	"Gentoo Linux"	0.0.0	deepseek-r1:14b	28.39
Linux	Neoverse-V2	no_gpu	503.12	"Gentoo Linux"	0.0.0	deepseek-r1:14b	28.37
Linux	Neoverse-V2	no_gpu	503.12	"Gentoo Linux"	0.0.0	deepseek-r1:14b	28.37
Linux	Neoverse-V2	no_gpu	503.12	"Gentoo Linux"	0.0.0	deepseek-r1:14b	28.3
Linux	AMD Ryzen 5 9600X 6-Core Processor	NVIDIA GeForce RTX 3060	30.47	Pop!_OS 22.04 LTS	0.5.10	deepseek-r1:14b	28.2
Linux	11th Gen Intel(R) Core(TM) i5-11600K @ 3.90GHz	NVIDIA GeForce RTX 3060 NVIDIA GeForce RTX 3060	62.66	Debian GNU/Linux 12 (bookworm)	0.5.7	deepseek-r1:14b	27.77
Linux	Neoverse-V2	no_gpu	494.82	"Gentoo Linux"	0.0.0	deepseek-r1:14b	27.52
Linux	Neoverse-V2	no_gpu	494.82	"Gentoo Linux"	0.0.0	deepseek-r1:14b	27.39
Linux	Neoverse-V2	no_gpu	494.82	"Gentoo Linux"	0.0.0	deepseek-r1:14b	27.25
Linux	AMD Ryzen 9 3900X 12-Core Processor	NVIDIA GeForce RTX 4060 Ti	62.71	Ubuntu 24.04.2 LTS	0.5.13	deepseek-r1:14b	26.82
Linux	13th Gen Intel(R) Core(TM) i5-13500	NVIDIA RTX 4000 SFF Ada Generation	62.60	Ubuntu 22.04.4 LTS	0.3.12	deepseek-r1:14b	26.47
Linux	13th Gen Intel(R) Core(TM) i5-13500	NVIDIA RTX 4000 SFF Ada Generation	62.35	"AlmaLinux 9.5 (Teal Serval)"	0.5.4	deepseek-r1:14b	25.46
Linux	AMD EPYC 7413 24-Core Processor	NVIDIA L4	47.04	Ubuntu 22.04.4 LTS	0.5.7-0-ga420a45-dirty	deepseek-r1:14b	24.97
Linux	AMD EPYC 7R13 Processor	NVIDIA L4	15.00	"Amazon Linux 2023.6.20250115"	0.5.7	deepseek-r1:14b	24.74
Linux	AMD EPYC 7R13 Processor	NVIDIA L4	30.15	"Amazon Linux 2023.6.20250115"	0.5.7	deepseek-r1:14b	24.55
Linux	AMD EPYC 7R13 Processor	NVIDIA L4	30.15	"Amazon Linux 2023.6.20250115"	0.5.7	deepseek-r1:14b	24.45
Linux	AMD EPYC 7R13 Processor	NVIDIA L4	30.15	"Amazon Linux 2023.6.20250115"	0.5.7	deepseek-r1:14b	24.44
Linux	AMD EPYC 7R13 Processor	NVIDIA L4	30.15	"Amazon Linux 2023.6.20250115"	0.5.7	deepseek-r1:14b	24.39
Linux	Intel(R) Core(TM) i5-6600 CPU @ 3.30GHz	NVIDIA GeForce GTX 1080 Ti NVIDIA GeForce GTX 1050	31.23	Ubuntu 24.10	0.5.7	deepseek-r1:14b	22.87
Linux	Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz	Tesla P40 Tesla P40	62.84	Debian GNU/Linux 12 (bookworm)	0.5.7	deepseek-r1:14b	21.11
Linux	Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz	Tesla P40 Tesla P40	62.84	Debian GNU/Linux 12 (bookworm)	0.5.7	deepseek-r1:14b	21.02
Linux	Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz	Tesla P40 Tesla P40	62.84	Debian GNU/Linux 12 (bookworm)	0.5.7	deepseek-r1:14b	20.93
Linux	Neoverse-V2	no_gpu	525.68	"Gentoo Linux"	0.0.0	deepseek-r1:14b	20.84
Linux	Neoverse-V2	no_gpu	525.68	"Gentoo Linux"	0.0.0	deepseek-r1:14b	20.8
Linux	Neoverse-V2	no_gpu	525.68	"Gentoo Linux"	0.0.0	deepseek-r1:14b	20.78
Linux	Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz	Tesla P40 Tesla P40	62.84	Debian GNU/Linux 12 (bookworm)	0.5.7	deepseek-r1:14b	20.77
Linux	Neoverse-V2	no_gpu	525.68	"Gentoo Linux"	0.0.0	deepseek-r1:14b	20.74
Linux	Neoverse-V2	no_gpu	525.68	"Gentoo Linux"	0.0.0	deepseek-r1:14b	20.57
Linux	AMD Ryzen 7 2700X Eight-Core Processor	NVIDIA GeForce RTX 3060	62.72	Linux Mint 21	0.5.7	deepseek-r1:14b	20.25
Linux	Intel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz	Tesla P40 Tesla P40	304.86	Ubuntu 22.04.5 LTS	0.5.11	deepseek-r1:14b	20.24
Linux	Intel(R) Core(TM) i5-8600K CPU @ 3.60GHz	NVIDIA GeForce GTX 1080 Ti	15.59	Ubuntu 24.04.1 LTS	0.5.12	deepseek-r1:14b	20.23
Linux	unknown	NVIDIA Corporation	525.68	"Debian GNU/Linux 12 (bookworm)"	0.5.11	deepseek-r1:14b	20.07
Linux	unknown	NVIDIA Corporation	525.68	"Debian GNU/Linux 12 (bookworm)"	0.5.11	deepseek-r1:14b	19.92
Linux	unknown	NVIDIA Corporation	525.68	"Debian GNU/Linux 12 (bookworm)"	0.5.11	deepseek-r1:14b	19.84
Linux	Intel(R) Xeon(R) CPU E5-2687W v4 @ 3.00GHz	Tesla P100-PCIE-16GB Tesla P100-PCIE-16GB Tesla P100-PCIE-16GB Tesla P100-PCIE-16GB	125.64	"CentOS Linux 7 (Core)"	0.3.8	deepseek-r1:14b	19.73
Linux	unknown	NVIDIA Corporation	525.68	"Debian GNU/Linux 12 (bookworm)"	0.5.11	deepseek-r1:14b	19.71
Linux	unknown	NVIDIA Corporation	525.68	"Debian GNU/Linux 12 (bookworm)"	0.5.11	deepseek-r1:14b	19.7
Linux	unknown	NVIDIA Corporation	525.68	"Debian GNU/Linux 12 (bookworm)"	0.5.11	deepseek-r1:14b	19.69
Linux	unknown	NVIDIA Corporation	525.68	"Debian GNU/Linux 12 (bookworm)"	0.5.11	deepseek-r1:14b	19.68
Linux	unknown	NVIDIA Corporation	525.68	"Debian GNU/Linux 12 (bookworm)"	0.5.11	deepseek-r1:14b	19.68
Linux	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Tesla T4	30.97	"Amazon Linux 2023.6.20250115"	0.5.7	deepseek-r1:14b	19.66
Linux	unknown	NVIDIA Corporation	525.68	"Debian GNU/Linux 12 (bookworm)"	0.5.11	deepseek-r1:14b	19.63
Linux	unknown	NVIDIA Corporation	525.68	"Debian GNU/Linux 12 (bookworm)"	0.5.11	deepseek-r1:14b	19.63
Linux	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Tesla T4	30.97	"Amazon Linux 2023.6.20250115"	0.5.7	deepseek-r1:14b	19.62
Linux	unknown	NVIDIA Corporation	525.68	"Debian GNU/Linux 12 (bookworm)"	0.5.11	deepseek-r1:14b	19.59
Linux	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Tesla T4	30.97	"Amazon Linux 2023.6.20250115"	0.5.7	deepseek-r1:14b	19.56
Linux	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Tesla T4	30.97	"Amazon Linux 2023.6.20250115"	0.5.7	deepseek-r1:14b	19.54
Linux	unknown	NVIDIA Corporation	525.68	"Debian GNU/Linux 12 (bookworm)"	0.5.11	deepseek-r1:14b	19.48
Linux	unknown	NVIDIA Corporation	525.68	"Debian GNU/Linux 12 (bookworm)"	0.5.11	deepseek-r1:14b	19.31
Linux	unknown	NVIDIA Corporation	525.68	"Debian GNU/Linux 12 (bookworm)"	0.5.11	deepseek-r1:14b	19.24
Linux	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Tesla T4	15.41	Ubuntu 22.04.4 LTS	0.5.7	deepseek-r1:14b	19.18
Linux	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Tesla T4	30.97	"Amazon Linux 2023.6.20250115"	0.5.7	deepseek-r1:14b	19.07
Linux	Neoverse-V2	NVIDIA GH200 480GB	525.68	"Gentoo Linux"	0.0.0	deepseek-r1:14b	19.05
Linux	Intel(R) Xeon(R) Gold 6154 CPU @ 3.00GHz	Tesla P40 Tesla P40 Tesla P40 Tesla P40 Tesla P40 Tesla P40	376.57	Ubuntu 22.04.5 LTS	0.5.12	deepseek-r1:14b	19.02
Linux	Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz	Tesla P40 Tesla P40	125.78	Ubuntu 24.04.1 LTS	0.5.4	deepseek-r1:14b	18.92
Linux	Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz	Tesla P100-PCIE-16GB Tesla P100-PCIE-16GB Tesla P100-PCIE-16GB Tesla P100-PCIE-16GB	62.88	Ubuntu 22.04.5 LTS	0.5.11	deepseek-r1:14b	18.45
Linux	Intel(R) Xeon(R) CPU E5-2640 v4 @ 2.40GHz	Tesla P40	125.78	Pop!_OS 22.04 LTS	0.5.12	deepseek-r1:14b	18.36
Linux	Neoverse-V2	NVIDIA GH200 480GB	525.68	"Gentoo Linux"	0.0.0	deepseek-r1:14b	17.99
Linux	Intel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz	NVIDIA GeForce GTX 980 Ti Quadro P5000	755.75	Ubuntu 24.04.2 LTS	0.5.12	deepseek-r1:14b	16.24
Linux	13th Gen Intel(R) Core(TM) i7-13700	Quadro P4000 Quadro P4000	31.12	Debian GNU/Linux 12 (bookworm)	0.5.7	deepseek-r1:14b	13.44
Linux	l3-cache2	Orin (nvgpu)	61.37	Ubuntu 22.04.5 LTS	0.5.11	deepseek-r1:14b	13.16
Linux	13th Gen Intel(R) Core(TM) i5-13600K	Raptor Lake-S GT1 [UHD Graphics 770]	62.32	"Red Hat Enterprise Linux 9.4 (Plow)"	0.5.7	deepseek-r1:14b	11.9
Linux	AMD Ryzen 7 5800X 8-Core Processor	NVIDIA GeForce RTX 3070	62.71	Ubuntu 24.04.2 LTS	0.5.7	deepseek-r1:14b	11.74
Linux	AMD EPYC 7443P 24-Core Processor	no_gpu	125.80	Debian GNU/Linux 12 (bookworm)	0.6.0	deepseek-r1:14b	11.39
Linux	Intel(R) Core(TM) i9-14900HX	NVIDIA GeForce RTX 4070 Laptop GPU	31.35	Ubuntu 22.04.5 LTS	0.4.7	deepseek-r1:14b	11.35
Linux	AMD Ryzen 7 3700X 8-Core Processor	NVIDIA GeForce RTX 2070 SUPER	62.74	Debian GNU/Linux 12 (bookworm)	0.5.7	deepseek-r1:14b	10.49
Linux	AMD Ryzen 9 5950X 16-Core Processor	no_gpu	125.72	Debian GNU/Linux 12 (bookworm)	0.5.11	deepseek-r1:14b	10
Linux	Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz	no_gpu	62.76	Debian GNU/Linux 12 (bookworm)	0.5.10	deepseek-r1:14b	9.96
Linux	AMD Ryzen 9 5950X 16-Core Processor	no_gpu	125.72	Debian GNU/Linux 12 (bookworm)	0.5.11	deepseek-r1:14b	9.74
Linux	Intel(R) Xeon(R) Gold 6342 CPU @ 2.80GHz	SVGA II Adapter	62.78	"Rocky Linux 9.3 (Blue Onyx)"	0.5.7	deepseek-r1:14b	9.19
Linux	Intel(R) Core(TM) i9-14900HX	NVIDIA GeForce RTX 4070 Laptop GPU	23.47	Ubuntu 22.04.5 LTS	0.5.7	deepseek-r1:14b	9.03
Linux	AMD EPYC 7543P 32-Core Processor	SVGA II Adapter	62.79	Ubuntu 22.04.3 LTS	0.4.7	deepseek-r1:14b	8.24
Linux	Intel(R) Xeon(R) Gold 6426Y	SVGA II Adapter	31.34	Ubuntu 24.04.2 LTS	0.5.13	deepseek-r1:14b	8.17
Linux	Intel(R) Xeon(R) Gold 5416S	bochs-drmdrmfb	62.71	Ubuntu 24.04.2 LTS	0.5.12	deepseek-r1:14b	8.08
Linux	unknown	NVIDIA GeForce RTX 2070	31.26	Arch Linux	0.5.13	deepseek-r1:14b	7.97
Linux	Intel(R) Core(TM) Ultra 7 265K	unknown	125.26	"Arch Linux"	0.5.13	deepseek-r1:14b	7.89
Linux	Intel(R) Core(TM) i9-14900HX	NVIDIA GeForce RTX 4070 Laptop GPU	23.47	Ubuntu 22.04.5 LTS	0.5.7	deepseek-r1:14b	7.62
Linux	Intel(R) Core(TM) Ultra 5 125H	no_gpu	30.49	Ubuntu 22.04.4 LTS	0.5.1-ipexllm-20250123	deepseek-r1:14b	7.48
Linux	AMD Ryzen 9 9950X3D 16-Core Processor	Advanced Micro Devices, Inc. [AMD/ATI]	60.44	Ubuntu 24.04.2 LTS	0.5.13	deepseek-r1:14b	7.43
Linux	13th Gen Intel(R) Core(TM) i7-13700	NVIDIA T1000 8GB	15.26	Ubuntu 24.04.1 LTS	0.5.11	deepseek-r1:14b	7.42
Linux	AMD Ryzen 7 5700G with Radeon Graphics	NVIDIA GeForce RTX 3060 Ti	15.56	Ubuntu 22.04.4 LTS	0.5.7	deepseek-r1:14b	7.27
Linux	AMD Ryzen 7 3700X 8-Core Processor	NVIDIA GeForce GTX 1070	31.24	Fedora Linux 41 (KDE Plasma)	0.5.13	deepseek-r1:14b	7.22
Linux	AMD Ryzen 9 7900X 12-Core Processor	Raphael	62.01	Ubuntu 24.04.1 LTS	0.5.7	deepseek-r1:14b	7.09
Linux	12th Gen Intel(R) Core(TM) i9-12900H	unknown	31.34	Ubuntu 24.04.2 LTS	0.5.13	deepseek-r1:14b	6.5
Linux	AMD Ryzen 7 7700X 8-Core Processor	no_gpu	27.07	Arch Linux	0.5.7	deepseek-r1:14b	6.48
Linux	AMD EPYC 9J14 96-Core Processor	bochs-drmdrmfb	188.19	"Oracle Linux Server 9.5"	0.5.13	deepseek-r1:14b	6.42
Linux	AMD Ryzen 9 7940HS w/ Radeon 780M Graphics	Phoenix1	46.85	Debian GNU/Linux 12 (bookworm)	0.5.7	deepseek-r1:14b	6.42
Linux	AMD Ryzen 7 5800X 8-Core Processor	NVIDIA GeForce RTX 3070	15.58	Ubuntu 22.04.5 LTS	0.5.7	deepseek-r1:14b	6.42
Linux	AMD Ryzen 9 7940HS w/ Radeon 780M Graphics	Phoenix1	46.85	Debian GNU/Linux 12 (bookworm)	0.5.13	deepseek-r1:14b	6.39
Linux	Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz	SVGA II Adapter	62.49	"Oracle Linux Server 8.10"	0.5.7	deepseek-r1:14b	6.32
Linux	Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz	NVIDIA GeForce RTX 2080 Ti Tesla T4 NVIDIA GeForce RTX 2080 Ti Tesla T4 Tesla T4 Tesla T4 NVIDIA GeForce RTX 2080 Ti NVIDIA GeForce RTX 2080 Ti	187.54	Ubuntu 24.04.2 LTS	0.5.12	deepseek-r1:14b	6.27
Linux	Intel(R) Xeon(R) Silver 4316 CPU @ 2.30GHz	ASPEED Graphics Family	3023.31	"Debian GNU/Linux 12 (bookworm)"	0.5.7	deepseek-r1:14b	6.2
Linux	AMD Ryzen 9 7900 12-Core Processor	Raphael	30.45	Manjaro Linux	0.5.7	deepseek-r1:14b	6.19
Linux	Intel(R) Xeon(R) Silver 4316 CPU @ 2.30GHz	ASPEED Graphics Family	3023.31	"Debian GNU/Linux 12 (bookworm)"	0.5.7	deepseek-r1:14b	6.17
Linux	12th Gen Intel(R) Core(TM) i9-12900K	Intel Corporation	31.09	Ubuntu 20.04.6 LTS	0.5.7	deepseek-r1:14b	5.98
Linux	Intel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHz	Tesla P4	15.62	Ubuntu 24.04 LTS	0.5.7	deepseek-r1:14b	5.89
Linux	13th Gen Intel(R) Core(TM) i9-13900HX	NVIDIA GeForce RTX 4070 Laptop GPU	62.46	Manjaro Linux	0.5.7	deepseek-r1:14b	5.83
Linux	Intel(R) Xeon(R) Gold 6346 CPU @ 3.10GHz	Integrated Matrox G200eW3 Graphics Controller	251.34	Ubuntu 24.04.1 LTS	0.5.7	deepseek-r1:14b	5.71
Linux	AMD Ryzen 7 7700X 8-Core Processor	Raphael	30.51	Ubuntu 24.04.1 LTS	0.5.7	deepseek-r1:14b	5.67
Linux	Intel(R) Xeon(R) Gold 6346 CPU @ 3.10GHz	Integrated Matrox G200eW3 Graphics Controller	251.34	Ubuntu 24.04.1 LTS	0.5.7	deepseek-r1:14b	5.51
Linux	13th Gen Intel(R) Core(TM) i9-13905H	NVIDIA GeForce RTX 4060 Laptop GPU	31.07	Fedora Linux 41 (KDE Plasma)	0.6.0	deepseek-r1:14b	5.47
Linux	unknown	NVIDIA GeForce RTX 2060	62.70	Debian GNU/Linux 12 (bookworm)	0.5.12	deepseek-r1:14b	5.16
Linux	Intel(R) Xeon(R) Gold 6150 CPU @ 2.70GHz	MGA G200eH3	755.53	Ubuntu 22.04.5 LTS	0.5.4	deepseek-r1:14b	5.11
Linux	Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz	Tesla P4	15.64	Ubuntu 24.04.2 LTS	0.5.11	deepseek-r1:14b	4.98
Linux	Intel(R) Core(TM) i7-7700 CPU @ 3.60GHz	NVIDIA GeForce RTX 2080	15.61	Ubuntu 24.04.2 LTS	0.6.0	deepseek-r1:14b	4.43
Linux	AMD Ryzen 7 7700X 8-Core Processor	NVIDIA GeForce RTX 3070	62.38	Ubuntu 22.04.5 LTS	0.5.4	deepseek-r1:14b	4.24
Linux	AMD Ryzen 7 2700 Eight-Core Processor	NVIDIA GeForce GTX 1060 6GB NVIDIA GeForce GT 1030	31.25	"NixOS 24.11 (Vicuna)"	0.3.12	deepseek-r1:14b	4.16
Linux	Intel(R) Core(TM) i7-8700 CPU @ 3.20GHz	NVIDIA GeForce GTX 1650	62.74	Debian GNU/Linux 12 (bookworm)	0.5.11	deepseek-r1:14b	4.01
Linux	AMD Ryzen 7 PRO 4750G with Radeon Graphics	Renoir [Radeon Vega Series / Radeon Vega Mobile Series]	46.91	Ubuntu 24.04.1 LTS	0.5.4	deepseek-r1:14b	3.97
Linux	AMD Ryzen 9 5950X 16-Core Processor	no_gpu	62.76	Debian GNU/Linux 12 (bookworm)	0.6.0	deepseek-r1:14b	3.85
Linux	AMD Ryzen 7 5700G with Radeon Graphics	NVIDIA GeForce RTX 3050	62.66	Ubuntu 24.04.2 LTS	0.5.7	deepseek-r1:14b	3.81
Linux	AMD Ryzen 7 PRO 4750G with Radeon Graphics	Renoir [Radeon Vega Series / Radeon Vega Mobile Series]	46.91	Ubuntu 24.04.1 LTS	0.5.10	deepseek-r1:14b	3.7
Linux	Intel(R) Xeon(R) E-2236 CPU @ 3.40GHz	NVIDIA T600	30.99	"Red Hat Enterprise Linux 9.5 (Plow)"	0.5.10	deepseek-r1:14b	3.48
Linux	Intel(R) Xeon(R) E-2136 CPU @ 3.30GHz	no_gpu	62.71	Debian GNU/Linux 12 (bookworm)	0.5.9	deepseek-r1:14b	3.45
Linux	Intel(R) Core(TM) i5-8500T CPU @ 2.10GHz	CoffeeLake-S GT2 [UHD Graphics 630]	31.22	Ubuntu 24.10	0.5.7	deepseek-r1:14b	3.12
Linux	AMD Ryzen 5 3600 6-Core Processor	NVIDIA GeForce GT 1030	60.72	Ubuntu 24.10	0.5.4	deepseek-r1:14b	2.92
Linux	11th Gen Intel(R) Core(TM) i7-1185G7 @ 3.00GHz	TigerLake-LP GT2 [Iris Xe Graphics]	15.33	Ubuntu 24.10	0.5.7	deepseek-r1:14b	2.82
Linux	Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz	HD Graphics 530	31.23	Ubuntu 20.04.6 LTS	0.5.11	deepseek-r1:14b	2.8
Linux	Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz	HD Graphics 530	31.23	Ubuntu 20.04.6 LTS	0.5.11	deepseek-r1:14b	2.8
Linux	Intel(R) Xeon(R) Gold 6138 CPU @ 2.00GHz	no_gpu	32.00	"Debian GNU/Linux 12 (bookworm)"	0.5.7	deepseek-r1:14b	2.46
Linux	Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz	no_gpu	314.78	Debian GNU/Linux 12 (bookworm)	0.3.14	deepseek-r1:14b	2.05
Linux	Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz	Tesla P4	15.62	Ubuntu 24.04.1 LTS	0.5.7	deepseek-r1:14b	1.82
Linux	AMD EPYC 3151 4-Core Processor	NVIDIA GeForce RTX 2080 SUPER	56.89	Ubuntu 24.04.1 LTS	0.5.7	deepseek-r1:14b	1.8
Linux	Intel(R) Xeon(R) CPU E5-4640 0 @ 2.40GHz	G200eR2	188.79	Ubuntu 24.04.2 LTS	0.5.7	deepseek-r1:14b	1.72
Linux	Intel(R) Xeon(R) CPU E5-4640 0 @ 2.40GHz	G200eR2	188.79	Ubuntu 24.04.2 LTS	0.5.7	deepseek-r1:14b	1.64
Linux	QEMU Virtual CPU version 2.5+	no_gpu	31.34	Debian GNU/Linux 12 (bookworm)	0.5.7	deepseek-r1:14b	0.55
Linux	Intel(R) Xeon(R) CPU E5540 @ 2.53GHz	no_gpu	188.87	Ubuntu 22.04.5 LTS	0.5.7	deepseek-r1:14b	0.14