In this video we take a look at the performance of Ollama running various models on a Surface Pro with Snapdragon X Elite processor. We compare its throughput to our prior Dell R250 w/Nvidia RTX A1000 and M4 Mac Mini results.

All of our benchmarks were run against the SnapDragon CPU.
As models and support to run them on the NPU becomes more available, we’ll return to run those on the system.

Windows Ollama Benchmark
https://github.com/savoirtech/windows-ollama-benchmark

Chapters:
0:00 Introduction
0:13 Hardware Review
0:24 Benchmarking
3:32 Results

Music:
Solicious – Dyalla
Never Play – Jeremy Blake
QuangerineCream – Noir Et Blanc Vie
The Bone Train – Slynk

Please take the opportunity to connect and share this video with your friends and family if you find it useful.