Skip to content
CI

Multi-threaded GGUF matmul: 35B 0.4→3.0 tok/s (7.5x), byte-identical … #101

Sign in to view logs

Multi-threaded GGUF matmul: 35B 0.4→3.0 tok/s (7.5x), byte-identical …

Multi-threaded GGUF matmul: 35B 0.4→3.0 tok/s (7.5x), byte-identical … #101

Run time

Learn about OS pricing on GitHub Actions
Job Run time
macos-latest (arm64)
1m 3s
ubuntu-latest (x86_64)
38s
1m 41s