Llama 3.1 8B

Great balance of speed and quality. Recommended starting point.

Available quantizations

Check whether your machine can run this model — with real measured speeds from anonymous community benchmarks — on the Central-Intel compatibility page.