Llmspeed

If you want to run a large language model on your own machine, Llmspeed lets you check the speed before you buy: pick the hardware and the model, and the answer streams out at the predicted rate, including the wait before the first token. It's an open-source web tool by the GitHub user nicorobinreal. The tool doesn't run any model; every speed is a prediction, labeled by where it comes from. Measured means benchmarked on that exact hardware, model and quantization; Derived is interpolated from similar setups; Projected is calculated from hardware specs, for example for hardware that isn't out yet. You can also race two setups side by side, check whether a model fits in memory at a given quantization, and make a share link. The README says the benchmarks come from r/LocalLLaMA, localscore.ai, llama.cpp discussions and community contributions.

Who it's for:anyone planning to buy a GPU, a Mac or a new build to run local LLMs.

Before you start: open it in a browser. No install, sign-in or payment. The interface is in English. The README calls the results estimates, not guarantees, and says drivers, engine versions, power limits and thermals can move real speeds by 10 to 30 percent. Multi-GPU setups aren't simulated yet. The site is static, and the README says nothing about privacy or analytics. The code is under the MIT license.

Based on the project's public documentation. Not tested by AI Inspiration World.