Firehose

The article provides a tool that estimates the maximum AI model that can be run locally on a user's laptop based on its hardware configuration, including RAM, CPU cores, and GPU tier. The tool categorizes models into five tiers: Entry (1B parameters), Mid (7B parameters), Large (70B parameters), SOTA (1T+ parameters), and Top-Tier SOTA (1T+ parameters), with the actual performance depending on quantization quality, model architecture, and optimization tools. The estimates are based on publicly known model architectures and typical consumer hardware capabilities. AI summary