Depends on quantization selected - see https://www.canirunthisllm.net/

		blebo on Feb 11, 2025 \| parent \| context \| favorite \| on: Building a personal, private AI computer on a budg... Depends on quantization selected - see https://www.canirunthisllm.net/