Performance varied significantly, with the MacBook Air M3 achieving the fastest speed (72 tokens/second), followed by the ...
This first article in a series explains the core AI concepts behind running LLM and RAG workloads on a Raspberry Pi, including why local AI is useful and what tradeoffs to expect.