edge ai
|
Arduino's 16 GB VENTUNO Q Runs a 744-Billion-Parameter AI Model From an SSD, and It Took 7 Minutes to Name Three Planets Large language models with hundreds of billions of parameters normally live in data centres, on servers with far more memory than any single-board computer. So it is a surprise to see one answer a question on an Arduino. In a project published on Arduino Project Hub, Jim Bruges ran GLM-5.3, a 744-billion-parameter model whose files take up about 419 GB, on an Arduino VENTUNO Q with just 16 GB… |
