local llms
|
Running 260K Tiny-LLM on ESP32 We are all facing a huge transition in tech due to AI. In projects, we can run AI models on PCs, SBCs or even Cloud servers. In this tutorial, we are trying to see if we can run an AI model on a microcontroller board like the ESP32. To test this out, we are going to deploy and benchmark the 260K-parameter Tiny-LLM by Andrej Karpathy using his open-source llama2.c… |
|
ESP32-Based AI Pet Gets Sick If You Doomscroll, While Android Handles Local LLMs, STT, and TTS Offline Maker and Youtuber, Brenpoly recently built an offline AI virtual pet that lives on an ESP32 and “gets sick” when you doomscroll too much, turning screen-time guilt into a tangible, hardware-based consequence. The project makes use of the 1.8 inch touch screen display and sensors that come integrated with the Waveshare ESP32-S3 based module to create a companion that reacts to your phone usage… |
