The next age of LLMs? Dev gets a small LLM running at 10 tokens a second locally on a $10 microcontroller

TechRadar
Aug 7, 2026, 3:35 pm206 ptsTrendingTop
A developer has a 28.9-million-parameter model generating TinyStories-style text at 9.88 tokens per second, fully offline, on a $10 microcontroller It was achieved by fitting a language model on a chip with 512KB of RAM by leaving most of it in flash storage The project is available on GitHub under an MIT…

Read Article Share
Share Article
- email
- x.com
- facebook
- pocket
- reddit
- tumblr
- linkedin
- pinterest

Trending Today on Tech News Tube

Kia’s larger electric van caught with less camo ahead of its ‘big’ debut [Images]

Electrek

Kia’s larger electric van caught with less camo ahead of its ‘big’ debut [Images] 130

Nokia's NXP Arizona fab buy signals AI optical bottleneck shifting upstream

Digitimes

Nokia's NXP Arizona fab buy signals AI optical bottleneck shifting upstream 128

The Chinese Philosopher Americans Can’t Stop Fighting About

Wired

The Chinese Philosopher Americans Can’t Stop Fighting About 127

‘The Legend of Zelda’ May Be Sam Neill’s Final Movie

Gizmodo

‘The Legend of Zelda’ May Be Sam Neill’s Final Movie 126

'Asimov Was Right' About Rules For Robots, Says Ex-US Cyber Director

Slashdot

'Asimov Was Right' About Rules For Robots, Says Ex-US Cyber Director 126

Russia is kickstarting its plans to dominate the space race once again — but it will have to depend on Chinese hardware to do so

TechRadar

Russia is kickstarting its plans to dominate the space race once again — but it will have to depend on Chinese hardware to do so 126

‘The Odyssey’ Will Soon Be Christopher Nolan’s Highest-Grossing Film

Gizmodo

‘The Odyssey’ Will Soon Be Christopher Nolan’s Highest-Grossing Film 125

TSMC, ASE, WPG: the white-knight battles that built Taiwan's chip empire

Digitimes

TSMC, ASE, WPG: the white-knight battles that built Taiwan's chip empire 120

About Tech News Tube

Tech News Tube is a real time news feed of the latest technology news headlines.

Follow all of the top tech sites in one place, on the web or your mobile device.

Featured

Pentagon signs $500 million deal for…

Pentagon signs $500 million deal for unmanned counter-drone missile systems…

Quote of the day by US President Dwight…

Quote of the day by US President Dwight D Eisenhower: 'Public policy could…

I've rounded up the best Samsung Galaxy…

I've rounded up the best Samsung Galaxy Z Fold 8 cases to keep your…

OpenAI Delays Next Major AI Model 'Astra' Over Critical Hacking Concerns

Could this be the end of BIOS-locked…

Could this be the end of BIOS-locked laptops? AI tweaker deploys Claude to…

WhatsApp scam costs Hong Kong man $1.27…

WhatsApp scam costs Hong Kong man $1.27 million after criminals used AI voice…

'I wasn’t driving. I had Autopilot…

'I wasn’t driving. I had Autopilot on': Tesla’s Full Self-Driving system is…

Flock Reportedly Tried to Turn Uber…

Flock Reportedly Tried to Turn Uber Drivers Into Mobile Snitches

Our top-rated business PC is a…

Our top-rated business PC is a multitasking powerhouse — save $530 on the Dell…

Water system controllers don't belong on…

Water system controllers don't belong on the internet, says ex-NSA chief after…