A 27-billion-parameter model finally fits in a phone

PrismML's Bonsai 27B model fits on an iPhone thanks to extreme compression. A major breakthrough for running local agents at no cost.