Microsoft has developed a super-efficient AI model that can run on CPUs.
Microsoft Develops an Ultra-Efficient AI Model That Can Run on CPUs
via cnBeta.COM Chinese Industry News Site - Telegram Channel
Telegraph
Microsoft Develops an Ultra-Efficient AI Model That Can Run on CPUsMicrosoft has developed an ultra-efficient AI model Bitnets that can run on CPUs. Essentially, Bitnets are compressed models designed to run on lightweight hardware. In standard models, weights (values that define the internal structure of the model) are usually quantized so that the model can perform well on various machines. Quantizing weights can reduce the number of bits (the smallest unit that a computer can process) required to represent these weights, enabling the model to run faster on chips with less memory. Bitnets quantize weights into three values: -1, 0, and 1. Theoretically, this makes them more memory and computationally efficient than most models today. Microsoft researchers said that BitNet b1.58 2B4T is the first to have 2 billion parameters and is more...
