OVH launches Olala Mini 7A1B: an open-source LLM that runs on 8 GB of VRAM
OVH has unveiled Olala Mini, an open-source LLM with 7 billion parameters and 1 billion active, capable of running on an 8 GB GPU and even on CPU. Built on a sparse mixture-of-experts architecture with hybrid attention, it reaches 160 tokens/s on an ...