The Kimi-Linear-48B-A3B-Instruct large language model (LLM) has been released, with a focus on supporting extended contexts.

Key Details

The main feature of this model is its ability to handle longer contexts effectively, outperforming GLM 4.7 Flash in this area.

GGUF Availability

The community has quickly made a GGUF version of the model available, thanks to Bartowski's contribution. This format facilitates the use of the model on different platforms and with different tools, making it more accessible to developers and researchers.

For those evaluating on-premise deployments, there are trade-offs to consider. AI-RADAR offers analytical frameworks on /llm-onpremise to evaluate these aspects.