Version 0.4.0 of LM Studio, a local development environment for large language models (LLM), is now available.

What's New

The update introduces changes to the user interface (UI), moving the runtime settings within the developer options. To access them, you need to enable developer mode in the application settings.

Parallelism Tests

A user tested the parallelism settings, varying the values from 2 to 40, without finding significant changes in performance. The unified KV cache is enabled by default and appears to be working correctly.

For those evaluating on-premise deployments, there are trade-offs to consider carefully. AI-RADAR offers analytical frameworks on /llm-onpremise to evaluate these aspects.