Local LLM and vLLM: Automating Changes Without Losing Control
A self-hosted user describes asking a local LLM to change vLLM settings to cut idle power draw with CUDA_DISABLE_PERF_BOOST=1. The moment highlights both the promise and risk of operational automation: real energy savings, but also the need for guard...