terminal
howtonotcode.com
topic Topic
Appeared in 1 digest

LocalAI 3.9.0 adds Agent Jobs and smarter GPU memory management

calendar_today First seen: 2025-12-26
update Last updated: 2025-12-26

Overview

LocalAI 3.9.0 introduces an Agent Jobs panel and API to schedule background agent tasks (cron, webhooks, MCP) and adds a Smart Memory Reclaimer with LRU model eviction to prevent OOM by auto-unloading unused models. It also adds MLX and CUDA 13 support, improving compatibility across Apple Silicon and newer NVIDIA stacks. The release focuses on stability and resource efficiency for local multi-model orchestration.

Story Timeline

LocalAI 3.9.0 adds Agent Jobs and smarter GPU memory management

LocalAI 3.9.0 introduces an Agent Jobs panel and API to schedule background agent tasks (cron, webhooks, MCP) and adds a Smart Memory Reclaimer with LRU model eviction to prevent OOM by auto-unloading unused models. It also adds MLX and CUDA 13 support, improving compatibility across Apple Silicon and newer NVIDIA stacks. The release focuses on stability and resource efficiency for local multi-model orchestration.

article 2025-12-26 2025-12-26 08:47