vibehacker
News
GitHub / vllm-project releases ·

vLLM 0.31.0 adds `vllm preload` for fast restarts and locks down per-request multimodal kwargs

The Oct 5 release adds vllm preload, a daemon that keeps post-quantized weights resident in GPU memory so engine restarts skip reloading, plus a big DeepSeek-V4.1-Flash speed pass on Blackwell (SM100). Check your configs before upgrading: per-request mm_processor_kwargs and media_io_kwargs are now rejected unless you pass --trust-request-mm-kwargs, tokenizer_mode="slow" is gone, and online quantization="fp8" becomes fp8_per_tensor.

More news

View all

GitLab adds `/goal` flows that run a change end to end, plus hosted GLM 5.3 and Kimi K3

Announced Oct 6 at Transcend, goal driven flows (GA this month) take an objective from the Duo CLI, headless mode, or Agentic Chat and carry it through review, tests, security scans, and approvals, while GitLab hosted GLM 5.3, Kimi K3, and MiniMax 3 are GA now with up to 8x more model calls per credit than frontier pairings. The MCP Server for outside coding agents also goes GA this month, and new credit caps can auto pause AI spend at a limit you set…

GitLab Blog

Codex Day 2: Auto-review is now free for every ChatGPT sign-in and no longer uses plan quota

Turn it on under Settings → Permissions → Auto review (or approvals reviewer = "auto review" with approval policy = "on request" in config.toml ), and a second agent answers your agent's sandbox escalation requests, blocking high risk or off request actions instead of pinging you for every approval. It only reviews actions that already needed approval and doesn't widen the sandbox, but it's still a model that can be fooled, so keep your real limits in place…

Agentonia is a live MCP world where AI agents hold jobs, vote, and start families while humans watch

Launched Oct 6 by an indie developer, the persistent world lets agents join over MCP ( claude mcp add transport http agentonia https://mcp.agentonia.com ) or REST to work, trade, start companies, run for office, and pass laws across four regions with different governments, with founder slots capped at 100. Spectators can read every agent's private messages and reasoning, so don't send in an agent that has access to anything you'd mind leaking…

Agentonia

Anaconda MCP goes GA as a remote, read-only server for package facts and vulnerabilities

The server at https://anaconda.com/api/mcp now runs remotely and only returns data, giving Claude Code, Cursor, Codex, Kilo, and other remote MCP clients package info and forum search on any Anaconda account, with package security and org policy tools on Business and Enterprise tiers. Unlike the beta it can't install or change anything on your machine, so your agent still runs conda itself under your own permission settings…

Anaconda Blog

Spotted something we missed? Start a thread.