Hugging Face's OpenEnv proxy turns Claude Code, Codex, and OpenCode into RL training environments
An open-source capture proxy sits between an unmodified harness and vLLM, speaks the OpenAI, Anthropic, and Gemini API formats, and records exact token IDs and logprobs so TRL can train on real agent runs; 10 harnesses work today. Training Liquid AI's LFM2.5-2.6B across four harnesses lifted its average solve rate from 42% to 54% (Claude Code 33% to 49%), and the proxy, trainer, tasks, and all seven checkpoints are open.
