@cloudflare/codemode v0.1.0: a new runtime agnostic modular architecture

The @cloudflare/codemode package has been rewritten into a modular, runtime-agnostic SDK.

Code Mode enables LLMs to write and execute code that orchestrates your tools, instead of calling them one at a time. This can (and does) yield significant token savings, reduces context window pressure and improves overall model performance on a task.

The new Executor interface is runtime agnostic and comes with a prebuilt DynamicWorkerExecutor to run generated code in a Dynamic Worker Loader.

Breaking changes

• Removed experimental_codemode() and CodeModeProxy — the package no longer owns an LLM call or model choice
• New import path: createCodeTool() is now exported from @cloudflare/codemode/ai

New features

• createCodeTool() — Returns a standard AI SDK Tool to use in your AI agents.
• Executor interface — Minimal execute(code, fns) contract. Implement for any code sandboxing primitive or runtime.

DynamicWorkerExecutor

Runs code in a Dynamic Worker. It comes with the following features:

• Network isolation — fetch() and connect() blocked by default (globalOutbound: null) when using DynamicWorkerExecutor
• Console capture — console.log/warn/error captured and returned in ExecuteResult.logs
• Execution timeout — Configurable via timeout option (default 30s)

Usage

import { createCodeTool } from "@cloudflare/codemode/ai"; import { DynamicWorkerExecutor } from "@cloudflare/codemode"; import { streamText } from "ai"; const executor = new DynamicWorkerExecutor({ loader: env.LOADER }); const codemode = createCodeTool({ tools: myTools, executor }); const result = streamText({ model, tools: { codemode }, messages, });

import { createCodeTool } from "@cloudflare/codemode/ai"; import { DynamicWorkerExecutor } from "@cloudflare/codemode"; import { streamText } from "ai"; const executor = new DynamicWorkerExecutor({ loader: env.LOADER }); const codemode = createCodeTool({ tools: myTools, executor }); const result = streamText({ model, tools: { codemode }, messages, });

Wrangler configuration

{ "worker_loaders": [{ "binding": "LOADER" }], }

[[worker_loaders]] binding = "LOADER"

See the Code Mode documentation for full API reference and examples.

Upgrade

npm i @cloudflare/codemode@latest