BackOpen source
Open source2026Author

InfrenceX CLI

Agentic terminal over a decentralized model market

A terminal coding agent that routes each task to whichever provider is cheapest and available, and fails over without losing the conversation.

Problem

Provider choice is usually a config value set once and forgotten, which means paying list price for work that a cheaper model would have done identically, and losing the session when that provider has an outage.

Failover is the harder half. Switching provider mid-task is only useful if the conversation survives the switch.

What I built

A terminal agent whose routing layer is the point.

  • Ink TUI with live token and cost tracking, and subagent monitoring
  • Automatic provider failover preserving conversation history
  • Dynamic routing against the InfrenceX market with seller availability monitoring
  • Five role-aware personas and a plan-first mode requiring approval before changes
  • Plugin framework for Skills and ESM/Claude-format plugins, plus an IDE JSON-RPC bridge

Limitations and failure modes

  • Routing quality depends on the market's availability signals; a provider that is listed but degraded still has to be discovered by failing.

Gallery

The project's own render of the TUI, cost and model shown in the status line, which is the part that makes routing decisions visible
The project's own render of the TUI, cost and model shown in the status line, which is the part that makes routing decisions visible

Attribution

Built by me
The CLI, routing, failover and plugin framework.

Related

  • Continuum

    Open-source memory for AI coding agents