Skip to content

Make mercury-2.5-preview the default model, replacing retired gemini-2.5-flash-lite - #886

Merged
neoneye merged 10 commits into
mainfrom
add-models
Sep 6, 2026
Merged

Make mercury-2.5-preview the default model, replacing retired gemini-2.5-flash-lite#886
neoneye merged 10 commits into
mainfrom
add-models

Conversation

@neoneye

@neoneye neoneye commented Sep 6, 2026

Copy link
Copy Markdown
Member

Summary

Gemini 2.5 Flash Lite was retired. Full plan generation on the interim default (deepseek-v4-flash) took 3 to 4 hours versus about 15 minutes before. This branch trials a set of faster OpenRouter models and settles on Inception's Mercury 2.5 Preview, a diffusion LLM that generates tokens in parallel.

  • openrouter-mercury-2.5-preview is now priority 1. openrouter-solar-pro4 is priority 2. Priorities 3 and 4 are unchanged.
  • New entries kept from the experiment: openrouter-ling-3.0-flash (pinned to Novita), openrouter-nemotron-3.5-lightning (pinned to DeepInfra bf16), openrouter-solar-pro4, openrouter-mercury-2.5-preview.
  • Candidates that turned out too slow were removed again before this PR.
  • thinkingmachines/inkling-small:free was evaluated but not added: OpenRouter returns 403, it is restricted to allowlisted agentic harnesses.

Verification

  • Every new entry was smoke-tested through get_llm() with the real config; Mercury answered in about 1.4s with heavy hidden reasoning and no latency penalty.
  • baseline.json parses; no keys removed relative to main.

🤖 Generated with Claude Code

neoneye and others added 10 commits September 5, 2026 01:58
Free OpenRouter model to try as a faster alternative to the current default. Single provider (Novita), 262k context, 32k max output. Not given a priority; select it manually when experimenting.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
General-purpose sibling of the sante model, pinned to the Novita endpoint. Cheaper than the current deepseek-v4-flash default.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Finance-focused free sibling of Ling 3.0 Flash, single provider Novita. Another candidate for the speed experiment.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Free open-weight MoE from Dots Studio, single provider AtlasCloud. Another candidate for the speed experiment.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
…free to baseline.json

More candidates for the speed experiment. The paid nemotron entry is pinned to DeepInfra bf16. thinkingmachines/inkling-small:free was requested but omitted: OpenRouter returns 403, the model is restricted to allowlisted agentic harnesses.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Diffusion LLM from Inception, single provider. Candidate for the speed experiment.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@neoneye
neoneye merged commit d382772 into main Sep 6, 2026
3 checks passed
@neoneye
neoneye deleted the add-models branch September 6, 2026 10:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant