Skip to content

docs: sweep em/en dashes in README and LLM_PROVIDERS, add reranker-eval note - #172

Open
Coding-Dev-Tools wants to merge 4 commits into
mainfrom
ship/pr2-docs
Open

docs: sweep em/en dashes in README and LLM_PROVIDERS, add reranker-eval note#172
Coding-Dev-Tools wants to merge 4 commits into
mainfrom
ship/pr2-docs

Conversation

@Coding-Dev-Tools

Copy link
Copy Markdown
Owner

docs: sweep em/en dashes in README and LLM_PROVIDERS, add reranker-eval note

  • README.md: replace two en-dashes in the env-var table with -- so the public-doc
    em-dash gate passes; add a brief evaluation note for the cross-encoder reranker
    knob (now reachable via MemoryEngine.create(rerank_model=...)) and document the
    measured ~15ms per-query cost on the bundled retrieval gates
  • docs/LLM_PROVIDERS.md: replace one em-dash in the Windows note with --

These are the only doc changes shipped in this round; the rest of the work is in
PR1 (core + MCP + integration).

…al note

- README.md: replace two en-dashes in the env-var table with `--` so the public-doc
  em-dash gate passes; add a brief evaluation note for the cross-encoder reranker
  knob (now reachable via MemoryEngine.create(rerank_model=...)) and document the
  measured ~15ms per-query cost on the bundled retrieval gates
- docs/LLM_PROVIDERS.md: replace one em-dash in the Windows note with `--`

These are the only doc changes shipped in this round; the rest of the work is in
PR1 (core + MCP + integration).

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: f25fc87d47

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread README.md Outdated
@Coding-Dev-Tools

Copy link
Copy Markdown
Owner Author

Review pass 2

Re-read both diffs in the worktree. PR2 is small, targeted, and ships cleanly: the em-dash sweep in docs/LLM_PROVIDERS.md and README.md is complete, and the new Windows cmd/cmd.exe PATH note in LLM_PROVIDERS.md is exactly the kind of operational gotcha that would otherwise eat a user's first hour. Two observations:

1. The reranker-eval note lands in a quiet section

The reranker-eval paragraph was added to the README env-var table area. That's correct content, but it sits in a section titled by the table above it. Consider giving it a subheading (### Optional cross-encoder reranker) or moving it under the headline Evaluated offline heading higher up, so a reader skimming the README doesn't miss it. This is a one-line edit.

2. The CHANGELOG cross-link is missing

PR1 adds the cross-encoder reranker to the [Unreleased] Added section. The README now describes the same feature. There's no cross-link, so a reader hunting the rationale or evaluation numbers has to read both files. The README paragraph could close with a one-liner like "(see CHANGELOG.md for the full eval methodology and offline gates)" — minor, but cheap.

What's good

  • Both em-dash replacements (the long-env-var-table entries and the new Windows note) are consistent (-- with spaces around it; not the em-dash, not the LaTeX --).
  • The new Windows cmd/cmd.exe note is precise: it names the symptom ("opens a Windows command-prompt window or prints 'mcp' is not recognized") and gives the diagnosis command (where cmd) plus the workaround (reorder PATH, or invoke by absolute path). That's exactly the right level of detail.
  • The 17/2 lines of change are all in two files; no scope creep.
  • The README paragraph is honest about the cost (~15 ms/query mean) which is the kind of detail users need to make a config decision.

Approve

  • Optional: subheading the reranker paragraph in README.
  • Optional: cross-link CHANGELOG from the README paragraph.

A note on what the changes do for Command Code usage

Neither file in PR2 directly changes Command Code behavior, but the Windows cmd note closes a real failure mode where cmd mcp add silently fails or runs the wrong binary — a class of issue that has historically bitten users. The reranker note is a pointer for users who want to opt into the precision upgrade.

…inter

The previous paragraph quoted model-specific MRR@5 / hit@5 / ~15 ms numbers
for the optional cross-encoder reranker without identifying the model,
revision, hardware, exact command, or evidence artifact. Per AGENTS.md
L177-L178 ("Prove 'better' with a number. No retrieval/quality claim ships
without an eval."), such numbers must not ship until the evidence is
registered.

The README now contains a short note that reranker benchmarks are
intentionally unpublished and points operators at the local reproduction
commands (`python -m eval.ablation`, `python -m eval.reinforcement`).

Co-authored-by: CommandCodeBot <noreply@commandcode.ai>

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 32195d1ff2

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread README.md Outdated
PR #172 introduced a single em-dash on README.md:751 inside the new
reranker-eval blockquote. The repo's no-em-dashes-in-public-docs policy
(tests/test_benchmark_evidence.py::test_public_facing_docs_do_not_use_em_dashes)
blocks on every Python matrix plus the core floor and coverage gate jobs.
Replace U+2014 with --, mirroring the convention used elsewhere in the
same blockquote.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant