Skip to content

Add Phase 2 language-pipeline study documents (tokenizer, parser, AST, semantic analysis, compiler, tiering) - #8

Merged
FredRavandi merged 5 commits into
mainfrom
claude/powershell-repo-history-i93gx6
Nov 3, 2026
Merged

Add Phase 2 language-pipeline study documents (tokenizer, parser, AST, semantic analysis, compiler, tiering)#8
FredRavandi merged 5 commits into
mainfrom
claude/powershell-repo-history-i93gx6

Conversation

@FredRavandi

@FredRavandi FredRavandi commented Nov 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Collaborator

PR Summary

Adds the Phase 2 wave-1 documents of the static PowerShell v7.6.9 architecture study under docs-out/:

  • T21 tokenizer: 02.1-tokenizer.md, TOKEN-CATALOG.md.
  • T22 parser: 02.2-parser.md, GRAMMAR.ebnf.md, ERROR-CATALOG.md.
  • T23 AST: 02.3-ast.md, AST-CATALOG.md.
  • T24 semantic analysis: 02.4-semantic-analysis.md (133 check sites, 104 error IDs, generated).
  • T25 compiler and engine: 02.5-compiler-and-engine.md, COMPILATION-MAP.md (63 Visit* methods), IR-SPEC.md.
  • T27 interpreter and tiering: INSTRUCTION-SET.md (183 classes), TIERING-POLICY.md (owns CF-CMP-001/002/003), EQUIVALENCE-SPEC.md.
  • Generators and helpers in docs-out/tools/ (gen_T21, gen_T22, gen_T23, gen_T24, gen_T25, gen_T27, expand_refs) so catalogs are rendered from docs-out/data/, not typed.
  • Registers: canonical facts CF-LEX-001/002, CF-GRM-001, CF-ERR-002, CF-CMP-001/002/003; deviations DEV-LEX-001, DEV-GRM-010, DEV-AST-020, DEV-SEM-030, DEV-ENG-040, DEV-TIER-060, DEV-EQV-061; contradictions CON-002..010; backlog VB-002..016; decisions D-012..D-018; PROGRESS.md.

No source, test or build file is changed. All changes are under docs-out/.

PR Context

The study is run static-only (no .NET SDK or pwsh), so behaviour claims are labelled FACT-SRC / INFERENCE / UNVERIFIED. Remaining tasks (T26 binders and runtime operations, T28 types/operators/conversions, T29 scope, T210/T211, coordinator documents, later phases) follow in later PRs.

Checks run: render-canonical --check, check-claims, lint-terms, check-front-matter, check-links, numbers lint all pass. validate-refs passes (1525 refs, 0 failures) only with its pin gate bypassed in a throwaway interpreter: the gate fails because post-pin dependabot merges changed .github/workflows/* and a root prompt file, while src/ and test/ are identical to the pin (decision D-012).

PR Checklist

  • PR has a meaningful title
  • Summarized changes
  • Copyright header: N/A (no .h, .cpp, .cs, .ps1, .psm1 files added)
  • This PR is ready to merge
  • Breaking changes
    • None
  • User-facing changes
    • Not Applicable
  • Testing - New and feature
    • N/A or can only be tested interactively

🤖 Generated with Claude Code

https://claude.ai/code/session_01HnR7RpZuh9mvNMRTtzxTvk

claude added 3 commits November 3, 2026 09:45
@claude
Phase 2 T21: tokenizer document, generated token catalog, registers
73c73e3 
Adds 02.1-tokenizer.md and TOKEN-CATALOG.md (generated by tools/gen_T21.py),
CF-LEX-001/002, 19 claims, DEV-LEX-001, backlog VB-002..005, CON-002/003,
decisions D-012..D-014; marks Phase 1 done in PROGRESS.md.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01HnR7RpZuh9mvNMRTtzxTvk
@claude
Phase 2 T22: parser, grammar and error catalog documents
5ad1ebc 
Adds 02.2-parser.md, GRAMMAR.ebnf.md and ERROR-CATALOG.md (generated parts by
tools/gen_T22.py: 157-method production table, 52-operator precedence table,
412 ParserStrings keys), CF-GRM-001, CF-ERR-002, DEV-GRM-010, 17 claims,
CON-004..006, VB-006/007, decisions D-015/D-016.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01HnR7RpZuh9mvNMRTtzxTvk
@claude
Phase 2 T23: AST document and generated node catalog
365e87d 
Adds 02.3-ast.md and AST-CATALOG.md (tools/gen_T23.py: 76 nodes, visit-order
children, creators, consumers, visitor tables, inheritance diagram), DEV-AST-020,
13 claims, CON-007/008, VB-008..012, decision D-017.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01HnR7RpZuh9mvNMRTtzxTvk
@FredRavandi FredRavandi changed the title Add Phase 2 tokenizer, parser, grammar and error-catalog study documents Add Phase 2 tokenizer, parser, grammar, error-catalog and AST study documents Nov 3, 2026
@claude
Phase 2 T24, T25, T27: semantic analysis, compiler/engine, IR, compil…
e7cf6b0 
…ation map, tiering, instruction set, equivalence

Adds 02.4-semantic-analysis (133 check sites generated), 02.5-compiler-and-engine,
COMPILATION-MAP (63 Visit methods), IR-SPEC, INSTRUCTION-SET (183 classes),
TIERING-POLICY (CF-CMP-001/002/003), EQUIVALENCE-SPEC; tools gen_T24/T25/T27 and
expand_refs; DEV-SEM-030, DEV-ENG-040, DEV-TIER-060, DEV-EQV-061; CON-009/010;
VB-013..016; decisions D-018.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01HnR7RpZuh9mvNMRTtzxTvk
@FredRavandi FredRavandi changed the title Add Phase 2 tokenizer, parser, grammar, error-catalog and AST study documents Add Phase 2 language-pipeline study documents (tokenizer, parser, AST, semantic analysis, compiler, tiering) Nov 3, 2026
@FredRavandi
FredRavandi marked this pull request as ready for review November 3, 2026 11:38
@FredRavandi
FredRavandi merged commit 0c182ad into main Nov 3, 2026
2 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@FredRavandi @claude