Skip to content

foundation: xsources, dev's SExtractor sources of the SFFT image, beside the source set (xsources) - #159

Merged
RussLaher merged 5 commits into
mainfrom
xsources
Nov 4, 2026
Merged

RussLaher merged 5 commits into
mainfrom
xsources

Conversation

@RussLaher

Copy link
Copy Markdown
Collaborator

What

  • decisions.md: the ruling decision-xsources (Russ Laher, 2026-11-04).
  • foundation.md: the rule, plus the products table, the difference stage's row and the binding sentence.

Under diff_flavor = "sfft" the difference job writes xsources beside its source set. These are dev's (d2657f7d) SExtractor sources of the SFFT difference image, positive and negative:

  • Kept by dev's loader cuts: inside the image more than 2 px from its edge; dropped at a finite sumrat ≤ 0.4, a finite rb ≤ 0 or a finite aperture S/N ≤ 5. Uncapped.
  • With dev's extra columns: the pixel columns, DAOStarFinder sharpness and roundness, a 5×5 PSF fit on the prefiltered sources, and the RuBR-AT score and label.
  • Split into xsources_<yyyymmdd>_<sca> child tables, loaded by COPY, and official with the source set.

Choices recorded:

  • a failure fails the job;
  • the rb cut is xsources' alone (sources keeps the rb-port ruling);
  • both signs are scored.

Why

Requested by Russ: xsources on rebuild, split and loaded as sources is.

Code

The rapid PR follows; link in a comment.

Testing

Run locally in a Python 3.12 container: sphinx-build -W builds clean, scripts/acceptance.sh passes, and scripts/check-public-safety.sh is clean. The external link check was not run.

🤖 Generated with Claude Code

…ide the source set (xsources)

The ruling on decisions.md and the rule on foundation.md: under sfft the
difference job writes xsources from both SExtractor catalogs, with dev's
extra columns and loader cuts, uncapped, split and COPY-loaded like
sources, official with the source set. Failure fails the job; the rb cut
is xsources' alone; both signs are scored.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@RussLaher

Copy link
Copy Markdown
Collaborator Author

Code: Caltech-IPAC/rapid#523

RussLaher and others added 2 commits November 4, 2026 09:25
… job goes on; a zero uncertainty pixel is masked

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ys loaded (skip-sources)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@RussLaher

Copy link
Copy Markdown
Collaborator Author

Added: the null-not-failure rule for uncomputable extra columns, and the decision-skip-sources ruling and rule ([difference] skip_loading_sources_records). Code in Caltech-IPAC/rapid#523.

…rces it needs, not the parents (children-reads)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@RussLaher

Copy link
Copy Markdown
Collaborator Author

Added the decision-children-reads ruling and the rule in foundation.md: the pipeline queries the child tables it needs, not the parents. Code in Caltech-IPAC/rapid#523.

…too, through sources_of and xsources_of (children-reads)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@RussLaher

Copy link
Copy Markdown
Collaborator Author

Updated decision-children-reads and the foundation rule: the operator scripts and named queries read child tables too, through sources_of and xsources_of. Code in Caltech-IPAC/rapid#523.

@RussLaher
RussLaher merged commit 708f41a into main Nov 4, 2026
2 checks passed
@RussLaher
RussLaher deleted the xsources branch November 4, 2026 18:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant