Skip to content

HR: thirteen ARKOD archives beside the rolling file - #241

Open
ivorbosloper wants to merge 1 commit into
mainfrom
split/hr
Open

HR: thirteen ARKOD archives beside the rolling file#241
ivorbosloper wants to merge 1 commit into
mainfrom
split/hr

Conversation

@ivorbosloper

Copy link
Copy Markdown
Collaborator

Part of the publish-portolan split (#231-#240). Croatia: editions 2011-2023 beside the current one, 18,664,678 field-years.

Three things had to be right before the archives could be published at all, none of them visible in the output:

  1. The converter declared both sources and variants. sources wins in the base converter, so every --variant converted the current file — thirteen copies of 2024 would have been published as thirteen years. (A guard for this belongs upstream; it is in the id/guard structural PR, not here.)
  2. index_as_id overwrote ARKOD's own parcel id. The archives carry it, unique within an edition; only the rolling land_parcels.gpkg lacks one. The row index is the fallback now, not the rule. Worth knowing when checking this kind of thing: the Hilbert sort shuffles the rows, so a row index looks like a meaningful id — compare against 0..n-1 to tell.
  3. The archives set gpkg srs_id to 0 ("Undefined geographic SRS") while holding EPSG:3765 metres, which put projected coordinates in the STAC extent and built the Hilbert grid from a global geographic extent, leaving every parcel in one cell of it.

missing_schemas also required six properties the archives do not all carry — 2011 leaves mines_status null for 909k of its 1.29M rows — so required is empty and the difference is recorded where readers will see it.

Fourteen editions published. Original commits: ed408b9, 6237d59, and the hr half of 88194e3.

🤖 Generated with Claude Code

https://claude.ai/code/session_01DVx9uQV2QPM8ecPAY3ZjXG

Three things had to be right before the archives could be published at all, and
none of them was visible in the output.

The converter declared both `sources` and `variants`. `sources` wins in the base
converter, so every `--variant` converted the current file: thirteen copies of
2024 would have been published as thirteen years.

`index_as_id` replaced ARKOD's own parcel id with a row number. The archives
carry that id, unique within an edition; only the rolling current file lacks
one, so the row index is the fallback rather than the rule.

The archives set the GeoPackage srs_id to 0 ("Undefined geographic SRS") while
holding EPSG:3765 metres, which put projected coordinates in the STAC extent
and built the Hilbert grid from a global geographic extent, leaving every parcel
in one cell of it.

`missing_schemas` also required six properties the archives do not all carry:
2011 leaves mines_status null for 909k of its 1.29M rows.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01DVx9uQV2QPM8ecPAY3ZjXG
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant