Skip to content

Support Arrow Map schemas in Iceberg writes - #72

Merged
osipovartem merged 1 commit into
embucket-sync-df55.0.0from
arrow-map-write-df55
Sep 8, 2026
Merged

Support Arrow Map schemas in Iceberg writes#72
osipovartem merged 1 commit into
embucket-sync-df55.0.0from
arrow-map-write-df55

Conversation

@osipovartem

Copy link
Copy Markdown

Summary

  • convert Arrow DataType::Map schemas to Iceberg MapType for write/create paths
  • assign stable Iceberg field IDs recursively to map keys and values
  • reject nullable Arrow map keys and malformed entries instead of producing invalid Iceberg metadata
  • cover schema round-trip and missing-ID assignment, including Utf8View keys

Validation

  • cargo +1.95.0 test -p iceberg-rust-spec arrow::schema --lib: 21 passed
  • cargo +1.95.0 clippy -p iceberg-rust-spec --all-targets -- -D warnings
  • cargo +1.95.0 fmt --all -- --check

@osipovartem
osipovartem merged commit 8ddcf23 into embucket-sync-df55.0.0 Sep 8, 2026
2 checks passed
@osipovartem
osipovartem deleted the arrow-map-write-df55 branch September 8, 2026 16:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant