Skip to content

[FLINK-40576][fs] Exclude transitive alluxio dependency from flink-s3-fs-presto - #29145

Open
spuru9 wants to merge 1 commit into
apache:masterfrom
spuru9:FLINK-40576
Open

[FLINK-40576][fs] Exclude transitive alluxio dependency from flink-s3-fs-presto#29145
spuru9 wants to merge 1 commit into
apache:masterfrom
spuru9:FLINK-40576

Conversation

@spuru9

@spuru9 spuru9 commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

What is the purpose of the change

flink-s3-fs-presto transitively bundles org.alluxio:alluxio-shaded-client, pulled in via presto-hive. It is only used by Presto's caching filesystem, which the Presto S3 file system does not use. The shaded client is an outdated uber-jar that unnecessarily bloats the plugin, so this excludes it from the bundle.

Brief change log

  • Exclude org.alluxio:alluxio-shaded-client from the presto-hive dependency in flink-s3-fs-presto.
  • Remove the corresponding entry from the bundled META-INF/NOTICE.

Verifying this change

This change is already covered by existing tests: the presto_seaweedfs_read end-to-end test (registered in run-nightly-tests.sh) exercises the Presto S3 file system read path against a local S3-compatible store.

Locally verified that mvn clean install -pl flink-filesystems/flink-s3-fs-presto -am succeeds (so NoticeFileChecker passes), and that the resulting shaded jar contains no alluxio classes while PrestoS3FileSystem and the rest of the S3 code path remain intact.

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): yes (removes a bundled transitive dependency)
  • The public API, i.e., is any changed class annotated with @Public(Evolving): no
  • The serializers: no
  • The runtime per-record code paths (performance sensitive): no
  • Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
  • The S3 file system connector: yes

Documentation

  • Does this pull request introduce a new feature? no

Was generative AI tooling used to co-author this PR?
  • Yes (please specify the tool below)

Generated-by: Claude Code (claude-opus-4-8)

…-fs-presto

flink-s3-fs-presto pulls in org.alluxio:alluxio-shaded-client transitively
via presto-hive. It is only used by Presto's caching filesystem, which the
S3 file system does not use. The shaded client is an outdated uber-jar that
unnecessarily bloats the bundled plugin, so exclude it and drop it from the
bundled NOTICE.

Generated-by: Claude Code (claude-opus-4-8)
@flinkbot

flinkbot commented Sep 9, 2026

Copy link
Copy Markdown
Collaborator

CI report:

Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants