geyanggang opened a new pull request, #10789:
URL: https://github.com/apache/gravitino/pull/10789
### What changes were proposed in this pull request?
- Remove `hadoop2` version (2.10.2) and its 6 library definitions from
libs.versions.toml
- Bump `hadoop3` from 3.3.1 to 3.3.6 (including `hadoop3-abs`,
`hadoop3-aliyun`, `hadoop-minikdc`)
- Replace all `libs.hadoop2.*` references with `libs.hadoop3.*` in 8 build
files
- Add Hadoop 3.x runtime dependencies stripped by `exclude("*")`:
`hadoop-shaded-guava`, `hadoop-shaded-protobuf`, `commons-configuration2`,
`re2j`
- Remove outdated hadoop2/hadoop3 conflict comment in `catalog-hive`
### Why are the changes needed?
- The `hadoop2` (2.10.2) dependency line brings in outdated transitive
dependencies (Jackson 2.6.x, Netty 3.x, Jetty 9.3.x) that are no longer
maintained
- `hive-metastore3-libs` was incorrectly configured with `hadoop2` despite
Hive 3.1.3 natively depending on Hadoop 3.1.0
- Unifying on a single Hadoop version eliminates classpath conflicts and
simplifies dependency management
Fix: #10788
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
- Full compilation (`./gradlew build -x test`) — passed
- Verified `hadoop-common-3.3.6` resolves in all affected modules, no Hadoop
2.x JARs in distribution
- All unit tests passed across 12 key modules including `catalog-hive`,
`hive-metastore-common`, `catalog-lakehouse-hudi`, `catalog-fileset`,
`filesystem-hadoop3`, `hadoop-common`, `authorization-ranger`,
`spark-connector`, `flink-connector`, `core`
- Integration tests pending CI validation
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
