amogh-jahagirdar commented on PR #12195: URL: https://github.com/apache/iceberg/pull/12195#issuecomment-2646608262
> > Big picture question I have though is if it makes sense for Iceberg to even be releasing a separate Kafka Connect distribution with HMS client. Since we're close to a release, and I also just don't have context on the rationale I think the change to have separate license/notice for each distribution makes sense cc @bryanck . > > The original reason for having a distribution without the HMS client was that Confluent has strict requirements for connectors hosted on Confluent Hub, and Hive with its transitive dependencies has too many security vulnerabilities to fix. In order to have the connector on Confluent Hub we had to strip out the HMS client, but there are several users who are using the HMS support. > > We could take the Flink approach, and leave it up to the user to provide the Hive and Hadoop libraries on the classpath. It makes it more difficult and cumbersome to use the connector, however, especially on a hosted platform like AWS MSK or Confluent Cloud. > > Alternatively, we could have one distribution with HMS client. We could possibly work with Confluent to resolve the security concerns if we ever want to host it on Confluent Hub. Got it, thanks for the context! Yeah I can imagine for users using HMS client, without Iceberg providing a bundle, it just becomes difficult to setup/use the connector. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
