coldfusioncoder commented on issue #12507: URL: https://github.com/apache/iceberg/issues/12507#issuecomment-3192797444
@paramadeep > copy the downloaded zip file into the plugin path of kafka-connect container (CONNECT_PLUGIN_PATH). it will work This was not specific enough for me. It seems that KC is actually quite sensitive about where these files need to be located, and I get different results depending on whether they're unzipped or not. ```sh $ echo $CONNECT_PLUGIN_PATH /usr/share/java/,/usr/share/confluent-hub-components/ ``` Which of these possible places is correct? ```sh /usr/share/java/ /usr/share/confluent-hub-components/ # or some subdirectory like... /usr/share/java/iceberg-iceberg-kafka-connect/ /usr/share/confluent-hub-components/iceberg-iceberg-kafka-connect/ ``` And then for each of these, we need to try placing the zip as is, or unzipping it. That's quite a few things to try. _It would be nice if someone could just tell us specifically what works._ **Best of all, share a Dockerfile, + docker-compose, + connector-config.json.** I discovered that the last of the above paths (`/usr/share/confluent-hub-components/iceberg-iceberg-kafka-connect/`) would work, so I then tried placing the files as a zip or extracted, and I found that I get this error if zipped: ``` Failed to find any class that implements Connector and which name matches org.apache.iceberg.connect.IcebergSinkConnector ``` If, however, I extract then I get a different error... ``` java.lang.ClassNotFoundException: org.apache.iceberg.nessie.NessieCatalog ``` ...which tells me that iceberg sink has loaded and now Nessie is failing (good sign, on to the next issue). The location that works for me is: `/usr/share/confluent-hub-components/iceberg-iceberg-kafka-connect/`. Why "iceberg-iceberg-kafka-connect"? Because I found this directory was present if I use `confluent-hub install --no-prompt iceberg/iceberg-kafka-connect:1.9.1` in the build process, rather than installing the zip file. It would be great if `confluent-hub install` were the solution, but this apparently doesn't yet install everything iceberg sink requires (see: #10745). **I'm guessing that this subdirectory name is not actually important but with so many paths to try, I'm tired of trying everything.** _It would be great if the people who have this working could be a little more specific when sharing their knowledge._ 🤞 for the `confluent-hub` fix. I hope the above info is helpful to someone. I've spent quite a few hours bouncing around between the various docs pages and repos to get this far. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
