ArnavBalyan commented on PR #489: URL: https://github.com/apache/incubator-livy/pull/489#issuecomment-3444656331
> Thank you for your PR @ArnavBalyan! This could be an important step of cleaning up unneeded features in an upcoming release. The change is quite big, so it will take some time to review. In the meantime, can I ask why you chose Spark version 3.3.4 in the main `pom.xml` and in `README.md`? The latest version should work with 3.5.6, but Spark 3.5.7 is already available as well. Hi @gyogal thanks so much, really appreciate it. For Spark, looks like `3.3.4` was the latest version that shipped hadoop 2 binaries. Moving to 3.5.7 may need us to bump to hadoop 3, was a bit unsure if this would have any side effects since this was getting a considerably large change. Let me know if we are comfortable directly moving to hadoop 3 happy to update. Thanks for taking a look -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
