xloya commented on PR #7096: URL: https://github.com/apache/iceberg/pull/7096#issuecomment-1469329713
> Yea for Action, my thought was on each call you can do: > > ``` > val mySpark = spark.cloneSession() > mySpark.setConf(...) // turn off auto broadcast join > SparkActions.get(mySpark).deleteOrphanFiles() > ``` > > I think each SparkAction.get() makes an independent instance, with its own sparkSession. > > I'm not sure about Procedure though. Looks like it uses activeSession, which is thread local. @szehon-ho I got your point. Actually such as Spark Thrift Server or Kyuubi, they only expose the SQL API for users, so you can't set conf like which in code, and they can't identify what type of SQL it is. This change mainly covers this scenario. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
