[
https://issues.apache.org/jira/browse/HBASE-30513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mazhengxuan reassigned HBASE-30513:
-----------------------------------
Assignee: mazhengxuan
> Restore SparkConf fallbacks for Spark 4 datasource read options
> ---------------------------------------------------------------
>
> Key: HBASE-30513
> URL: https://issues.apache.org/jira/browse/HBASE-30513
> Project: HBase
> Issue Type: Sub-task
> Components: hbase-connectors
> Reporter: mazhengxuan
> Assignee: mazhengxuan
> Priority: Major
>
> The Spark 4 datasource reads hbase.spark.query.cacheblocks,
> hbase.spark.query.cachedrows, hbase.spark.query.batchsize and
> hbase.spark.bulkget.size from datasource options without the SparkConf
> fallback used by Spark 3. Existing applications that set these globally can
> therefore silently use different read settings after upgrading.
> We should restore the precedence of datasource option, then SparkConf, then
> default, and test both global settings and per-read overrides.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
