Sigma-Ma opened a new pull request, #178:
URL: https://github.com/apache/hbase-connectors/pull/178

   ### What changes were proposed in this pull request?
   
   Add JavaHBaseContext to the Spark 4 module, covering bulkPut/Get/Delete, 
both scan overloads, foreachPartition/mapPartitions, and both bulk-load 
wrappers.
   
   Preserve the existing Java batch API signatures, adapt Java iterators 
internally, and keep ClassTags out of the Java API. All operations delegate to 
the existing Spark 4 HBaseContext.
   
   Add Java mini-cluster tests and a Java usage example. Legacy DStream APIs 
are outside the scope of this port.
   
   ### Why are the changes needed?
   
   The Spark 4 module provides HBaseContext but lacks the JavaHBaseContext 
facade available in Spark 3. This leaves JavaRDD applications without 
equivalent batch API entry points when upgrading.
   
   ### How was this patch tested?
   
   ```bash
   mvn -B -ntp -Pspark4 -pl spark4/hbase-spark4 -am -DskipTests clean install
   
   mvn -B -ntp -Pspark4 -pl spark4/hbase-spark4 -Dtest=TestJavaHBaseContext 
-Dsuites=org.apache.hadoop.hbase.spark.HBaseContextSuite,org.apache.hadoop.hbase.spark.BulkLoadSuite
 -Dsurefire.failIfNoSpecifiedTests=true -Dsurefire.rerunFailingTestsCount=0 test
   
   mvn -B -ntp -Pspark4 -pl spark4/hbase-spark4 -Dtest=TestJavaHBaseContext 
-Dsurefire.failIfNoSpecifiedTests=true -Dsurefire.rerunFailingTestsCount=0 
test-compile surefire:test
   
   mvn -B -ntp -Pspark4 -pl spark,spark4/hbase-spark4 
'-DspotlessFiles=.*/spark/README.md|.*/spark4/hbase-spark4/(pom.xml|.*JavaHBaseContext.*)'
 spotless:check
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to