This is an automated email from the ASF dual-hosted git repository.
vanzin pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 4ec04e5 [SPARK-22340][PYTHON] Add a mode to pin Python thread into
JVM's
add 3641c3d [SPARK-21869][SS] Apply Apache Commons Pool to Kafka producer
No new revisions were added by this update.
Summary of changes:
.../spark/sql/kafka010/CachedKafkaProducer.scala | 118 +++++-------
.../sql/kafka010/InternalKafkaConnectorPool.scala | 210 +++++++++++++++++++++
.../sql/kafka010/InternalKafkaConsumerPool.scala | 210 +++------------------
.../sql/kafka010/InternalKafkaProducerPool.scala | 68 +++++++
.../spark/sql/kafka010/KafkaDataConsumer.scala | 7 +-
.../spark/sql/kafka010/KafkaDataWriter.scala | 34 +++-
.../apache/spark/sql/kafka010/KafkaWriteTask.scala | 20 +-
.../org/apache/spark/sql/kafka010/package.scala | 34 +++-
.../sql/kafka010/CachedKafkaProducerSuite.scala | 154 +++++++++++----
...scala => InternalKafkaConnectorPoolSuite.scala} | 8 +-
.../sql/kafka010/KafkaDataConsumerSuite.scala | 6 +-
.../org/apache/spark/sql/kafka010/KafkaTest.scala | 10 +-
.../kafka010/KafkaDataConsumerSuite.scala | 7 -
13 files changed, 554 insertions(+), 332 deletions(-)
create mode 100644
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/InternalKafkaConnectorPool.scala
create mode 100644
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/InternalKafkaProducerPool.scala
rename
external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/{InternalKafkaConsumerPoolSuite.scala
=> InternalKafkaConnectorPoolSuite.scala} (96%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
