This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 6fd3138 [SPARK-30667][CORE] Change BarrierTaskContext allGather
method return type
add bb295d8 [SPARK-31159][SQL] Rebase date/timestamp from/to Julian
calendar in parquet
No new revisions were added by this update.
Summary of changes:
.../spark/sql/catalyst/util/DateTimeUtils.scala | 106 ++++++++++++++++++++-
.../org/apache/spark/sql/internal/SQLConf.scala | 16 ++++
.../sql/catalyst/util/DateTimeUtilsSuite.scala | 60 ++++++++++++
.../parquet/VectorizedColumnReader.java | 44 ++++++++-
.../datasources/parquet/ParquetRowConverter.scala | 49 ++++++++--
.../datasources/parquet/ParquetWriteSupport.scala | 19 ++++
.../test-data/before_1582_date_v2_4.snappy.parquet | Bin 0 -> 398 bytes
...before_1582_timestamp_int96_v2_4.snappy.parquet | Bin 0 -> 494 bytes
...efore_1582_timestamp_micros_v2_4.snappy.parquet | Bin 0 -> 436 bytes
...efore_1582_timestamp_millis_v2_4.snappy.parquet | Bin 0 -> 436 bytes
.../datasources/parquet/ParquetIOSuite.scala | 66 +++++++++++++
11 files changed, 343 insertions(+), 17 deletions(-)
create mode 100644
sql/core/src/test/resources/test-data/before_1582_date_v2_4.snappy.parquet
create mode 100644
sql/core/src/test/resources/test-data/before_1582_timestamp_int96_v2_4.snappy.parquet
create mode 100644
sql/core/src/test/resources/test-data/before_1582_timestamp_micros_v2_4.snappy.parquet
create mode 100644
sql/core/src/test/resources/test-data/before_1582_timestamp_millis_v2_4.snappy.parquet
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
