wfxxh commented on issue #7226:
URL: https://github.com/apache/iceberg/issues/7226#issuecomment-2270542484
spark version: 3.3.3 , iceberg version: 1.4.3 ,same stack trace for me.
my table is:
> CREATE TABLE iceberg_catalog.doi.doi_log (
date_time TIMESTAMP,
ip STRING,
protocol STRING,
operation STRING,
response STRING,
duration STRING,
doi STRING)
USING iceberg
PARTITIONED BY (days(date_time))
TBLPROPERTIES (
'format' = 'iceberg/parquet',
'format-version' = '2',
'write.metadata.delete-after-commit.enabled' = 'true',
'write.metadata.previous-versions-max' = '20',
'write.parquet.bloom-filter-enabled.column.doi' = 'true',
'write.parquet.compression-codec' = 'zstd',
'write.target-file-size-bytes' = '1073741824')
the error is "org.apache.spark.sql.AnalysisException: days(date_time) is not
currently supported"
when I set 'write.distribution-mode=none' the error is "days(date_time) ASC
NULLS FIRST is not currently supported"
My code is like
> val kafkaDF = spark read from kafka topic
kafkaDF.writeStream
.outputMode("append")
.queryName("doi")
.option("checkpointLocation", "path/to/checkpoint")
.option("fanout-enabled", "true")
.trigger(Trigger.ProcessingTime(1, TimeUnit.MINUTES))
.format("iceberg")
.toTable("iceberg_catalog.doi.doi_log")
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org
