pvary commented on issue #10506:
URL: https://github.com/apache/iceberg/issues/10506#issuecomment-2171107875
I would ask this question on the Hive users list, and the if appropriate, I
would file a Hive jira. The folks there would know, if this is the way how you
should use Hive 4.0.0.
--
jbonofre commented on code in PR #10494:
URL: https://github.com/apache/iceberg/pull/10494#discussion_r1641622578
##
core/src/main/java/org/apache/iceberg/io/ContentCache.java:
##
@@ -147,10 +147,23 @@ public InputFile tryCache(InputFile input) {
return input;
}
+ /**
jbonofre commented on PR #10496:
URL: https://github.com/apache/iceberg/pull/10496#issuecomment-2171068998
@stevenzwu do we have a corresponding issue for this PR ? Your PR looks like
a good idea to me.
--
This is an automated message from the Apache Git Service.
To respond to the message
jbonofre commented on code in PR #10498:
URL: https://github.com/apache/iceberg/pull/10498#discussion_r1641622324
##
core/src/main/java/org/apache/iceberg/jdbc/JdbcCatalog.java:
##
@@ -466,6 +466,16 @@ public List listNamespaces(Namespace namespace)
throws NoSuchNamespac
jbonofre commented on PR #10501:
URL: https://github.com/apache/iceberg/pull/10501#issuecomment-2171066896
@findepi you should set Iceberg 1.6.0 as milestone for this PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
dependabot[bot] opened a new pull request, #10507:
URL: https://github.com/apache/iceberg/pull/10507
Bumps
[datamodel-code-generator](https://github.com/koxudaxi/datamodel-code-generator)
from 0.25.6 to 0.25.7.
Release notes
Sourced from https://github.com/koxudaxi/datamodel-code-
nadialeiden opened a new issue, #10506:
URL: https://github.com/apache/iceberg/issues/10506
### Query engine
Hive 4.0.0
### Question
**Versions**
Hive 4.0.0
Hadoop 3.4.1
**Problem**
Hello, I have just encountered a problem regarding to Hive and Ice
dependabot[bot] opened a new pull request, #10505:
URL: https://github.com/apache/iceberg/pull/10505
Bumps software.amazon.awssdk:bom from 2.25.69 to 2.26.3.
[ from
4.1.110.Final to 4.1.111.Final.
Commits
https://github.com/netty/netty/commit/90c5fd78c12ffe4698795e44fc6d865d
dependabot[bot] opened a new pull request, #10503:
URL: https://github.com/apache/iceberg/pull/10503
Bumps
[org.springframework:spring-web](https://github.com/spring-projects/spring-framework)
from 5.3.36 to 5.3.37.
Release notes
Sourced from https://github.com/spring-projects/spr
dependabot[bot] closed pull request #10417: Build: Bump
com.google.cloud:libraries-bom from 26.28.0 to 26.40.0
URL: https://github.com/apache/iceberg/pull/10417
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL abov
dependabot[bot] commented on PR #10417:
URL: https://github.com/apache/iceberg/pull/10417#issuecomment-2171039799
Superseded by #10502.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specifi
dependabot[bot] opened a new pull request, #10502:
URL: https://github.com/apache/iceberg/pull/10502
Bumps
[com.google.cloud:libraries-bom](https://github.com/googleapis/java-cloud-bom)
from 26.28.0 to 26.41.0.
Release notes
Sourced from https://github.com/googleapis/java-cloud-bo
chinmay-bhat commented on code in PR #758:
URL: https://github.com/apache/iceberg-python/pull/758#discussion_r1641606523
##
pyiceberg/table/__init__.py:
##
@@ -1956,6 +1957,10 @@ def _commit(self) -> UpdatesAndRequirements:
"""Apply the pending changes and commit."""
github-actions[bot] commented on issue #132:
URL: https://github.com/apache/iceberg-python/issues/132#issuecomment-2170984831
This issue has been closed because it has not received any activity in the
last 14 days since being marked as 'stale'
--
This is an automated message from the Apac
github-actions[bot] closed issue #132: to_pandas() API which converts iceberg
table scan to a pd.DataFrame will lost datetime data type and row order
URL: https://github.com/apache/iceberg-python/issues/132
--
This is an automated message from the Apache Git Service.
To respond to the messag
github-actions[bot] closed issue #2723: Support for low latency writes to
iceberg table
URL: https://github.com/apache/iceberg/issues/2723
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specifi
github-actions[bot] commented on issue #2723:
URL: https://github.com/apache/iceberg/issues/2723#issuecomment-2170984119
This issue has been closed because it has not received any activity in the
last 14 days since being marked as 'stale'
--
This is an automated message from the Apache Gi
github-actions[bot] commented on issue #2718:
URL: https://github.com/apache/iceberg/issues/2718#issuecomment-2170984113
This issue has been closed because it has not received any activity in the
last 14 days since being marked as 'stale'
--
This is an automated message from the Apache Gi
github-actions[bot] closed issue #2718: Remove site docs from showing up in
IntelliJ search and causing very long index times in IntelliJ
URL: https://github.com/apache/iceberg/issues/2718
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
github-actions[bot] closed issue #2715: Hive documentation not updated on
website
URL: https://github.com/apache/iceberg/issues/2715
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comm
github-actions[bot] commented on issue #2715:
URL: https://github.com/apache/iceberg/issues/2715#issuecomment-2170984109
This issue has been closed because it has not received any activity in the
last 14 days since being marked as 'stale'
--
This is an automated message from the Apache Gi
github-actions[bot] closed issue #2696: Can't seem to read from glue iceberg
table in EMR Hive
URL: https://github.com/apache/iceberg/issues/2696
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
github-actions[bot] commented on issue #2696:
URL: https://github.com/apache/iceberg/issues/2696#issuecomment-2170984103
This issue has been closed because it has not received any activity in the
last 14 days since being marked as 'stale'
--
This is an automated message from the Apache Gi
github-actions[bot] closed issue #2690: [Incremental Scan] [Spark] Support
overwrite snapshots too
URL: https://github.com/apache/iceberg/issues/2690
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
github-actions[bot] commented on issue #2690:
URL: https://github.com/apache/iceberg/issues/2690#issuecomment-2170984096
This issue has been closed because it has not received any activity in the
last 14 days since being marked as 'stale'
--
This is an automated message from the Apache Gi
github-actions[bot] commented on issue #2633:
URL: https://github.com/apache/iceberg/issues/2633#issuecomment-2170984083
This issue has been automatically marked as stale because it has been open
for 180 days with no activity. It will be closed in next 14 days if no further
activity occurs.
syun64 commented on issue #716:
URL: https://github.com/apache/iceberg-python/issues/716#issuecomment-2170966077
Hi @cgbur and @felixscherz thank you for raising this and taking this
investigation further. I'm not a polars user myself, but the difference in the
behavior is quite interesting
syun64 commented on issue #818:
URL: https://github.com/apache/iceberg-python/issues/818#issuecomment-2170955774
Thank you for raising this @ndrluis 💯 I will add this as a 0.8.0 milestone
for now
--
This is an automated message from the Apache Git Service.
To respond to the message, plea
syun64 closed issue #24: Support get partition table with filter
URL: https://github.com/apache/iceberg-python/issues/24
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsu
syun64 commented on issue #24:
URL: https://github.com/apache/iceberg-python/issues/24#issuecomment-2170955372
Partitions table was added in:
https://github.com/apache/iceberg-python/pull/603
--
This is an automated message from the Apache Git Service.
To respond to the message, please l
syun64 commented on PR #821:
URL: https://github.com/apache/iceberg-python/pull/821#issuecomment-2170950407
Hi @ndrluis - thank you for raising this. This looks like an issue we'd
definitely want to fix.
Just to help with reviewing this PR, and for future records, would you be
able t
syun64 commented on PR #728:
URL: https://github.com/apache/iceberg-python/pull/728#issuecomment-2170945908
This is awesome! @chinmay-bhat You are on a roll with these PRs right now,
thank you for contributing these much needed features to PyIceberg! Looking
forward to releasing these with
findepi commented on code in PR #10498:
URL: https://github.com/apache/iceberg/pull/10498#discussion_r1641426650
##
core/src/main/java/org/apache/iceberg/jdbc/JdbcCatalog.java:
##
@@ -466,6 +466,16 @@ public List listNamespaces(Namespace namespace)
throws NoSuchNamespac
findepi commented on issue #7094:
URL: https://github.com/apache/iceberg/issues/7094#issuecomment-2170594846
follow-up to complete removal of AssertHelpers --
https://github.com/apache/iceberg/pull/10500
> I don't think we want to spend time migrating those
agreed! fortunately
findepi commented on PR #6977:
URL: https://github.com/apache/iceberg/pull/6977#issuecomment-2170594054
follow-up to complete removal of AssertHelpers --
https://github.com/apache/iceberg/pull/10500
--
This is an automated message from the Apache Git Service.
To respond to the message, pl
findepi commented on PR #10500:
URL: https://github.com/apache/iceberg/pull/10500#issuecomment-2170593672
[flink-scala-2-12-tests (8,
1.17)](https://github.com/apache/iceberg/actions/runs/9528246393/job/26265724393#logs)
looks like a flake. on a subsequent run [flink-scala-2-12-tests (8,
1
Fokko merged PR #10195:
URL: https://github.com/apache/iceberg/pull/10195
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa
Fokko merged PR #10419:
URL: https://github.com/apache/iceberg/pull/10419
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa
amogh-jahagirdar commented on code in PR #9695:
URL: https://github.com/apache/iceberg/pull/9695#discussion_r1641406745
##
open-api/rest-catalog-open-api.yaml:
##
@@ -2106,6 +2210,32 @@ components:
items:
$ref: '#/components/schemas/PartitionStatisticsFil
danielcweeks commented on code in PR #9695:
URL: https://github.com/apache/iceberg/pull/9695#discussion_r1641334986
##
open-api/rest-catalog-open-api.yaml:
##
@@ -3789,6 +4003,21 @@ components:
EmptyResponse:
$ref: '#/components/examples/ListNamespace
danielcweeks commented on code in PR #9695:
URL: https://github.com/apache/iceberg/pull/9695#discussion_r1641334089
##
open-api/rest-catalog-open-api.yaml:
##
@@ -2838,6 +2988,69 @@ components:
additionalProperties:
type: string
+PreplanTableRequest
danielcweeks commented on code in PR #9695:
URL: https://github.com/apache/iceberg/pull/9695#discussion_r1641333965
##
open-api/rest-catalog-open-api.yaml:
##
@@ -2838,6 +2988,69 @@ components:
additionalProperties:
type: string
+PreplanTableRequest
danielcweeks commented on code in PR #9695:
URL: https://github.com/apache/iceberg/pull/9695#discussion_r1641333565
##
open-api/rest-catalog-open-api.yaml:
##
@@ -2838,6 +2988,69 @@ components:
additionalProperties:
type: string
+PreplanTableRequest
danielcweeks commented on code in PR #9695:
URL: https://github.com/apache/iceberg/pull/9695#discussion_r1641328271
##
open-api/rest-catalog-open-api.yaml:
##
@@ -2838,6 +2988,69 @@ components:
additionalProperties:
type: string
+PreplanTableRequest
amogh-jahagirdar commented on code in PR #10090:
URL: https://github.com/apache/iceberg/pull/10090#discussion_r1640408646
##
parquet/src/main/java/org/apache/iceberg/parquet/ParquetDictionaryRowGroupFilter.java:
##
@@ -116,48 +122,48 @@ private boolean eval(
}
}
ZENOTME commented on code in PR #401:
URL: https://github.com/apache/iceberg-rust/pull/401#discussion_r1641288830
##
crates/iceberg/src/spec/values.rs:
##
@@ -50,7 +51,7 @@ use super::datatypes::{PrimitiveType, Type};
const MAX_TIME_VALUE: i64 = 24 * 60 * 60 * 1_000_000i64 - 1;
ZENOTME commented on code in PR #401:
URL: https://github.com/apache/iceberg-rust/pull/401#discussion_r1641281871
##
crates/iceberg/src/arrow/reader.rs:
##
Review Comment:
+1. We can expose an interface in the table to get a builder.
--
This is an automated message from
ZENOTME commented on code in PR #401:
URL: https://github.com/apache/iceberg-rust/pull/401#discussion_r1641279780
##
crates/iceberg/src/arrow/reader.rs:
##
@@ -74,38 +70,22 @@ impl ArrowReaderBuilder {
self
}
-/// Sets the desired column projection with a lis
ZENOTME commented on code in PR #401:
URL: https://github.com/apache/iceberg-rust/pull/401#discussion_r1641278744
##
crates/iceberg/src/expr/predicate.rs:
##
@@ -879,12 +905,19 @@ mod tests {
)
}
+fn test_bound_predicate_serialize_diserialize(bound_predicate:
chinmay-bhat commented on PR #728:
URL: https://github.com/apache/iceberg-python/pull/728#issuecomment-2170122431
Thanks @HonahX @Fokko @syun64 for the discussions and reviews! 🫡 🙌
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitH
HonahX closed issue #573: Support creating tags
URL: https://github.com/apache/iceberg-python/issues/573
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail
HonahX commented on PR #728:
URL: https://github.com/apache/iceberg-python/pull/728#issuecomment-2170106747
Merged! Thanks @chinmay-bhat for the great work. Thanks @Fokko @syun64 for
the review.
--
This is an automated message from the Apache Git Service.
To respond to the message, please
HonahX merged PR #728:
URL: https://github.com/apache/iceberg-python/pull/728
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg
findepi commented on code in PR #10500:
URL: https://github.com/apache/iceberg/pull/10500#discussion_r1641257105
##
spark/v3.3/spark-extensions/src/test/java/org/apache/iceberg/spark/extensions/TestAddFilesProcedure.java:
##
@@ -688,23 +688,23 @@ public void invalidDataImport()
nastra commented on code in PR #10500:
URL: https://github.com/apache/iceberg/pull/10500#discussion_r1641210236
##
spark/v3.3/spark-extensions/src/test/java/org/apache/iceberg/spark/extensions/TestAddFilesProcedure.java:
##
@@ -688,23 +688,23 @@ public void invalidDataImport() {
chinmay-bhat commented on PR #728:
URL: https://github.com/apache/iceberg-python/pull/728#issuecomment-2169622681
@Fokko @HonahX Can we merge this in? Other draft PRs depend on this one 🙌
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on
findepi commented on PR #10499:
URL: https://github.com/apache/iceberg/pull/10499#issuecomment-2169528217
thanks for the merge, @nastra !
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the speci
nastra merged PR #10499:
URL: https://github.com/apache/iceberg/pull/10499
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap
findepi closed pull request #10500: Tests: Remove deprecated and unused test
helper
URL: https://github.com/apache/iceberg/pull/10500
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific com
findepi commented on PR #10500:
URL: https://github.com/apache/iceberg/pull/10500#issuecomment-2169422404
you're right, just intellij didn't see them.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to g
findepi commented on PR #10499:
URL: https://github.com/apache/iceberg/pull/10499#issuecomment-2169395232
cc @pan3793
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To un
findepi commented on code in PR #10478:
URL: https://github.com/apache/iceberg/pull/10478#discussion_r1641090102
##
settings.gradle:
##
@@ -72,6 +72,7 @@ project(':open-api').name = 'iceberg-open-api'
if (null != System.getProperty("allVersions")) {
System.setProperty("fli
findepi closed pull request #10478: Use all known Scala versions when
-DallVersions set
URL: https://github.com/apache/iceberg/pull/10478
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
findepi commented on code in PR #10478:
URL: https://github.com/apache/iceberg/pull/10478#discussion_r1641082384
##
settings.gradle:
##
@@ -72,6 +72,7 @@ project(':open-api').name = 'iceberg-open-api'
if (null != System.getProperty("allVersions")) {
System.setProperty("fli
findepi commented on code in PR #10474:
URL: https://github.com/apache/iceberg/pull/10474#discussion_r1641073768
##
baseline.gradle:
##
@@ -60,8 +63,7 @@ subprojects {
spotless {
java {
target 'src/main/java/**/*.java', 'src/test/java/**/*.java',
'src/jmh/j
liurenjie1024 commented on issue #405:
URL: https://github.com/apache/iceberg-rust/issues/405#issuecomment-2169283940
> I'm happy to start looking into this one if you like?
Thanks @sdd !
--
This is an automated message from the Apache Git Service.
To respond to the message, please
sdd commented on issue #405:
URL: https://github.com/apache/iceberg-rust/issues/405#issuecomment-2169282092
I'm happy to start looking into this one if you like?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
nastra commented on code in PR #10478:
URL: https://github.com/apache/iceberg/pull/10478#discussion_r1640997638
##
settings.gradle:
##
@@ -72,6 +72,7 @@ project(':open-api').name = 'iceberg-open-api'
if (null != System.getProperty("allVersions")) {
System.setProperty("flin
nastra commented on code in PR #10474:
URL: https://github.com/apache/iceberg/pull/10474#discussion_r1640996276
##
baseline.gradle:
##
@@ -60,8 +63,7 @@ subprojects {
spotless {
java {
target 'src/main/java/**/*.java', 'src/test/java/**/*.java',
'src/jmh/ja
liurenjie1024 commented on issue #244:
URL: https://github.com/apache/iceberg-rust/issues/244#issuecomment-2169270213
Close by #245 . Follow up issued tracked in #405 to make things more clear.
--
This is an automated message from the Apache Git Service.
To respond to the message, please l
liurenjie1024 closed issue #244: Read Parquet data file with projection
URL: https://github.com/apache/iceberg-rust/issues/244
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
T
liurenjie1024 commented on issue #145:
URL: https://github.com/apache/iceberg-rust/issues/145#issuecomment-2169253182
Close by #204
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific c
liurenjie1024 closed issue #153: Tracking: Support row filter in table scan.
URL: https://github.com/apache/iceberg-rust/issues/153
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific commen
liurenjie1024 closed issue #145: refactor: Rename `ManifestListEntry`,
`ManifestEntry` to make them more similar to java/python implementation.
URL: https://github.com/apache/iceberg-rust/issues/145
--
This is an automated message from the Apache Git Service.
To respond to the message, please
liurenjie1024 commented on issue #125:
URL: https://github.com/apache/iceberg-rust/issues/125#issuecomment-2169252223
Close by #207
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific c
liurenjie1024 closed issue #125: Enable reading to arrow record batch stream.
URL: https://github.com/apache/iceberg-rust/issues/125
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comme
liurenjie1024 merged PR #404:
URL: https://github.com/apache/iceberg-rust/pull/404
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@ic
liurenjie1024 commented on code in PR #401:
URL: https://github.com/apache/iceberg-rust/pull/401#discussion_r1640919368
##
Cargo.toml:
##
@@ -65,8 +65,8 @@ log = "^0.4"
mockito = "^1"
murmur3 = "0.5.2"
once_cell = "1"
-opendal = "0.46"
-ordered-float = "4.0.0"
+opendal = { ve
sdd commented on code in PR #404:
URL: https://github.com/apache/iceberg-rust/pull/404#discussion_r1640927249
##
crates/iceberg/src/arrow/reader.rs:
##
@@ -741,42 +742,98 @@ impl<'a> BoundPredicateVisitor for PredicateConverter<'a>
{
fn starts_with(
&mut self,
-
sdd commented on code in PR #404:
URL: https://github.com/apache/iceberg-rust/pull/404#discussion_r1640925156
##
crates/iceberg/src/arrow/reader.rs:
##
@@ -741,42 +742,98 @@ impl<'a> BoundPredicateVisitor for PredicateConverter<'a>
{
fn starts_with(
&mut self,
-
ZENOTME commented on issue #398:
URL: https://github.com/apache/iceberg-rust/issues/398#issuecomment-2169216557
> > > Sorry, I don't quite get what's the meta here?
> >
> >
> > e.g. field_id, predicate. The info that can be shared by the set of
FileScanTasks. Maybe "metadata" is n
liurenjie1024 commented on issue #398:
URL: https://github.com/apache/iceberg-rust/issues/398#issuecomment-2169210628
> > Sorry, I don't quite get what's the meta here?
>
> e.g. field_id, predicate. The info that can be shared by the set of
FileScanTasks. Maybe "metadata" is not preci
liurenjie1024 commented on issue #354:
URL: https://github.com/apache/iceberg-rust/issues/354#issuecomment-2169200194
Close by #380 Thanks @gupteaj
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
liurenjie1024 closed issue #354: Correct names in the ManifestList
URL: https://github.com/apache/iceberg-rust/issues/354
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To uns
liurenjie1024 commented on issue #375:
URL: https://github.com/apache/iceberg-rust/issues/375#issuecomment-2169199161
I think to fix #374, we should decouple two things:
1. Add a setting in metadata reader/writer to deal with current-snapshot-id
2. How to enable the setting, either
ZENOTME commented on issue #398:
URL: https://github.com/apache/iceberg-rust/issues/398#issuecomment-2169198820
> Sorry, I don't quite get what's the meta here?
e.g. field_id, predicate. The info that can be shared by the set of
FileScanTasks. Maybe "metadata" is not precise here.
-
liurenjie1024 commented on issue #398:
URL: https://github.com/apache/iceberg-rust/issues/398#issuecomment-2169196583
Sorry, I don't quite get what's the meta here?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
U
88 matches
Mail list logo
