ajantha-bhat commented on issue #10110:
URL: https://github.com/apache/iceberg/issues/10110#issuecomment-2063857060
closing as it was a user error and user confirmed that it worked after
correcting it.
--
This is an automated message from the Apache Git Service.
To respond to the message
ajantha-bhat commented on issue #10110:
URL: https://github.com/apache/iceberg/issues/10110#issuecomment-2049681447
Never mind, it is a Function in static block not one time assignment. So, on
each call, it will create a new `JavaHttpClient`. So, no issue on the older
versions too.
ajantha-bhat commented on issue #10110:
URL: https://github.com/apache/iceberg/issues/10110#issuecomment-2048960308
@dimas-b : catalog created by spark and catalog created by the user is using
the same same `JavaHttpClient` object?
Isn't the culprit is the `Static` class `ImplSwitch
pseudomuto commented on issue #10110:
URL: https://github.com/apache/iceberg/issues/10110#issuecomment-2048599779
Well, that worked like a charm. That is indeed the issue. I can't thank you
guys enough!
I'd like to give something back for this. Can I take a stab at
https://github.com
pseudomuto commented on issue #10110:
URL: https://github.com/apache/iceberg/issues/10110#issuecomment-2048568071
Hmm...I did notice that when I wrote it. My assumption was that the
SparkActions would be creating tasks that would instantiate their own instance
of the catalog via Spark rathe
dimas-b commented on issue #10110:
URL: https://github.com/apache/iceberg/issues/10110#issuecomment-2048477509
Well, that `try (var catalog = new NessieCatalog()) {...}` block _will_
close the Nessie client associated with the table that is loaded from this
catalog.
I believe the cat
pseudomuto commented on issue #10110:
URL: https://github.com/apache/iceberg/issues/10110#issuecomment-2048366352
Sure thing! I've removed imports and a few things for brevity
```java
private static final String NESSIE_PREFIX = "spark.sql.catalog.nessie.";
Table getTable(Stri
pseudomuto commented on issue #10110:
URL: https://github.com/apache/iceberg/issues/10110#issuecomment-2047986951
Just tried with matching server version (0.78.0). Same result unfortunately.
```
java.lang.NullPointerException: Cannot invoke
"java.net.http.HttpClient.send(java.net.h
dimas-b commented on issue #10110:
URL: https://github.com/apache/iceberg/issues/10110#issuecomment-2047816727
In non-oauth2 modes, there's no log message on closing the client,
unfortunately.
--
This is an automated message from the Apache Git Service.
To respond to the message, please l
pseudomuto commented on issue #10110:
URL: https://github.com/apache/iceberg/issues/10110#issuecomment-2047655639
> These settings are not needed on the client (engine) side.
We have Nessie running behind IAP in Google and the auth token is added to
the spark properties before the cod
dimas-b commented on issue #10110:
URL: https://github.com/apache/iceberg/issues/10110#issuecomment-2047587036
Side note @pseudomuto :
>
spark.sql.catalog.nessie.quarkus.oidc.auth-server-url=https://accounts.google.com
> spark.sql.catalog.nessie.quarkus.oidc.client-id=
These
dimas-b commented on issue #10110:
URL: https://github.com/apache/iceberg/issues/10110#issuecomment-2047483276
Not sure it is critical in this case, but Iceberg 1.4.3
[includes](https://github.com/apache/iceberg/blob/apache-iceberg-1.4.3/gradle/libs.versions.toml#L50)
Nessie Client 0.71.0,
ajantha-bhat commented on issue #10110:
URL: https://github.com/apache/iceberg/issues/10110#issuecomment-2047147156
I couldn't locally reproduce it. Can you share the detailed log? Maybe there
is some clue.
--
This is an automated message from the Apache Git Service.
To respond to the me
ajantha-bhat commented on issue #10110:
URL: https://github.com/apache/iceberg/issues/10110#issuecomment-2046317631
Ideally we should use the same version. Can you try once with the same
version?
This NPE (that too in a debug log) is little odd to me (never seen before).
Nessie does
pseudomuto commented on issue #10110:
URL: https://github.com/apache/iceberg/issues/10110#issuecomment-2046306547
In case it's relevant, the spark extensions jar is version 0.78.0 (Iceberg
1.4.3)
--
This is an automated message from the Apache Git Service.
To respond to the message, pleas
pseudomuto commented on issue #10110:
URL: https://github.com/apache/iceberg/issues/10110#issuecomment-2046298594
Hey @ajantha-bhat! I'm running 0.76.3 deployed with the Helm chart
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitH
ajantha-bhat commented on issue #10110:
URL: https://github.com/apache/iceberg/issues/10110#issuecomment-2046290081
@pseudomuto: Which version of the Nessie server are you using and how it is
deployed?
--
This is an automated message from the Apache Git Service.
To respond to the messag
amogh-jahagirdar commented on issue #10110:
URL: https://github.com/apache/iceberg/issues/10110#issuecomment-2046273223
@ajantha-bhat @jbonofre Would you be able to help out on this issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log o
pseudomuto opened a new issue, #10110:
URL: https://github.com/apache/iceberg/issues/10110
### Apache Iceberg version
1.4.3
### Query engine
Spark
### Please describe the bug 🐞
I'm having trouble running the RewriteDataFiles action in Spark. I have a
table
19 matches
Mail list logo
