commits  

Messages by Thread

• (spark) branch master updated (10b27f3a5ad9 -> 6c9e7503f3ac) dongjoon
• (spark) branch master updated (10c634fe8cc4 -> 2844705f4885) wenchen
• (spark) branch branch-4.0 updated: [SPARK-53539][INFRA][4.0] Add `libwebp-dev` to recover `spark-rm/Dockerfile` building dongjoon
• (spark-connect-go) branch dependabot/go_modules/google.golang.org/protobuf-1.36.8 deleted (was 003249b) github-bot
• (spark-connect-go) branch dependabot/go_modules/google.golang.org/grpc-1.75.1 created (now 4f9c24b) github-bot
• (spark) branch master updated: [SPARK-53572][SQL] Avoid throwing from ExtractValue.isExtractable wenchen
• (spark) branch master updated: [SPARK-53574] Fix AnalysisContext being wiped during nested plan resolution wenchen
• (spark) branch master updated: [SPARK-53361][SS][1/2] Optimizing JVM–Python Communication in TWS by Grouping Multiple Keys into One Arrow Batch kabhwan
• (spark) branch master updated (ce94cb3132f9 -> fbdad297f542) wenchen
• (spark) branch master updated (9bd844b87c84 -> ce94cb3132f9) wenchen
• (spark) branch master updated: [SPARK-53558][SQL] Show fully qualified table name including the catalog name in the exception message when the table is not found wenchen
• (spark) branch branch-3.5 updated: [SPARK-53518][SQL][3.5] No truncation for catalogString of User Defined Type yao
• (spark) branch branch-4.0 updated: [SPARK-53524][CONNECT][SQL][4.0] Fix temporal value conversion in LiteralValueProtoConverter wenchen
• (spark) branch master updated: [SPARK-53553][CONNECT] Fix handling of null values in LiteralValueProtoConverter wenchen
• (spark) branch master updated: [SPARK-43579][PYTHON] optim: Cache the converter between Arrow and pandas for reuse gurwls223
• (spark) branch master updated: [SPARK-53568][CONNECT][PYTHON] Fix several small bugs in Spark Connect Python client error handling logic gurwls223
• (spark) branch master updated: [SPARK-53563][PS] Optimize: sql_processor by avoiding inefficient string concatenation gurwls223
• (spark) branch master updated: [SPARK-53182][PYTHON][DOCS] Fix broken and missing links in PySpark DataFrames user guide gurwls223
• (spark) branch master updated: [SPARK-53544][PYTHON] Support complex types on observations gurwls223
• (spark-connect-swift) branch main updated: [SPARK-53571] Add `integration-test-mac-spark4-iceberg` GitHub Action job dongjoon
• (spark) branch master updated: [SPARK-53521] Refactor Star expression wenchen
• (spark) branch master updated: [SPARK-53537][CORE] Adding Support for Parsing CONTINUE HANDLER wenchen
• (spark) branch master updated: [SPARK-53444][SQL] Rework execute immediate wenchen
• (spark-connect-swift) branch main updated: [SPARK-53570] Update `integration-test-token` to use Spark `4.1.0-preview1` dongjoon
• (spark-connect-swift) branch main updated: [SPARK-53569] Use `Iceberg` 1.10 for `Spark 3`-based Iceberg integration test dongjoon
• (spark) branch master updated: [SPARK-53523][SQL] Named parameters respect `spark.sql.caseSensitive` dongjoon
• (spark-kubernetes-operator) branch main updated: [SPARK-53545] Enforce style check at project level for operator ptoth
• (spark) branch master updated (19735de5b46e -> f210e979f017) dongjoon
• (spark) branch master updated: [SPARK-53550][SQL][FOLLOWUP] Union output partitioning should compare canonicalized attributes viirya
• (spark) branch master updated: [SPARK-53491][SS] Fix exponential formatting of inputRowsPerSecond and processedRowsPerSecond in progress metrics JSON kabhwan
• [PR] Update `.asf.yaml` with new `README.md` link [spark-website] via GitHub
  • Re: [PR] Update `.asf.yaml` with new `README.md` link [spark-website] via GitHub
  • Re: [PR] Update `.asf.yaml` with new `README.md` link [spark-website] via GitHub
  • Re: [PR] Update `.asf.yaml` with new `README.md` link [spark-website] via GitHub
• (spark) branch master updated: [SPARK-52449][CONNECT][PYTHON][ML] Make datatypes for Expression.Literal.Map/Array optional ruifengz
• (spark) branch branch-4.0 updated (b92662194f32 -> aaa7fb3a675c) dongjoon
• (spark) branch master updated: [SPARK-53399][SQL] Merge Python UDFs ptoth
• (spark) branch master updated (29626507fa02 -> faa1aaa64f49) dongjoon
• (spark) branch master updated (07d987a0cc6e -> 1dab449da5c8) dongjoon
• (spark) branch master updated (faa1aaa64f49 -> 07d987a0cc6e) dongjoon
• (spark) branch master updated (f465eca7e954 -> 29626507fa02) yao
• (spark) branch master updated: [SPARK-53561][SS] Catch Interruption Exception in TransformWithStateInPySparkStateServer during outputStream.flush to avoid the worker crash ashrigondekar
• (spark) branch branch-4.0 updated: [SPARK-53538][SQL][4.0] `ExpandExec` should initialize the unsafe projections dongjoon
• (spark) branch branch-3.5 updated: [SPARK-53557][INFRA] Reduce automated vote email deadline from 4 days to 73 hours dongjoon
• (spark) branch branch-4.0 updated: [SPARK-53557][INFRA] Reduce automated vote email deadline from 4 days to 73 hours dongjoon
• (spark) branch master updated: [SPARK-53557][INFRA] Reduce automated vote email deadline from 4 days to 73 hours dongjoon
• (spark) branch master updated (b9848ac61a71 -> 4575b1da9e1d) ashrigondekar
• (spark) branch master updated (bb41e19ae9ee -> f90333d109ba) ashrigondekar
• (spark) branch master updated: [SPARK-53525][CONNECT] Spark Connect ArrowBatch Result Chunking hvanhovell
• (spark) branch master updated (d0177795bbbe -> 1817e676f1b7) wenchen
• (spark) branch branch-4.0 updated: [SPARK-53434][SQL][4.0] ColumnarRow's get should also check isNullAt wenchen
• (spark) branch master updated: [MINOR][PYTHON][TESTS] Skip some tests if numpy not installed ruifengz
• (spark) branch master updated: [SPARK-53512][SQL] Better unification of DSv2 PushDownUtils gengliang
• (spark) branch master updated: [SPARK-52238][SDP] Rename Pipeline Spec Field "definitions" to 'libraries' wenchen
• (spark) branch master updated: [SPARK-53029][FOLLOWUP] Update PyArrow StructType usage to avoid .names attribute for compatibility with PyArrow gurwls223
• (spark) branch master updated: [SPARK-53541][K8S][INFRA] Update K8s IT CI to use K8s 1.34 yangjie01
• (spark) branch master updated: [SPARK-53531][CORE] Better error message for HadoopRDD.getInputFormat yangjie01
• (spark) branch branch-3.5 updated (195d81b42142 -> 7ab7b7cde154) yangjie01
• (spark) branch master updated: [SPARK-53530][SS] Clean up the useless code related to `TransformWithStateInPySparkStateServer` yangjie01
• (spark) branch master updated: [SPARK-51756][CORE] Computes RowBasedChecksum in ShuffleWriters mridulm80
• (spark) branch master updated (e75ca577923f -> 19c271f10e98) gurwls223
• (spark) branch master updated (be5d367ff234 -> e75ca577923f) ruifengz
• (spark-kubernetes-operator) branch main updated: [SPARK-53542] Update CI to test K8s 1.34 dongjoon
• (spark) branch master updated (19912f85b8a5 -> be5d367ff234) dongjoon
• (spark) branch master updated (f210e979f017 -> 19912f85b8a5) dongjoon
• (spark) branch master updated: [SPARK-53506][PS] Disallow `%` between Decimal and float under ANSI ruifengz
• (spark-website) branch asf-site updated: Update `GraphX` menu according to the deprecation (#629) dongjoon
• (spark) branch master updated: [SPARK-53534][PYTHON][TESTS] Add tests for arrow udf with numpy output dongjoon
• (spark) branch branch-4.0 updated: [SPARK-48163][CONNECT][TESTS][4.0] Fix flaky tests in `SparkConnectServiceSuite` which are caused by `executorHolder` undefined dongjoon
• (spark) branch master updated (1d09e5a470ff -> 50ce752a57ae) wenchen
• (spark) branch branch-4.0 updated: [SPARK-53527][SQL] Improve fallback of analyzeExistenceDefaultValue wenchen
• (spark-website) branch asf-site updated: Update `Gemfile` to allow Ruby 3.0+ explicitly (#628) dongjoon
• (spark) branch master updated (b633ad30ac84 -> d16e92de0a3a) ueshin
• [PR] Update `Gemfile` to allow Ruby 3.0+ explicitly [spark-website] via GitHub
  • Re: [PR] Update `Gemfile` to allow Ruby 3.0+ explicitly [spark-website] via GitHub
  • Re: [PR] Update `Gemfile` to allow Ruby 3.0+ explicitly [spark-website] via GitHub
  • Re: [PR] Update `Gemfile` to allow Ruby 3.0+ explicitly [spark-website] via GitHub
  • Re: [PR] Update `Gemfile` to allow Ruby 3.0+ explicitly [spark-website] via GitHub
  • Re: [PR] Update `Gemfile` to allow Ruby 3.0+ explicitly [spark-website] via GitHub
• (spark-kubernetes-operator) branch gh-pages updated: Use Apache Spark 4.0.1 instead of 4.0.0 dongjoon
• (spark) branch master updated (cd6f63042461 -> 90ef38960586) wenchen
• (spark) branch master updated: [SPARK-53518][SQL] No truncation for catalogString of User Defined Type dongjoon
• [PR] Make versioning-policy up-to-date with Spark 4.1.0 [spark-website] via GitHub
  • Re: [PR] Make versioning-policy up-to-date with Spark 4.1.0 [spark-website] via GitHub
  • Re: [PR] Make versioning-policy up-to-date with Spark 4.1.0 [spark-website] via GitHub
• [PR] Remove duplicated files [spark-website] via GitHub
  • Re: [PR] Remove duplicated files [spark-website] via GitHub
  • Re: [PR] Remove duplicated files [spark-website] via GitHub
  • Re: [PR] Remove duplicated files [spark-website] via GitHub
  • Re: [PR] Remove duplicated files [spark-website] via GitHub
  • Re: [PR] Remove duplicated files [spark-website] via GitHub
  • Re: [PR] Remove duplicated files [spark-website] via GitHub
  • Re: [PR] Remove duplicated files [spark-website] via GitHub
  • Re: [PR] Remove duplicated files [spark-website] via GitHub
  • Re: [PR] Remove duplicated files [spark-website] via GitHub
  • Re: [PR] Remove duplicated files [spark-website] via GitHub
  • Re: [PR] Remove duplicated files [spark-website] via GitHub
• (spark) branch master updated: [SPARK-48163][CONNECT][TESTS] Fix flaky tests in `SparkConnectServiceSuite` which are caused by `executorHolder` undefined dongjoon
• (spark) branch branch-4.0 updated (043819a9bd4d -> b92662194f32) sarutak
• (spark-connect-go) branch dependabot/go_modules/golang.org/x/oauth2-0.31.0 created (now f00712e) github-bot
• (spark-connect-go) branch dependabot/go_modules/github.com/apache/arrow-go/v18-18.4.1 created (now 56cd92b) github-bot
• (spark) branch master updated: [SPARK-53489][SQL] Remove using `v2ColumnsToStructType` in `ApplyDefaultCollationToStringType` wenchen
• (spark) branch master updated (af16aa8e11c2 -> 6f51e04dcd7f) gurwls223
• (spark) branch branch-4.0 updated: [SPARK-53505][CONNECT] Try the eager analysis first for withColumns and withColumnsRenamed in Spark Connect wenchen
• (spark) branch master updated (90ef38960586 -> c247483480d3) wenchen
• (spark) branch master updated: [SPARK-52745][SQL][FOLLOWUP] Allow the absense of exists default wenchen
• (spark) branch master updated (6f51e04dcd7f -> 3ad04e36e3ea) gurwls223
• (spark) branch master updated (ab9a63626018 -> af16aa8e11c2) ruifengz
• (spark) branch master updated: [SPARK-53514][DOCS] Update `Gemfile` to allow Ruby 3.0+ explicitly dongjoon
• (spark-kubernetes-operator) branch main updated: [SPARK-53511] Make `examples` directory up-to-date with Spark 4.0.1 dongjoon
• (spark) branch master updated (254beec342f4 -> 0dc38b02f4a7) ruifengz
• (spark-kubernetes-operator) branch main updated: [SPARK-53513] Update `YuniKorn` docs with `1.7.0` dongjoon
• (spark) branch master updated (d9a23c2f447f -> 254beec342f4) dongjoon
• (spark) branch master updated: [SPARK-53474][SQL] Add conf DATA_SOURCE_V2_EXPR_FOLDING wenchen
• [PR] Add Spark 4.0.1 docs [spark-website] via GitHub
  • Re: [PR] Add Spark 4.0.1 docs [spark-website] via GitHub
  • Re: [PR] Add Spark 4.0.1 docs [spark-website] via GitHub
• (spark-kubernetes-operator) branch main updated: [SPARK-53405] Add metrics recording for latency of Spark app state transition ptoth
• (spark) branch master updated: [SPARK-50785][SQL][FOLLOWUP] Remove overrideIfExists check in SqlScriptingLocalVariableManager wenchen
• (spark) branch master updated (061bbebb811c -> f2ede1846915) ruifengz
• (spark) branch master updated: [SPARK-53500][PYTHON][TESTS] Make `test_unpivot` deterministic ruifengz
• (spark) branch master updated: [SPARK-53470][SQL] ExtractValue expressions should always do type checking wenchen
• (spark) branch master updated: [SPARK-53499][PYTHON] from_arrow_type should respect containsNull in ArrayType ruifengz
• (spark) branch master updated (fb7719869666 -> 61ba323fc277) ruifengz
• (spark-kubernetes-operator) branch main updated: [SPARK-53510] Update `SparkClusterResourceSpec` to use `apache/spark:4.0.1` as the default value of container image dongjoon
• [PR] Add 4.0.1 news [spark-website] via GitHub
  • Re: [PR] Add 4.0.1 news [spark-website] via GitHub
  • Re: [PR] Add 4.0.1 news [spark-website] via GitHub
  • Re: [PR] Add 4.0.1 news [spark-website] via GitHub
  • Re: [PR] Add 4.0.1 news [spark-website] via GitHub
  • Re: [PR] Add 4.0.1 news [spark-website] via GitHub
• (spark-connect-swift) branch main updated: [SPARK-53466] Use Spark `4.0.1` instead of `4.0.0` dongjoon
• (spark) branch master updated: [SPARK-50888][CONNECT][TESTS] Remove flaky assertion from `SparkConnectServiceSuite` dongjoon
• (spark-docker) branch master updated: [SPARK-53509] Publish Apache Spark 4.0.1 to docker registry (#93) dongjoon
• (spark) branch master updated: [SPARK-53458][INFRA] Add daily dry-run release test GitHub Action jobs for Spark 4.0/3.5 dongjoon
• (spark-connect-swift) branch main updated: [SPARK-53477] Add `integration-test-ubuntu-spark41` GitHub Action job dongjoon
• (spark-kubernetes-operator) branch main updated: [SPARK-53508] Upgrade Spark to 4.0.1 dongjoon
• svn commit: r79096 - dev/spark/v4.0.1-rc1-docs/_site release/spark/docs/4.0.1 dongjoon
• (spark) tag v4.0.1 created (now 29434ea766b0) dongjoon
• svn commit: r79097 - dev/spark/v4.0.1-rc1-docs dongjoon
• svn commit: r79095 - dev/spark/v4.0.1-rc1-bin release/spark/spark-4.0.1 dongjoon
• (spark) branch master updated (1043d53b62bd -> e45ddd17242d) xinrong
• (spark-kubernetes-operator) branch main updated: [SPARK-53495] Remove unused 'persistentVolume' access from operator rbac ptoth
• (spark) branch master updated: [SPARK-53481][PYTHON] Make Hybrid queue class ruifengz
• (spark-website) branch asf-site updated: Add the instruction of using GitHub Actions to make a release gurwls223
• (spark) branch master updated: [SPARK-53441][PS] Bools `|`/`&`/`^` None should fail under ANSI xinrong
• (spark) branch master updated: [SPARK-53496][SQL][CORE][ML][SS][K8S][YARN] Remove dangling right curly braces in log dongjoon
• (spark) branch master updated: [SPARK-53485][DOCS][SECURITY] Add Proxy User Instructions dongjoon
• (spark) branch master updated: [SPARK-52431][SDP][TESTS][FOLLOWUP] Remove unused scalatest Matchers from SparkPipelinesSuite dongjoon
• (spark) branch master updated (fcaeb6358892 -> 241f92ec527a) dongjoon
• (spark-kubernetes-operator) branch main updated: [SPARK-53493] Add `pi-preview.yaml` example dongjoon
• (spark) branch master updated: [SPARK-53487][SQL] Improve comments in `NormalizePlan.scala` dtenedor
• (spark) branch master updated (b01747341918 -> 60d2078c6b07) ruifengz
• (spark) branch master updated: [SPARK-49386][CORE][SQL][FOLLOWUP] More accurate memory tracking for memory based spill threshold wuyi
• (spark) branch branch-3.5 updated: [SPARK-53472][DOCS] Fix jekyll-redirect-from template and generated html files yao
• [PR] Add the instruction of using GitHub Actions to make a release [spark-website] via GitHub
  • Re: [PR] Add the instruction of using GitHub Actions to make a release [spark-website] via GitHub
  • Re: [PR] Add the instruction of using GitHub Actions to make a release [spark-website] via GitHub
  • Re: [PR] Add the instruction of using GitHub Actions to make a release [spark-website] via GitHub
• (spark) branch master updated: [SPARK-53420][BUILD] Upgrade Parquet to 1.16.0 dongjoon
• (spark) branch master updated (eea976727b33 -> 76352046c890) yao
• (spark) branch branch-4.0 updated: [SPARK-53472][DOCS] Fix jekyll-redirect-from template and generated html files yao
• (spark) branch master updated: [MINOR][DOCS] Update comments for ResolveCoalesceHints gurwls223
• (spark) branch master updated: [SPARK-53459][CORE] Use ReadOnlySparkConf in more places wenchen
• (spark-docker) branch master updated: [SPARK-53475] Use `setup-minikube` in `spark-docker` repository (#92) dongjoon
• (spark-docker) branch master updated: [SPARK-53473] Publish Apache Spark 4.1.0-preview1 to docker registry (#91) dongjoon
• (spark) branch master updated: [SPARK-53401][SQL] Enable Direct Passthrough Partitioning in the DataFrame API wenchen
• (spark) branch master updated (7f5db0c1c557 -> fbbc5509bbfe) gurwls223
• (spark-kubernetes-operator) branch main updated: [SPARK-53325] Support Prometheus 2.0 text-based-format and best practices for metrics naming ptoth
• (spark-kubernetes-operator) branch main updated: [SPARK-53430] Prevent unintended JSON serialization with @JsonIgnore ptoth
• (spark) branch master updated: [SPARK-53433][TESTS][FOLLOW-UP] Make the test compatible with PyArrow 15.0.0 gurwls223
• (spark) branch branch-4.0 updated (f1d020ae5160 -> 7f4002f78ed5) dongjoon
  • (spark) 01/02: Revert "Removing test jars and class files" dongjoon
  • (spark) 02/02: Preparing development version 4.0.2-SNAPSHOT dongjoon
• (spark) branch master updated: [SPARK-52346][SDP] Propagate partition columns from destination for BatchTableWrite gengliang
• (spark) branch master updated (916a779a8d46 -> 166895a9a073) yao
• (spark) branch master updated (9ada1e7e68db -> 8c8c96641ce6) dongjoon
• (spark) branch branch-4.0 updated: [MINOR][BUILD] Remove `preview` postfix in documentation.md when releasing gurwls223
• (spark) branch master updated (6476dbc92afa -> fb22d371f0dd) gurwls223
• (spark) branch branch-4.0 updated: [MINOR][BUILD] Fix download of preview releases in the news gurwls223
• (spark) branch master updated: [SPARK-52346][SDP] Fix counter initialization and increment logic for flow retries gengliang
• (spark-kubernetes-operator) branch main updated: [SPARK-53468] Update `setup-minikube` to v0.0.20 dongjoon
• (spark) branch master updated: [SPARK-53207][SDP] Send Pipeline Event to Client Asynchronously gengliang
• (spark) branch master updated: [SPARK-53417][PYTHON][TESTS][FOLLOW-UP] Add more tests for aggregation and window gurwls223
• (spark-connect-swift) branch main updated: [SPARK-53467] Improve `merge_spark_pr.py` to accept PR numbers as a CLI argument dongjoon
• svn commit: r78974 - dev/spark/v3.5.6-rc1-docs dongjoon
• (spark-connect-go) branch dependabot/go_modules/github.com/stretchr/testify-1.11.0 deleted (was 528ce2c) github-bot
• svn commit: r79002 - release/spark gurwls223
• (spark) branch r0DK6b6xRWqc5bnV deleted (was bc36a7db43f2) gurwls223
• (spark-connect-swift) branch main updated: [SPARK-53465] Use `4.1.0-preview1` instead of `RC1` dongjoon
• (spark) branch master updated (41c43466db5c -> 6ec533ca3e37) dongjoon
• (spark) branch master updated: [SPARK-53464][K8S][INFRA] Update `setup-minikube` to v0.0.20 dongjoon
• (spark) branch branch-4.0 updated: [MINOR][BUILD] Remove todos for testing in the real releases gurwls223
• (spark) branch branch-3.5 updated: [MINOR][BUILD] Remove `preview` postfix in documentation.md when releasing gurwls223
• (spark) branch master updated (fb22d371f0dd -> 41c43466db5c) gurwls223
• (spark) branch branch-3.5 updated: [MINOR][BUILD] Remove todos for testing in the real releases gurwls223
• (spark) branch branch-3.5 updated: [MINOR][BUILD] Fix download of preview releases in the news gurwls223
• (spark) branch master updated: [MINOR][BUILD] Fix download of preview releases in the news gurwls223
• (spark-website) branch asf-site updated: Fix typos in release docs for Apache Spark 4.1.0-preview1 gurwls223
• svn commit: r79003 - dev/spark/v4.1.0-preview1-rc1-docs gurwls223

• Earlier messages
• Later messages