dependabot[bot] opened a new pull request, #129: URL: https://github.com/apache/iceberg-python/pull/129
Bumps [ray](https://github.com/ray-project/ray) from 2.7.1 to 2.8.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/ray-project/ray/releases";>ray's releases</a>.</em></p> <blockquote> <h2>Ray-2.8.0</h2> <h1>Release Highlights</h1> <p>This release features stability improvements and API clean-ups across the Ray libraries.</p> <ul> <li>In Ray Serve, we are deprecating the previously experimental DAG API for deployment graphs. Model composition will be supported through <a href="https://docs.ray.io/en/latest/serve/model_composition.html";>deployment handles</a> providing more flexibility and stability. The previously deprecated Ray Serve 1.x APIs have also been removed. We’ve also added a new Java APIs that aligns with the Ray Serve 2.x APIs. More API changes in the release notes below.</li> <li>In RLlib, we’ve moved 24 algorithms into <code>rllib_contrib</code> (still available within RLlib for Ray 2.8).</li> <li>We’ve added support for PyTorch-compatible input files shuffling for Ray Data. This allows users to randomly shuffle input files for better model training accuracy. This release also features new Ray Data datasources for Databricks and BigQuery.</li> <li>On the Ray Dashboard, we’ve added new metrics for Ray Data in the Metrics tab. This allows users to monitor Ray Data workload including real time metrics of cluster memory, CPU, GPU, output data size, etc. See <a href="https://docs.ray.io/en/master/data/performance-tips.html#monitoring-your-application";>the doc</a> for more details.</li> <li>Ray Core now supports profiling GPU tasks or actors using Nvidia Nsight. See <a href="https://docs.ray.io/en/master/ray-observability/user-guides/profiling.html?highlight=nsight#nsight-system-profiler";>the documentation</a> for instructions.</li> <li>We fixed 2 critical bugs raised by many kuberay / ML library users, including a child process leak issue from Ray worker that leaks the GPU memory (<a href="https://redirect.github.com/ray-project/ray/issues/40182";>#40182</a>) and an job page excessive loading time issue when Ray HA cluster restarts a head node (<a href="https://redirect.github.com/ray-project/ray/issues/40742";>#40742</a>)</li> <li>Python 3.7 support is officially deprecated from Ray.</li> </ul> <h1>Ray Libraries</h1> <h2>Ray Data</h2> <p>🎉 New Features:</p> <ul> <li>Add support for shuffling input files (<a href="https://redirect.github.com/ray-project/ray/issues/40154";>#40154</a>)</li> <li>Support streaming read of PyTorch dataset (<a href="https://redirect.github.com/ray-project/ray/issues/39554";>#39554</a>)</li> <li>Add BigQuery datasource (<a href="https://redirect.github.com/ray-project/ray/issues/37380";>#37380</a>)</li> <li>Add Databricks table / SQL datasource (<a href="https://redirect.github.com/ray-project/ray/issues/39852";>#39852</a>)</li> <li>Add inverse transform functionality to LabelEncoder (<a href="https://redirect.github.com/ray-project/ray/issues/37785";>#37785</a>)</li> <li>Add function arg params to <code>Dataset.map</code> and <code>Dataset.flat_map</code> (<a href="https://redirect.github.com/ray-project/ray/issues/40010";>#40010</a>)</li> </ul> <p>💫Enhancements:</p> <ul> <li>Hard deprecate <code>DatasetPipeline</code> (<a href="https://redirect.github.com/ray-project/ray/issues/40129";>#40129</a>)</li> <li>Remove <code>BulkExecutor</code> code path (<a href="https://redirect.github.com/ray-project/ray/issues/40200";>#40200</a>)</li> <li>Deprecate extraneous <code>Dataset</code> parameters and methods (<a href="https://redirect.github.com/ray-project/ray/issues/40385";>#40385</a>)</li> <li>Remove legacy iteration code path (<a href="https://redirect.github.com/ray-project/ray/issues/40013";>#40013</a>)</li> <li>Implement streaming output backpressure (<a href="https://redirect.github.com/ray-project/ray/issues/40387";>#40387</a>)</li> <li>Cap op concurrency with exponential ramp-up (<a href="https://redirect.github.com/ray-project/ray/issues/40275";>#40275</a>)</li> <li>Store ray dashboard metrics in <code>_StatsActor</code> (<a href="https://redirect.github.com/ray-project/ray/issues/40118";>#40118</a>)</li> <li>Slice output blocks to respect target block size (<a href="https://redirect.github.com/ray-project/ray/issues/40248";>#40248</a>)</li> <li>Drop columns before grouping by in <code>Dataset.unique()</code> (<a href="https://redirect.github.com/ray-project/ray/issues/40016";>#40016</a>)</li> <li>Standardize physical operator runtime metrics (<a href="https://redirect.github.com/ray-project/ray/issues/40173";>#40173</a>)</li> <li>Estimate blocks for limit and union operator (<a href="https://redirect.github.com/ray-project/ray/issues/40072";>#40072</a>)</li> <li>Store bytes spilled/restored after plan execution (<a href="https://redirect.github.com/ray-project/ray/issues/39361";>#39361</a>)</li> <li>Optimize <code>sample_boundaries</code> in <code>SortTaskSpec</code> (<a href="https://redirect.github.com/ray-project/ray/issues/39581";>#39581</a>)</li> <li>Optimization to reduce ArrowBlock building time for blocks of size 1 (<a href="https://redirect.github.com/ray-project/ray/issues/38833";>#38833</a>)</li> </ul> <p>🔨 Fixes:</p> <ul> <li>Fix bug where <code>_StatsActor</code> errors with <code>PandasBlock</code> (<a href="https://redirect.github.com/ray-project/ray/issues/40481";>#40481</a>)</li> <li>Remove deprecated <code>do_write</code> (<a href="https://redirect.github.com/ray-project/ray/issues/40422";>#40422</a>)</li> <li>Improve error message when reading HTTP files (<a href="https://redirect.github.com/ray-project/ray/issues/40462";>#40462</a>)</li> <li>Add flag to skip <code>get_object_locations</code> for metrics (<a href="https://redirect.github.com/ray-project/ray/issues/39884";>#39884</a>)</li> <li>Fall back to fetch files info in parallel for multiple directories (<a href="https://redirect.github.com/ray-project/ray/issues/39592";>#39592</a>)</li> <li>Replace deprecated <code>.pieces</code> with updated <code>.fragments</code> (<a href="https://redirect.github.com/ray-project/ray/issues/39523";>#39523</a>)</li> <li>Backwards compatibility for <code>Preprocessor</code> that have been fit in older versions (<a href="https://redirect.github.com/ray-project/ray/issues/39173";>#39173</a>)</li> <li>Removing unnecessary data copy in <code>convert_udf_returns_to_numpy</code> (<a href="https://redirect.github.com/ray-project/ray/issues/39188";>#39188</a>)</li> <li>Do not eagerly free root <code>RefBundles</code> (<a href="https://redirect.github.com/ray-project/ray/issues/39016";>#39016</a>)</li> </ul> <p>📖Documentation:</p> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/ray-project/ray/commit/dd270c86feaf3b342014f20c3f7559a6e4cb4272";><code>dd270c8</code></a> [Doc][KubeRay] Add a doc for RayService high-availability (<a href="https://redirect.github.com/ray-project/ray/issues/40672";>#40672</a>) (<a href="https://redirect.github.com/ray-project/ray/issues/40870";>#40870</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/d7dcc7a705261f661dd71664ef882b4bc651f77a";><code>d7dcc7a</code></a> [Doc][KubeRay] Doc for Helm chart RBAC (<a href="https://redirect.github.com/ray-project/ray/issues/40360";>#40360</a>) (<a href="https://redirect.github.com/ray-project/ray/issues/40871";>#40871</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/105355bd253d6538ed34d331f6a4bdf0e38ace3a";><code>105355b</code></a> fix (<a href="https://redirect.github.com/ray-project/ray/issues/40848";>#40848</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/1f8fcac290b54c94277c700a188c8c8d6eb2667d";><code>1f8fcac</code></a> cast size bytes to int (<a href="https://redirect.github.com/ray-project/ray/issues/40820";>#40820</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/e82c801b94e9d3bb4f0efe58c251fc93bddf695a";><code>e82c801</code></a> [data] Revert default block size back to 512MiB (<a href="https://redirect.github.com/ray-project/ray/issues/40765";>#40765</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/60b7b61a29356c2f5b8ae2d9f0c3c899d49588c9";><code>60b7b61</code></a> [docs] fix from Kapa for clipped Ray logo in Ask AI button (<a href="https://redirect.github.com/ray-project/ray/issues/40709";>#40709</a>) (<a href="https://redirect.github.com/ray-project/ray/issues/40728";>#40728</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/e101b41b00721899ab8e1266511049cfd57badc9";><code>e101b41</code></a> [Doc][KubeRay] Upgrade KubeRay and CRD versioning (<a href="https://redirect.github.com/ray-project/ray/issues/40555";>#40555</a>) (<a href="https://redirect.github.com/ray-project/ray/issues/40722";>#40722</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/7dfb173f23efae0d0322778c595b6882150bbb9f";><code>7dfb173</code></a> [GCS FT] Mark job as finished for dead node (<a href="https://redirect.github.com/ray-project/ray/issues/40431";>#40431</a>) (<a href="https://redirect.github.com/ray-project/ray/issues/40742";>#40742</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/c9165eb2a93d6bdfe204c30f51866cc551c88c88";><code>c9165eb</code></a> Revert "[core][dashboard] Task backend GC policy - worker update [1/3] (<a href="https://redirect.github.com/ray-project/ray/issues/387";>#387</a>...</li> <li><a href="https://github.com/ray-project/ray/commit/25fae25cd8c8a58f93239588b4caf7136cd8c406";><code>25fae25</code></a> make submission id show as default over core job id. Fix download logs button...</li> <li>Additional commits viewable in <a href="https://github.com/ray-project/ray/compare/ray-2.7.1...ray-2.8.0";>compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
