abnobdoss commented on code in PR #765:
URL: https://github.com/apache/iceberg-cpp/pull/765#discussion_r3447001471
##########
.github/workflows/aws_test.yml:
##########
@@ -113,11 +115,29 @@ jobs:
if: ${{ matrix.s3 == 'ON' }}
shell: bash
run: bash ci/scripts/start_minio.sh
+ - name: Restore sccache cache
+ uses: actions/cache/restore@27d5ce7f107fe9357f9df03efb73ab90386fccae #
v5.0.5
Review Comment:
Hey @zhjwpku, thank you for the review!
With `SCCACHE_GHA_ENABLED`, sccache uploads each compiled object as its own
cache entry, which adds up to hundreds per build. On the larger Linux/macOS
builds this hits GitHub's upload rate-limit throttle and surfaces as `cache
write errors`. The build still passes when we hit the throttle, but the
affected objects silently don't get cached. Pointing sccache at a local
directory with a single `actions/cache` save/restore turns it into one archive
per leg, so there's nothing to throttle. In my fork that brought write errors
down to zero, and it was a bit faster overall since it uploads once instead of
hundreds of small objects that each take a network round trip.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
