ebehrendt opened a new pull request #1195: SOLR-13101: Log accurate file counts for Push and Pull and CorePushPull URL: https://github.com/apache/lucene-solr/pull/1195 # Description Number of files and bytes pushed/pulled are logged when pushing to or pulling from blobstore, but values are only accurate when operation is successful. Log expected and actual file count, actual byte count, and add back boolean for whether operation was successful. # Solution Count number of files/bytes actually transferred # Tests Ran ant test, and working on adding additional unit tests. Logline for successful push: `PushPullData=[collectionName=gettingstarted shardName=shard1 sharedStoreName=gettingstarted_shard1 coreName=gettingstarted_shard1_replica_s1] action=PUSH storageProvider=LOCAL_FILE_SYSTEM bucketRegion=N/A bucketName=N/A runTime=44325264 startLatency=44325264 bytesTransferred=2076 attempt=0 expectedFilesAffected=10 actualFilesAffected=10 isSuccessful=true localGeneration=2 blobGeneration=-1 ` Logline for successful pull: `PushPullData=[collectionName=pulltest2 shardName=shard2 sharedStoreName=pulltest2_shard2 coreName=pulltest2_shard2_replica_s6] action=PULL storageProvider=LOCAL_FILE_SYSTEM bucketRegion=N/A bucketName=N/A runTime=70088178 startLatency=70090032 bytesTransferred=9828 attempt=0 expectedFilesAffected=46 actualFilesAffected=46 isSuccessful=true localGeneration=1 blobGeneration=6` Logline for exception thrown partway through push: `PushPullData=[collectionName=gettingstarted shardName=shard1 sharedStoreName=gettingstarted_shard1 coreName=gettingstarted_shard1_replica_s1] action=PUSH storageProvider=LOCAL_FILE_SYSTEM bucketRegion=N/A bucketName=N/A runTime=6363713 startLatency=6363713 bytesTransferred=1132 attempt=0 expectedFilesAffected=10 actualFilesAffected=6 isSuccessful=false localGeneration=2 blobGeneration=-1` Logline for exception thrown partway through pull: `PushPullData=[collectionName=pulltest2 shardName=shard1 sharedStoreName=pulltest2_shard1 coreName=pulltest2_shard1_replica_s1] action=PULL storageProvider=LOCAL_FILE_SYSTEM bucketRegion=N/A bucketName=N/A runTime=9548098 startLatency=9548350 bytesTransferred=1404 attempt=0 expectedFilesAffected=19 actualFilesAffected=6 isSuccessful=false localGeneration=1 blobGeneration=3`
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org
