steveloughran commented on PR #15428:
URL: https://github.com/apache/iceberg/pull/15428#issuecomment-3992372880

   FWIW, headers on requests picked up by running some cloudstore commands 
against s3 london, s3a client set to use sse-kms encryption. The bucket is 
versioned so on repeated reads the if-match header would be used to declare the 
version.
   
   ## HEAD /f
   ```
   2026-03-03 16:22:07,956 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "HEAD /f HTTP/1.1[\r][\n]"
   2026-03-03 16:22:07,956 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "Host: stevel-london.s3.eu-west-2.amazonaws.com[\r][\n]"
   2026-03-03 16:22:07,956 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "amz-sdk-invocation-id: 
a31481a9-7186-008d-b3b3-ea125702f45a[\r][\n]"
   2026-03-03 16:22:07,956 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "amz-sdk-request: attempt=1; max=3[\r][\n]"
   2026-03-03 16:22:07,956 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "Authorization: AWS4-HMAC-SHA256 
Credential=AKI............7/20260303/eu-west-2/s3/aws4_request, 
SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;host;referer;x-amz-content-sha256;x-amz-date,
 Signature=1dc......b[\r][\n]"
   2026-03-03 16:22:07,956 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "Referer: 
https://audit.example.org/hadoop/1/op_delete/4022a50f-dd44-4915-b6ec-85c6cb7337c5-00000026/?op=op_delete&p1=s3a://stevel-london/f&pr=stevel&ps=0b35c845-dbf9-4a18-9edd-61469b1f3644&cm=StoreDiag&id=4022a50f-dd44-4915-b6ec-85c6cb7337c5-00000026&t0=1&fs=4022a50f-dd44-4915-b6ec-85c6cb7337c5&t1=1&ts=1772554927951[\r][\n]";
   2026-03-03 16:22:07,957 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "User-Agent: Hadoop 3.4.3 aws-sdk-java/2.35.4 md/io#sync 
md/http#Apache ua/2.1 api/S3#2.35.x os/Mac_OS_X#26.3 lang/java#17.0.17 
md/OpenJDK_64-Bit_Server_VM#17.0.17+10-LTS md/vendor#Amazon.com_Inc. md/en_GB 
m/F,G hll/cross-region[\r][\n]"
   2026-03-03 16:22:07,957 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "x-amz-content-sha256: UNSIGNED-PAYLOAD[\r][\n]"
   2026-03-03 16:22:07,957 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "X-Amz-Date: 20260303T162207Z[\r][\n]"
   2026-03-03 16:22:07,957 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "Connection: Keep-Alive[\r][\n]"
   2026-03-03 16:22:07,957 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "[\r][\n]"
   ```
   
   ## PUT of directory marker (not relevant to s3file IO). adds 
x-amz-server-side-encryption x-amz-server-side-encryption-aws-kms-key-id, 
Content-Length, Content-Type.
   
   
   
   ```
   2026-03-03 16:22:07,852 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "PUT /f/ HTTP/1.1[\r][\n]"
   2026-03-03 16:22:07,852 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "Host: stevel-london.s3.eu-west-2.amazonaws.com[\r][\n]"
   2026-03-03 16:22:07,852 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "amz-sdk-invocation-id: 
8473b1fd-3959-a715-6236-0ed4ac5e4b21[\r][\n]"
   2026-03-03 16:22:07,852 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "amz-sdk-request: attempt=1; max=3[\r][\n]"
   2026-03-03 16:22:07,853 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "Authorization: AWS4-HMAC-SHA256 
Credential=A...7/./eu-west-2/s3/aws4_request, 
SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;content-length;content-type;host;referer;x-amz-content-sha256;x-amz-date;x-amz-server-side-encryption;x-amz-server-side-encryption-aws-kms-key-id,
 Signature=5...44[\r][\n]"
   2026-03-03 16:22:07,853 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "Content-Type: application/x-directory[\r][\n]"
   2026-03-03 16:22:07,853 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "Referer: 
https://audit.example.org/hadoop/1/op_delete/4022a50f-dd44-4915-b6ec-85c6cb7337c5-00000025/?op=op_delete&p1=s3a://stevel-london/f/dir-2cbe3df1-1998-49da-b466-947aae0920f1&pr=stevel&ps=0b35c845-dbf9-4a18-9edd-61469b1f3644&ks=1&cm=StoreDiag&id=4022a50f-dd44-4915-b6ec-85c6cb7337c5-00000025&t0=1&fs=4022a50f-dd44-4915-b6ec-85c6cb7337c5&t1=1&ts=1772554927525[\r][\n]";
   2026-03-03 16:22:07,853 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "User-Agent: Hadoop 3.4.3 aws-sdk-java/2.35.4 md/io#sync 
md/http#Apache ua/2.1 api/S3#2.35.x os/Mac_OS_X#26.3 lang/java#17.0.17 
md/OpenJDK_64-Bit_Server_VM#17.0.17+10-LTS md/vendor#Amazon.com_Inc. md/en_GB 
md/rb#u m/F,G hll/cross-region[\r][\n]"
   2026-03-03 16:22:07,853 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "x-amz-content-sha256: UNSIGNED-PAYLOAD[\r][\n]"
   2026-03-03 16:22:07,853 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "X-Amz-Date: 20260303T162207Z[\r][\n]"
   2026-03-03 16:22:07,853 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "x-amz-server-side-encryption: aws:kms[\r][\n]"
   2026-03-03 16:22:07,855 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "x-amz-server-side-encryption-aws-kms-key-id: 
arn:aws:kms:eu-west-2:152813717728:key/c92f3bc9-ecb1-49d3-a259-9004dbac4443[\r][\n]"
   2026-03-03 16:22:07,856 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "Content-Length: 0[\r][\n]"
   2026-03-03 16:22:07,856 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "Connection: Keep-Alive[\r][\n]"
   2026-03-03 16:22:07,856 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-2 >> "[\r][\n]"
   ```
   
   ## single object DELETE
   ```
   2026-03-03 16:22:07,667 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(133)) - 
http-outgoing-2 >> DELETE /f/dir-2cbe3df1-1998-49da-b466-947aae0920f1/ HTTP/1.1
   2026-03-03 16:22:07,667 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-2 >> Host: stevel-london.s3.eu-west-2.amazonaws.com
   2026-03-03 16:22:07,667 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-2 >> amz-sdk-invocation-id: 92132426-701f-3a48-b96a-cd8bb52ec7a8
   2026-03-03 16:22:07,667 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-2 >> amz-sdk-request: attempt=1; max=3
   2026-03-03 16:22:07,667 [main] DEBUG http.headers 
   2026-03-03 16:22:07,667 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-2 >> Referer: 
https://audit.example.org/hadoop/1/op_delete/4022a50f-dd44-4915-b6ec-85c6cb7337c5-00000025/?op=op_delete&p1=s3a://stevel-london/f/dir-2cbe3df1-1998-49da-b466-947aae0920f1&pr=stevel&ps=0b35c845-dbf9-4a18-9edd-61469b1f3644&ks=1&cm=StoreDiag&id=4022a50f-dd44-4915-b6ec-85c6cb7337c5-00000025&t0=1&fs=4022a50f-dd44-4915-b6ec-85c6cb7337c5&t1=1&ts=1772554927525
   2026-03-03 16:22:07,667 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-2 >> User-Agent: Hadoop 3.4.3 aws-sdk-java/2.35.4 md/io#sync 
md/http#Apache ua/2.1 api/S3#2.35.x os/Mac_OS_X#26.3 lang/java#17.0.17 
md/OpenJDK_64-Bit_Server_VM#17.0.17+10-LTS md/vendor#Amazon.com_Inc. md/en_GB 
m/F,G hll/cross-region
   2026-03-03 16:22:07,667 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-2 >> x-amz-content-sha256: UNSIGNED-PAYLOAD
   2026-03-03 16:22:07,667 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-2 >> X-Amz-Date: 20260303T162207Z
   2026-03-03 16:22:07,667 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-2 >> Connection: Keep-Alive
   ```
   
   
   ## initiate multipart PUT
   ```
   2026-03-03 16:43:01,615 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-0 >> "POST /multipart?uploads HTTP/1.1[\r][\n]"
   2026-03-03 16:43:01,615 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-0 >> "Host: stevel-london.s3.eu-west-2.amazonaws.com[\r][\n]"
   2026-03-03 16:43:01,615 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-0 >> "amz-sdk-invocation-id: 
713e0c15-ffa7-b7c8-cdc3-91644ce93434[\r][\n]"
   2026-03-03 16:43:01,615 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-0 >> "amz-sdk-request: attempt=1; max=3[\r][\n]"
   2026-03-03 16:43:01,615 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-0 >> "Authorization: AWS4-HMAC-SHA256 
Credential=AKIASHFDIJDQPVOFIO47/20260303/eu-west-2/s3/aws4_request, 
SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;content-length;content-type;host;referer;x-amz-content-sha256;x-amz-date;x-amz-meta-headername;x-amz-server-side-encryption;x-amz-server-side-encryption-aws-kms-key-id,
 
Signature=682a8b56055d50b2832ab72f911e0975b4b15b49324ac94dd3e0e2beaa27ff85[\r][\n]"
   2026-03-03 16:43:01,615 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-0 >> "Content-Type: binary/octet-stream[\r][\n]"
   2026-03-03 16:43:01,615 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-0 >> "Referer: 
https://audit.example.org/hadoop/1/op_createfile/16b1c6a1-d5a4-4a6e-849a-21eef332bd6d-00000005/?op=op_createfile&p1=multipart&pr=stevel&ps=0565a125-fb37-4a3d-9115-729515d614fb&cm=Put&id=16b1c6a1-d5a4-4a6e-849a-21eef332bd6d-00000005&t0=1&fs=16b1c6a1-d5a4-4a6e-849a-21eef332bd6d&t1=1&ts=1772556180848[\r][\n]";
   2026-03-03 16:43:01,615 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-0 >> "User-Agent: Hadoop 3.5.0 aws-sdk-java/2.35.4 md/io#sync 
md/http#Apache ua/2.1 api/S3#2.35.x os/Mac_OS_X#26.3 lang/java#17.0.17 
md/OpenJDK_64-Bit_Server_VM#17.0.17+10-LTS md/vendor#Amazon.com_Inc. md/en_GB 
m/F,G hll/cross-region[\r][\n]"
   2026-03-03 16:43:01,615 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-0 >> "x-amz-content-sha256: UNSIGNED-PAYLOAD[\r][\n]"
   2026-03-03 16:43:01,615 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-0 >> "X-Amz-Date: 20260303T164301Z[\r][\n]"
   2026-03-03 16:43:01,615 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-0 >> "x-amz-meta-headername: value[\r][\n]"
   2026-03-03 16:43:01,615 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-0 >> "x-amz-server-side-encryption: aws:kms[\r][\n]"
   2026-03-03 16:43:01,615 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-0 >> "x-amz-server-side-encryption-aws-kms-key-id: 
arn:aws:kms:eu-west-2:152813717728:key/c92f3bc9-ecb1-49d3-a259-9004dbac4443[\r][\n]"
   2026-03-03 16:43:01,615 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-0 >> "Content-Length: 0[\r][\n]"
   2026-03-03 16:43:01,615 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-0 >> "Connection: Keep-Alive[\r][\n]"
   ```
   
   the x-amz-meta-headername is because "headername" is an explicit custom 
header.
   
   ## part
   
   ```
   2026-03-03 16:43:01,807 [s3a-transfer-stevel-london-bounded-pool1-t1] DEBUG 
http.wire (Wire.java:wire(73)) - http-outgoing-0 >> "PUT 
/multipart?partNumber=1&uploadId=1YjxcUi4oeYfKetmEQ5BKuHvy0lJuHVl.2s3N3v97RkzUxXbB4j0KZJXcJlQjTCY8qnAJeFKey2wpuwOwcEWCIf9Mg6srz2TddP.w5KoFTIWuPZrodVDycOz0xHeUysj
 HTTP/1.1[\r][\n]"
   2026-03-03 16:43:01,808 [s3a-transfer-stevel-london-bounded-pool1-t1] DEBUG 
http.wire (Wire.java:wire(73)) - http-outgoing-0 >> "Host: 
stevel-london.s3.eu-west-2.amazonaws.com[\r][\n]"
   2026-03-03 16:43:01,808 [s3a-transfer-stevel-london-bounded-pool1-t1] DEBUG 
http.wire (Wire.java:wire(73)) - http-outgoing-0 >> "amz-sdk-invocation-id: 
20b5c96e-dc4c-1528-cf05-0643832e8fc0[\r][\n]"
   2026-03-03 16:43:01,808 [s3a-transfer-stevel-london-bounded-pool1-t1] DEBUG 
http.wire (Wire.java:wire(73)) - http-outgoing-0 >> "amz-sdk-request: 
attempt=1; max=3[\r][\n]"
   2026-03-03 16:43:01,808 [s3a-transfer-stevel-london-bounded-pool1-t1] DEBUG 
http.wire (Wire.java:wire(73)) - http-outgoing-0 >> "Authorization: 
AWS4-HMAC-SHA256 Credential=st, 
SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;content-length;content-type;host;referer;x-amz-content-sha256;x-amz-date,
 Signature=2...2[\r][\n]"
   2026-03-03 16:43:01,808 [s3a-transfer-stevel-london-bounded-pool1-t1] DEBUG 
http.wire (Wire.java:wire(73)) - http-outgoing-0 >> "Content-Type: 
application/octet-stream[\r][\n]"
   2026-03-03 16:43:01,808 [s3a-transfer-stevel-london-bounded-pool1-t1] DEBUG 
http.wire (Wire.java:wire(73)) - http-outgoing-0 >> "Expect: 
100-continue[\r][\n]"
   2026-03-03 16:43:01,808 [s3a-transfer-stevel-london-bounded-pool1-t1] DEBUG 
http.wire (Wire.java:wire(73)) - http-outgoing-0 >> "Referer: 
https://audit.example.org/hadoop/1/op_createfile/16b1c6a1-d5a4-4a6e-849a-21eef332bd6d-00000005/?op=op_createfile&p1=multipart&pr=stevel&ps=0565a125-fb37-4a3d-9115-729515d614fb&cm=Put&id=16b1c6a1-d5a4-4a6e-849a-21eef332bd6d-00000005&t0=1&fs=16b1c6a1-d5a4-4a6e-849a-21eef332bd6d&t1=24&ts=1772556180848[\r][\n]";
   2026-03-03 16:43:01,810 [s3a-transfer-stevel-london-bounded-pool1-t1] DEBUG 
http.wire (Wire.java:wire(73)) - http-outgoing-0 >> "User-Agent: Hadoop 3.5.0 
aws-sdk-java/2.35.4 md/io#sync md/http#Apache ua/2.1 api/S3#2.35.x 
os/Mac_OS_X#26.3 lang/java#17.0.17 md/OpenJDK_64-Bit_Server_VM#17.0.17+10-LTS 
md/vendor#Amazon.com_Inc. md/en_GB md/rb#u m/F,G hll/cross-region[\r][\n]"
   2026-03-03 16:43:01,810 [s3a-transfer-stevel-london-bounded-pool1-t1] DEBUG 
http.wire (Wire.java:wire(73)) - http-outgoing-0 >> "x-amz-content-sha256: 
UNSIGNED-PAYLOAD[\r][\n]"
   2026-03-03 16:43:01,810 [s3a-transfer-stevel-london-bounded-pool1-t1] DEBUG 
http.wire (Wire.java:wire(73)) - http-outgoing-0 >> "X-Amz-Date: 
20260303T164301Z[\r][\n]"
   2026-03-03 16:43:01,810 [s3a-transfer-stevel-london-bounded-pool1-t1] DEBUG 
http.wire (Wire.java:wire(73)) - http-outgoing-0 >> "Content-Length: 
9201[\r][\n]"
   2026-03-03 16:43:01,810 [s3a-transfer-stevel-london-bounded-pool1-t1] DEBUG 
http.wire (Wire.java:wire(73)) - http-outgoing-0 >> "Connection: 
Keep-Alive[\r][\n]"
   ```
   
   adds Expect: 100-continue, but like Connection: Keep-Alive this is being put 
out on the wire after signing has taken place. The signer doesn't see it, so 
it's not relevant.
   
   ## completion of MPU
   
   ```
   2026-03-03 16:43:01,932 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(133)) - 
http-outgoing-0 >> POST 
/multipart?uploadId=1YjxcUi4oeYfKetmEQ5BKuHvy0lJuHVl.2s3N3v97RkzUxXbB4j0KZJXcJlQjTCY8qnAJeFKey2wpuwOwcEWCIf9Mg6srz2TddP.w5KoFTIWuPZrodVDycOz0xHeUysj
 HTTP/1.1
   2026-03-03 16:43:01,933 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> Host: stevel-london.s3.eu-west-2.amazonaws.com
   2026-03-03 16:43:01,933 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> amz-sdk-invocation-id: 76067516-d2b1-644b-65bd-d6184521df63
   2026-03-03 16:43:01,933 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> amz-sdk-request: attempt=1; max=3
   2026-03-03 16:43:01,933 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> Authorization: AWS4-HMAC-SHA256 
Credential=AK3/eu-west-2/s3/aws4_request, 
SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;content-length;content-type;host;referer;x-amz-content-sha256;x-amz-date,
 Signature=44
   2026-03-03 16:43:01,933 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> Content-Type: application/xml
   2026-03-03 16:43:01,933 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> Referer: 
https://audit.example.org/hadoop/1/op_createfile/16b1c6a1-d5a4-4a6e-849a-21eef332bd6d-00000005/?op=op_createfile&p1=multipart&pr=stevel&ps=0565a125-fb37-4a3d-9115-729515d614fb&cm=Put&id=16b1c6a1-d5a4-4a6e-849a-21eef332bd6d-00000005&t0=1&fs=16b1c6a1-d5a4-4a6e-849a-21eef332bd6d&t1=1&ts=1772556180848
   2026-03-03 16:43:01,933 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> User-Agent: Hadoop 3.5.0 aws-sdk-java/2.35.4 md/io#sync 
md/http#Apache ua/2.1 api/S3#2.35.x os/Mac_OS_X#26.3 lang/java#17.0.17 
md/OpenJDK_64-Bit_Server_VM#17.0.17+10-LTS md/vendor#Amazon.com_Inc. md/en_GB 
m/F,G hll/cross-region
   2026-03-03 16:43:01,933 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> x-amz-content-sha256: UNSIGNED-PAYLOAD
   2026-03-03 16:43:01,933 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> X-Amz-Date: 20260303T164301Z
   2026-03-03 16:43:01,933 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> Content-Length: 233
   2026-03-03 16:43:01,933 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> Connection: Keep-Alive
   2026-03-03 16:43:01,933 [main] DEBUG http.wire (Wire.java:wire(73)) - 
http-outgoing-0 >> "POST 
/multipart?uploadId=1YjxcUi4oeYfKetmEQ5BKuHvy0lJuHVl.2s3N3v97RkzUxX
   ```
   
   no new headers.
   
   ## single file PUT
   
   this with with options
   ```
   fs.s3a.performance.flags=*
   fs.s3a.create.conditional.enabled=true
   ```
   
   But I think as the `put` command always overwrites, we don't get delayed 
if-overwrite checks.
   
   ```
   2026-03-03 16:58:27,830 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(133)) - 
http-outgoing-0 >> PUT /oneline HTTP/1.1
   2026-03-03 16:58:27,830 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> Host: stevel-london.s3.eu-west-2.amazonaws.com
   2026-03-03 16:58:27,830 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> amz-sdk-invocation-id: 8445eba8-0eb8-9588-0cec-1c54aa726cf5
   2026-03-03 16:58:27,830 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> amz-sdk-request: attempt=1; max=3
   2026-03-03 16:58:27,830 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> Authorization: AWS4-HMAC-SHA256 Credential=st, 
SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;content-length;content-type;host;referer;x-amz-content-sha256;x-amz-date;x-amz-server-side-encryption;x-amz-server-side-encryption-aws-kms-key-id,
 Signature=51
   2026-03-03 16:58:27,830 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> Content-Type: application/octet-stream
   2026-03-03 16:58:27,830 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> Expect: 100-continue
   2026-03-03 16:58:27,830 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> Referer: 
https://audit.example.org/hadoop/1/op_createfile/eca05bec-6b3a-4f47-90e4-d4b23028134a-00000005/?op=op_createfile&p1=oneline&pr=stevel&ps=3d5c8edb-b0da-424f-b19e-ffb6be9bebde&cm=Put&id=eca05bec-6b3a-4f47-90e4-d4b23028134a-00000005&t0=1&fs=eca05bec-6b3a-4f47-90e4-d4b23028134a&t1=1&ts=1772557106981
   2026-03-03 16:58:27,831 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> User-Agent: Hadoop 3.5.0 aws-sdk-java/2.35.4 md/io#sync 
md/http#Apache ua/2.1 api/S3#2.35.x os/Mac_OS_X#26.3 lang/java#17.0.17 
md/OpenJDK_64-Bit_Server_VM#17.0.17+10-LTS md/vendor#Amazon.com_Inc. md/en_GB 
md/rb#u m/F,G hll/cross-region
   2026-03-03 16:58:27,831 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> x-amz-content-sha256: UNSIGNED-PAYLOAD
   2026-03-03 16:58:27,831 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> X-Amz-Date: 20260303T165827Z
   2026-03-03 16:58:27,831 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> x-amz-server-side-encryption: aws:kms
   2026-03-03 16:58:27,831 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> x-amz-server-side-encryption-aws-kms-key-id: 
arn:aws:kms:eu-west-2:152813717728:key/c92f3bc9-ecb1-49d3-a259-9004dbac4443
   2026-03-03 16:58:27,831 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> Content-Length: 5
   2026-03-03 16:58:27,831 [main] DEBUG http.headers 
(LoggingManagedHttpClientConnection.java:onRequestSubmitted(136)) - 
http-outgoing-0 >> Connection: Keep-Alive
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to