bk-mz commented on issue #9833: URL: https://github.com/apache/iceberg/issues/9833#issuecomment-1989436414
I.e.  Odd folder 475031 -> 1710111600 -> Sun Mar 10 2024 23:00:00 GMT+0000  ``` select file_path, file_size_in_bytes from table.files where partition.data_load_ts_hour = 475031; s3://table/data/data_load_ts_hour=2024-03-10-23/00013-3509493-318c11b3-8524-44a5-9666-d83eb56eb629-00002.parquet 45733 s3://table/data/data_load_ts_hour=2024-03-10-23/00015-3445167-69efcc48-af68-457c-b04c-8098bf1d5075-00001.parquet 49560 s3://table/data/data_load_ts_hour=2024-03-10-23/00016-3380992-f13b8421-04b8-4066-808d-65eaeb3f43a0-00011.parquet 43586 s3://table/data/data_load_ts_hour=2024-03-10-23/00016-3319607-da37d93f-19e2-4299-bfe8-c39379609412-00002.parquet 48747 s3://table/data/data_load_ts_hour=2024-03-10-23/00015-3260964-cdef4129-3da2-478e-a909-a12324fb05ff-00006.parquet 46419 s3://table/data/data_load_ts_hour=2024-03-10-23/00016-3197026-1ff4d8e1-cc34-4d90-bc49-9a9c2c3a2006-00003.parquet 48212 s3://table/data/data_load_ts_hour=2024-03-10-23/00016-3141354-5a0785fa-1242-4417-bd2d-52783f0a4962-00001.parquet 51474 s3://table/data/data_load_ts_hour=2024-03-10-23/00015-3083005-3442d952-b4c5-48fe-954e-e06b11f2366f-00002.parquet 46876 s3://table/data/data_load_ts_hour=2024-03-10-23/00000-615765-fc9949b0-e3e0-4fca-82b6-37584104f369-00001.parquet 72581629 s3://table/data/data_load_ts_hour=2024-03-10-23/00071-52955-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102451428 s3://table/data/data_load_ts_hour=2024-03-10-23/00072-52985-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102579065 s3://table/data/data_load_ts_hour=2024-03-10-23/00073-52976-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102562792 s3://table/data/data_load_ts_hour=2024-03-10-23/00074-52983-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102523561 s3://table/data/data_load_ts_hour=2024-03-10-23/00075-52990-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102416806 s3://table/data/data_load_ts_hour=2024-03-10-23/00076-52978-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102503807 s3://table/data/data_load_ts_hour=2024-03-10-23/00077-52980-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102752978 s3://table/data/data_load_ts_hour=2024-03-10-23/00078-52993-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102571840 s3://table/data/data_load_ts_hour=2024-03-10-23/00079-52987-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102606616 s3://table/data/data_load_ts_hour=2024-03-10-23/00080-52943-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102949360 s3://table/data/data_load_ts_hour=2024-03-10-23/00081-52982-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102413581 s3://table/data/data_load_ts_hour=2024-03-10-23/00082-52981-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102433660 s3://table/data/data_load_ts_hour=2024-03-10-23/00083-52964-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102382969 s3://table/data/data_load_ts_hour=2024-03-10-23/00084-52967-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102499015 s3://table/data/data_load_ts_hour=2024-03-10-23/00085-52986-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102645047 s3://table/data/data_load_ts_hour=2024-03-10-23/00086-52992-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102409434 s3://table/data/data_load_ts_hour=2024-03-10-23/00087-52975-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102292344 s3://table/data/data_load_ts_hour=2024-03-10-23/00088-52988-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102571193 s3://table/data/data_load_ts_hour=2024-03-10-23/00089-52984-2950793c-8099-475f-8d39-f12e51fbe384-00002.parquet 102692273 s3://table/data/data_load_ts_hour=2024-03-10-23/00090-52989-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102362866 s3://table/data/data_load_ts_hour=2024-03-10-23/00091-52991-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102582641 s3://table/data/data_load_ts_hour=2024-03-10-23/00092-52994-2950793c-8099-475f-8d39-f12e51fbe384-00001.parquet 102684825 s3://table/data/data_load_ts_hour=2024-03-10-23/00014-2780212-cbae87b5-972a-4502-a503-7af1aa2fa345-00001.parquet 52428 s3://table/data/data_load_ts_hour=2024-03-10-23/00000-2713285-5621343d-59e6-4fb2-94eb-3abb650807e8-00001.parquet 558576 s3://table/data/data_load_ts_hour=2024-03-10-23/00001-2713286-5621343d-59e6-4fb2-94eb-3abb650807e8-00001.parquet 736579 s3://table/data/data_load_ts_hour=2024-03-10-23/00015-2895320-64cf8ddc-50c9-4751-a682-42bfc866da26-00002.parquet 48850 s3://table/data/data_load_ts_hour=2024-03-10-23/00014-2718792-ef600d59-b559-41dd-a718-1cdccad2d2af-00003.parquet 45186 s3://table/data/data_load_ts_hour=2024-03-10-23/00015-2954371-35a30ce1-f52b-463a-a987-d0076a407294-00002.parquet 43511 s3://table/data/data_load_ts_hour=2024-03-10-23/00016-2836402-586be539-99b1-4471-a54b-456da1c4c757-00002.parquet 47107 s3://table/data/data_load_ts_hour=2024-03-10-23/00015-3013381-b6a11670-a567-4cf7-87bf-434d95fd50cc-00001.parquet 51385 s3://table/data/data_load_ts_hour=475031/00089-3512827-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 6843 s3://table/data/data_load_ts_hour=475031/00107-3513237-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 18330 s3://table/data/data_load_ts_hour=475031/00264-3516565-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 1813 s3://table/data/data_load_ts_hour=475031/00366-3518557-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 1771 s3://table/data/data_load_ts_hour=475031/00434-3519930-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 18304 s3://table/data/data_load_ts_hour=475031/00484-3520949-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 18567 s3://table/data/data_load_ts_hour=475031/00605-3523428-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 19055 s3://table/data/data_load_ts_hour=475031/00609-3523522-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 18045 s3://table/data/data_load_ts_hour=475031/00840-3528509-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 18473 s3://table/data/data_load_ts_hour=475031/00936-3530655-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 18516 s3://table/data/data_load_ts_hour=475031/00947-3530931-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 18314 s3://table/data/data_load_ts_hour=475031/00974-3531559-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 18203 s3://table/data/data_load_ts_hour=475031/01155-3535492-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 17941 s3://table/data/data_load_ts_hour=475031/01175-3535917-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 1771 s3://table/data/data_load_ts_hour=475031/01275-3538024-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 18253 s3://table/data/data_load_ts_hour=475031/01341-3539357-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 17981 s3://table/data/data_load_ts_hour=475031/01434-3541342-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 1813 s3://table/data/data_load_ts_hour=475031/01535-3543442-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 18564 s3://table/data/data_load_ts_hour=475031/01610-3544978-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 18476 s3://table/data/data_load_ts_hour=475031/01753-3547842-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 1770 s3://table/data/data_load_ts_hour=475031/01777-3548348-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 18273 s3://table/data/data_load_ts_hour=475031/01931-3551544-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 18869 s3://table/data/data_load_ts_hour=475031/02062-3554342-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 1771 s3://table/data/data_load_ts_hour=475031/02132-3555802-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 18528 s3://table/data/data_load_ts_hour=475031/02143-3556044-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 17974 s3://table/data/data_load_ts_hour=475031/02206-3557310-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 18243 s3://table/data/data_load_ts_hour=475031/02214-3557488-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 18202 s3://table/data/data_load_ts_hour=475031/02245-3558183-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 18995 s3://table/data/data_load_ts_hour=475031/02420-3561823-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 1771 s3://table/data/data_load_ts_hour=475031/02618-3565614-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 18271 s3://table/data/data_load_ts_hour=475031/02689-3566578-3d8f11a9-2801-434d-b7cb-e1c51d2be2e1-00001-deletes.parquet 1771 Time taken: 7.393 seconds, Fetched 70 row(s) ``` So it seems that those two partitions are not really connected, b/c those 2k delete files are not listed in the partition metadata. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
