Re: [I] Failed to assign splits due to the serialized split size [iceberg]

[via GitHub]

javrasya commented on issue #9410:
URL: https://github.com/apache/iceberg/issues/9410#issuecomment-1878646665

   No idea tbh since I run into this on production and there I don't have the 
ability to go deep and debug. 
   
   I wouldn't say it is a wide table in terms of number of columns and I don't 
know about column stats. Is there a way to fetch that from somewhere?
   
   
   But the metadata about the file I know at least is like;
   
   One of the files:
   
   **File name:** 
`s3://data-furnishing-pipeline-eu-production/data-lake/dafu_pipeline.db/transactional_customer_ids_created/data/__key_bucket=0/createdAt_day=2018-10-04/country=NO/00021-0-ca186d77-6349-4e79-bb4f-874fac0ee123-00186.parquet`
   
   **Schema**:
   ```json
   [
     {
       "Name": "__key",
       "Type": "string",
       "Parameters": {
         "iceberg.field.current": "true",
         "iceberg.field.id": "1",
         "iceberg.field.optional": "true"
       }
     },
     {
       "Name": "eventid",
       "Type": "string",
       "Parameters": {
         "iceberg.field.current": "true",
         "iceberg.field.id": "2",
         "iceberg.field.optional": "false"
       }
     },
     {
       "Name": "authorizationid",
       "Type": "string",
       "Parameters": {
         "iceberg.field.current": "true",
         "iceberg.field.id": "3",
         "iceberg.field.optional": "false"
       }
     },
     {
       "Name": "authorizationkrn",
       "Type": "string",
       "Parameters": {
         "iceberg.field.current": "true",
         "iceberg.field.id": "4",
         "iceberg.field.optional": "true"
       }
     },
     {
       "Name": "orderid",
       "Type": "string",
       "Parameters": {
         "iceberg.field.current": "true",
         "iceberg.field.id": "5",
         "iceberg.field.optional": "false"
       }
     },
     {
       "Name": "ordershortid",
       "Type": "string",
       "Parameters": {
         "iceberg.field.current": "true",
         "iceberg.field.id": "6",
         "iceberg.field.optional": "true"
       }
     },
     {
       "Name": "orderkrn",
       "Type": "string",
       "Parameters": {
         "iceberg.field.current": "true",
         "iceberg.field.id": "7",
         "iceberg.field.optional": "true"
       }
     },
     {
       "Name": "nationalidentificationnumber",
       "Type": "string",
       "Parameters": {
         "iceberg.field.current": "true",
         "iceberg.field.id": "8",
         "iceberg.field.optional": "true"
       }
     },
     {
       "Name": "personaid",
       "Type": "string",
       "Parameters": {
         "iceberg.field.current": "true",
         "iceberg.field.id": "9",
         "iceberg.field.optional": "true"
       }
     },
     {
       "Name": "personakrn",
       "Type": "string",
       "Parameters": {
         "iceberg.field.current": "true",
         "iceberg.field.id": "10",
         "iceberg.field.optional": "true"
       }
     },
     {
       "Name": "accountid",
       "Type": "string",
       "Parameters": {
         "iceberg.field.current": "true",
         "iceberg.field.id": "11",
         "iceberg.field.optional": "true"
       }
     },
     {
       "Name": "accountkrn",
       "Type": "string",
       "Parameters": {
         "iceberg.field.current": "true",
         "iceberg.field.id": "12",
         "iceberg.field.optional": "true"
       }
     },
     {
       "Name": "country",
       "Type": "string",
       "Parameters": {
         "iceberg.field.current": "true",
         "iceberg.field.id": "13",
         "iceberg.field.optional": "false"
       }
     },
     {
       "Name": "createdat",
       "Type": "timestamp",
       "Parameters": {
         "iceberg.field.current": "true",
         "iceberg.field.id": "14",
         "iceberg.field.optional": "false"
       }
     }
   ]
   ```
   
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org