anvanna commented on issue #8891: URL: https://github.com/apache/iceberg/issues/8891#issuecomment-1774003254
@pvary i think the insert is ok as below: 0: jdbc:hive2://hadoop-maste:2> insert into table_g values (300, 'iceberg'); INFO : Compiling command(queryId=hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b): insert into table_g values (300, 'iceberg') INFO : Semantic Analysis Completed (retrial = false) INFO : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:_col0, type:bigint, comment:null), FieldSchema(name:_col1, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b); Time taken: 1.609 seconds INFO : Executing command(queryId=hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b): insert into table_g values (300, 'iceberg') INFO : Query ID = hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b INFO : Total jobs = 1 INFO : Starting task [Stage-0:DDL] in serial mode INFO : Starting task [Stage-1:DDL] in serial mode INFO : Launching Job 1 out of 1 INFO : Starting task [Stage-2:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b INFO : Tez session hasn't been created yet. Opening session INFO : Dag name: insert into table_g values (300, 'iceberg') (Stage-2) INFO : Status: Running (Executing on YARN cluster with App id application_1697615344511_0012) ---------------------------------------------------------------------------------------------- VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 4.55 s ---------------------------------------------------------------------------------------------- INFO : Status: DAG finished successfully in 4.50 seconds INFO : INFO : Query Execution Summary INFO : ---------------------------------------------------------------------------------------------- INFO : OPERATION DURATION INFO : ---------------------------------------------------------------------------------------------- INFO : Compile Query 1.61s INFO : Prepare Plan 3.99s INFO : Get Query Coordinator (AM) 0.00s INFO : Submit Plan 0.49s INFO : Start DAG 0.58s INFO : Run DAG 4.50s INFO : ---------------------------------------------------------------------------------------------- INFO : INFO : Task Execution Summary INFO : ---------------------------------------------------------------------------------------------- INFO : VERTICES DURATION(ms) CPU_TIME(ms) GC_TIME(ms) INPUT_RECORDS OUTPUT_RECORDS INFO : ---------------------------------------------------------------------------------------------- INFO : Map 1 2479.00 7,560 129 3 0 INFO : ---------------------------------------------------------------------------------------------- INFO : INFO : org.apache.tez.common.counters.DAGCounter: INFO : NUM_SUCCEEDED_TASKS: 1 INFO : TOTAL_LAUNCHED_TASKS: 1 INFO : DATA_LOCAL_TASKS: 1 INFO : AM_CPU_MILLISECONDS: 2580 INFO : AM_GC_TIME_MILLIS: 21 INFO : File System Counters: INFO : HDFS_BYTES_WRITTEN: 701 INFO : HDFS_WRITE_OPS: 1 INFO : HDFS_OP_CREATE: 1 INFO : org.apache.tez.common.counters.TaskCounter: INFO : GC_TIME_MILLIS: 129 INFO : TASK_DURATION_MILLIS: 2602 INFO : CPU_MILLISECONDS: 7560 INFO : PHYSICAL_MEMORY_BYTES: 859832320 INFO : VIRTUAL_MEMORY_BYTES: 2864087040 INFO : COMMITTED_HEAP_BYTES: 859832320 INFO : INPUT_RECORDS_PROCESSED: 4 INFO : INPUT_SPLIT_LENGTH_BYTES: 1 INFO : OUTPUT_RECORDS: 0 INFO : HIVE: INFO : CREATED_FILES: 1 INFO : DESERIALIZE_ERRORS: 0 INFO : RECORDS_IN_Map_1: 3 INFO : RECORDS_OUT_1_default.table_g: 1 INFO : RECORDS_OUT_INTERMEDIATE_Map_1: 0 INFO : RECORDS_OUT_OPERATOR_FS_5: 1 INFO : RECORDS_OUT_OPERATOR_MAP_0: 0 INFO : RECORDS_OUT_OPERATOR_SEL_1: 1 INFO : RECORDS_OUT_OPERATOR_SEL_3: 1 INFO : RECORDS_OUT_OPERATOR_TS_0: 1 INFO : RECORDS_OUT_OPERATOR_UDTF_2: 1 INFO : TaskCounter_Map_1_INPUT__dummy_table: INFO : INPUT_RECORDS_PROCESSED: 4 INFO : INPUT_SPLIT_LENGTH_BYTES: 1 INFO : TaskCounter_Map_1_OUTPUT_out_Map_1: INFO : OUTPUT_RECORDS: 0 INFO : Starting task [Stage-4:DDL] in serial mode INFO : Completed executing command(queryId=hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b); Time taken: 9.566 seconds INFO : OK No rows affected (11.23 seconds) 2. and the parquet files & .metadata.json was created [hdfs@hadoop-master ~]$ hdfs dfs -ls /user/hive/warehouse/default/table_g/dataFound 3 items-rw-r--r-- 3 hive hdfs 673 2023-10-20 16:56 /user/hive/warehouse/default/table_g/data/00000-0-hive_20231020165640_da5c38e9-b556-4e7f-b125-156e0d0b5679-job_1697615344511_0005-00001.parquet-rw-r--r-- 3 hive hdfs 673 2023-10-20 17:38 /user/hive/warehouse/default/table_g/data/00000-0-hive_20231020173840_17952753-a875-42a5-b572-979c08249888-job_1697615344511_0011-00001.parquet-rw-r--r-- 3 hive hdfs 701 2023-10-22 12:48 /user/hive/warehouse/default/table_g/data/00000-0-hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b-job_1697615344511_0012-00001.parquet[hdfs@hadoop-master ~]$ hdfs dfs -ls /user/hive/warehouse/default/table_g/metadataFound 1 items-rw-r--r-- 3 hive hdfs 1357 2023-10-20 16:55 /user/hive/warehouse/default/table_g/metadata/00000-c64d7b49-d2c6-4cf5-b4b1-0d75a3fb98c6.metadata.json -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org