anvanna commented on issue #8891:
URL: https://github.com/apache/iceberg/issues/8891#issuecomment-1774003254

   @pvary i think the insert is ok as below:
   
   0: jdbc:hive2://hadoop-maste:2> insert into table_g values (300, 'iceberg');
   INFO  : Compiling 
command(queryId=hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b): 
insert into table_g values (300, 'iceberg')
   INFO  : Semantic Analysis Completed (retrial = false)
   INFO  : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:_col0, 
type:bigint, comment:null), FieldSchema(name:_col1, type:string, 
comment:null)], properties:null)
   INFO  : Completed compiling 
command(queryId=hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b); Time 
taken: 1.609 seconds
   INFO  : Executing 
command(queryId=hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b): 
insert into table_g values (300, 'iceberg')
   INFO  : Query ID = hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b
   INFO  : Total jobs = 1
   INFO  : Starting task [Stage-0:DDL] in serial mode
   INFO  : Starting task [Stage-1:DDL] in serial mode
   INFO  : Launching Job 1 out of 1
   INFO  : Starting task [Stage-2:MAPRED] in serial mode
   INFO  : Subscribed to counters: [] for queryId: 
hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b
   INFO  : Tez session hasn't been created yet. Opening session
   INFO  : Dag name: insert into table_g values (300, 'iceberg') (Stage-2)
   INFO  : Status: Running (Executing on YARN cluster with App id 
application_1697615344511_0012)
   
   
----------------------------------------------------------------------------------------------
           VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING 
 FAILED  KILLED  
   
----------------------------------------------------------------------------------------------
   Map 1 .......... container     SUCCEEDED      1          1        0        0 
      0       0  
   
----------------------------------------------------------------------------------------------
   VERTICES: 01/01  [==========================>>] 100%  ELAPSED TIME: 4.55 s   
  
   
----------------------------------------------------------------------------------------------
   INFO  : Status: DAG finished successfully in 4.50 seconds
   INFO  : 
   INFO  : Query Execution Summary
   INFO  : 
----------------------------------------------------------------------------------------------
   INFO  : OPERATION                            DURATION
   INFO  : 
----------------------------------------------------------------------------------------------
   INFO  : Compile Query                           1.61s
   INFO  : Prepare Plan                            3.99s
   INFO  : Get Query Coordinator (AM)              0.00s
   INFO  : Submit Plan                             0.49s
   INFO  : Start DAG                               0.58s
   INFO  : Run DAG                                 4.50s
   INFO  : 
----------------------------------------------------------------------------------------------
   INFO  : 
   INFO  : Task Execution Summary
   INFO  : 
----------------------------------------------------------------------------------------------
   INFO  :   VERTICES      DURATION(ms)   CPU_TIME(ms)    GC_TIME(ms)   
INPUT_RECORDS   OUTPUT_RECORDS
   INFO  : 
----------------------------------------------------------------------------------------------
   INFO  :      Map 1           2479.00          7,560            129           
    3                0
   INFO  : 
----------------------------------------------------------------------------------------------
   INFO  : 
   INFO  : org.apache.tez.common.counters.DAGCounter:
   INFO  :    NUM_SUCCEEDED_TASKS: 1
   INFO  :    TOTAL_LAUNCHED_TASKS: 1
   INFO  :    DATA_LOCAL_TASKS: 1
   INFO  :    AM_CPU_MILLISECONDS: 2580
   INFO  :    AM_GC_TIME_MILLIS: 21
   INFO  : File System Counters:
   INFO  :    HDFS_BYTES_WRITTEN: 701
   INFO  :    HDFS_WRITE_OPS: 1
   INFO  :    HDFS_OP_CREATE: 1
   INFO  : org.apache.tez.common.counters.TaskCounter:
   INFO  :    GC_TIME_MILLIS: 129
   INFO  :    TASK_DURATION_MILLIS: 2602
   INFO  :    CPU_MILLISECONDS: 7560
   INFO  :    PHYSICAL_MEMORY_BYTES: 859832320
   INFO  :    VIRTUAL_MEMORY_BYTES: 2864087040
   INFO  :    COMMITTED_HEAP_BYTES: 859832320
   INFO  :    INPUT_RECORDS_PROCESSED: 4
   INFO  :    INPUT_SPLIT_LENGTH_BYTES: 1
   INFO  :    OUTPUT_RECORDS: 0
   INFO  : HIVE:
   INFO  :    CREATED_FILES: 1
   INFO  :    DESERIALIZE_ERRORS: 0
   INFO  :    RECORDS_IN_Map_1: 3
   INFO  :    RECORDS_OUT_1_default.table_g: 1
   INFO  :    RECORDS_OUT_INTERMEDIATE_Map_1: 0
   INFO  :    RECORDS_OUT_OPERATOR_FS_5: 1
   INFO  :    RECORDS_OUT_OPERATOR_MAP_0: 0
   INFO  :    RECORDS_OUT_OPERATOR_SEL_1: 1
   INFO  :    RECORDS_OUT_OPERATOR_SEL_3: 1
   INFO  :    RECORDS_OUT_OPERATOR_TS_0: 1
   INFO  :    RECORDS_OUT_OPERATOR_UDTF_2: 1
   INFO  : TaskCounter_Map_1_INPUT__dummy_table:
   INFO  :    INPUT_RECORDS_PROCESSED: 4
   INFO  :    INPUT_SPLIT_LENGTH_BYTES: 1
   INFO  : TaskCounter_Map_1_OUTPUT_out_Map_1:
   INFO  :    OUTPUT_RECORDS: 0
   INFO  : Starting task [Stage-4:DDL] in serial mode
   INFO  : Completed executing 
command(queryId=hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b); Time 
taken: 9.566 seconds
   INFO  : OK
   No rows affected (11.23 seconds)
   
   2. and the parquet files & .metadata.json was created
   
   [hdfs@hadoop-master ~]$ hdfs dfs -ls 
/user/hive/warehouse/default/table_g/dataFound 3 items-rw-r--r--   3 hive hdfs  
      673 2023-10-20 16:56 
/user/hive/warehouse/default/table_g/data/00000-0-hive_20231020165640_da5c38e9-b556-4e7f-b125-156e0d0b5679-job_1697615344511_0005-00001.parquet-rw-r--r--
   3 hive hdfs        673 2023-10-20 17:38 
/user/hive/warehouse/default/table_g/data/00000-0-hive_20231020173840_17952753-a875-42a5-b572-979c08249888-job_1697615344511_0011-00001.parquet-rw-r--r--
   3 hive hdfs        701 2023-10-22 12:48 
/user/hive/warehouse/default/table_g/data/00000-0-hive_20231022124803_fac475fe-2d99-408f-841a-1e7e0ba9558b-job_1697615344511_0012-00001.parquet[hdfs@hadoop-master
 ~]$ hdfs dfs -ls /user/hive/warehouse/default/table_g/metadataFound 1 
items-rw-r--r--   3 hive hdfs       1357 2023-10-20 16:55 
/user/hive/warehouse/default/table_g/metadata/00000-c64d7b49-d2c6-4cf5-b4b1-0d75a3fb98c6.metadata.json


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org

Reply via email to