siddharthteotia commented on a change in pull request #6914:
URL: https://github.com/apache/incubator-pinot/pull/6914#discussion_r632272054
##########
File path:
pinot-tools/src/main/resources/examples/batch/githubEvents/githubEvents_offline_complexTypeHandling_table_config.json
##########
@@ -0,0 +1,33 @@
+{
+ "tableName": "githubEvents",
+ "tableType": "OFFLINE",
+ "tenants": {
+ },
+ "segmentsConfig": {
+ "segmentPushType": "REFRESH",
+ "replication": "1",
+ "timeColumnName": "created_at_timestamp"
+ },
+ "tableIndexConfig": {
+ "loadMode": "MMAP"
+ },
+ "ingestionConfig": {
+ "transformConfigs": [
+ {
+ "columnName": "created_at_timestamp",
+ "transformFunction": "fromDateTime(created_at,
'yyyy-MM-dd''T''HH:mm:ss''Z''')"
+ },
+ {
+ "columnName": "payload_json",
+ "transformFunction": "jsonFormat(\"payload\")"
+ }
+ ],
+ "complexTypeConfig": {
+ "unnestFields": ["payload.commits"]
+ }
Review comment:
Can we please add another quickstart example where the entire payload
json column is unnested as opposed to payload.commits subtree ? Someone
interested in using nested data this way without json index will find it helpful
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org
