[GitHub] [incubator-pinot] codecov-io commented on pull request #6376: Geo Indexing (WIP)

2020-12-21 Thread GitBox
codecov-io commented on pull request #6376: URL: https://github.com/apache/incubator-pinot/pull/6376#issuecomment-749394213 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6376?src=pr&el=h1) Report > Merging [#6376](https://codecov.io/gh/apache/incubator-pinot/pull/6376?s

[GitHub] [incubator-pinot] kishoreg opened a new pull request #6376: Geo Indexing (WIP)

2020-12-21 Thread GitBox
kishoreg opened a new pull request #6376: URL: https://github.com/apache/incubator-pinot/pull/6376 ## Description Adding support for indexing (lat,lon) using Uber's H3 indexing. ``` select count(*) from starbucksStores where ST_DISTANCE(location_st_point , ST_POINT(-122, 3

[GitHub] [incubator-pinot] kishoreg commented on pull request #6375: make MAX_NUM_THREADS_PER_QUERY configurable for pinto server

2020-12-21 Thread GitBox
kishoreg commented on pull request #6375: URL: https://github.com/apache/incubator-pinot/pull/6375#issuecomment-749367187 > Why are we using the JVM system property based mechanism to set this as opposed to using pinot.server.* configurations which is how we set the server instance config?

[GitHub] [incubator-pinot] kishoreg commented on pull request #6375: make MAX_NUM_THREADS_PER_QUERY configurable for pinto server

2020-12-21 Thread GitBox
kishoreg commented on pull request #6375: URL: https://github.com/apache/incubator-pinot/pull/6375#issuecomment-749366869 > > Why are we using the JVM system property based mechanism to set this as opposed to using pinot.server.* configurations which is how we set the server instance confi

[GitHub] [incubator-pinot] mcvsubbu commented on pull request #6375: make MAX_NUM_THREADS_PER_QUERY configurable for pinto server

2020-12-21 Thread GitBox
mcvsubbu commented on pull request #6375: URL: https://github.com/apache/incubator-pinot/pull/6375#issuecomment-749325126 > Why are we using the JVM system property based mechanism to set this as opposed to using pinot.server.* configurations which is how we set the server instance config?

[incubator-pinot] branch master updated: compatibility test: create/delete table operations (#6360)

2020-12-21 Thread mcvsubbu
This is an automated email from the ASF dual-hosted git repository. mcvsubbu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git The following commit(s) were added to refs/heads/master by this push: new b8bc74f compatibility test: create/d

[GitHub] [incubator-pinot] mcvsubbu merged pull request #6360: compatibility test: create/delete table operations

2020-12-21 Thread GitBox
mcvsubbu merged pull request #6360: URL: https://github.com/apache/incubator-pinot/pull/6360 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [incubator-pinot] mcvsubbu commented on pull request #6360: compatibility test: create/delete table operations

2020-12-21 Thread GitBox
mcvsubbu commented on pull request #6360: URL: https://github.com/apache/incubator-pinot/pull/6360#issuecomment-749324271 Thanks, @jtao15 This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6360: compatibility test: create/delete table operations

2020-12-21 Thread GitBox
codecov-io edited a comment on pull request #6360: URL: https://github.com/apache/incubator-pinot/pull/6360#issuecomment-748383568 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6360?src=pr&el=h1) Report > Merging [#6360](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6360: compatibility test: create/delete table operations

2020-12-21 Thread GitBox
codecov-io edited a comment on pull request #6360: URL: https://github.com/apache/incubator-pinot/pull/6360#issuecomment-748383568 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6360?src=pr&el=h1) Report > Merging [#6360](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] siddharthteotia commented on pull request #6375: make MAX_NUM_THREADS_PER_QUERY configurable for pinto server

2020-12-21 Thread GitBox
siddharthteotia commented on pull request #6375: URL: https://github.com/apache/incubator-pinot/pull/6375#issuecomment-749310890 Why are we using the JVM system property based mechanism to set this as opposed to using pinot.server.* configurations which is how we set the server instance co

[GitHub] [incubator-pinot] mcvsubbu commented on a change in pull request #6360: compatibility test: create/delete table operations

2020-12-21 Thread GitBox
mcvsubbu commented on a change in pull request #6360: URL: https://github.com/apache/incubator-pinot/pull/6360#discussion_r547028950 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/compat/tests/TableOp.java ## @@ -19,6 +19,17 @@ package org.apache.pinot.c

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6360: compatibility test: create/delete table operations

2020-12-21 Thread GitBox
codecov-io edited a comment on pull request #6360: URL: https://github.com/apache/incubator-pinot/pull/6360#issuecomment-748383568 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6360?src=pr&el=h1) Report > Merging [#6360](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] fx19880617 commented on issue #6349: Standalone ingestion jobs do not clean up output files after completing loading

2020-12-21 Thread GitBox
fx19880617 commented on issue #6349: URL: https://github.com/apache/incubator-pinot/issues/6349#issuecomment-749282776 1. For the ingestion job, it's by design to keep the segments in output directory. The reason is that for URI and METADATA push job, the output dir is treated at the sour

[incubator-pinot] branch master updated (85cf696 -> 10dad7d)

2020-12-21 Thread nehapawar
This is an automated email from the ASF dual-hosted git repository. nehapawar pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. from 85cf696 Fixing the issue for realtime table creation with env variables in stream configs (#6373)

[GitHub] [incubator-pinot] npawar merged pull request #6354: Ingestion resource with APIs for ingestion via file/URI

2020-12-21 Thread GitBox
npawar merged pull request #6354: URL: https://github.com/apache/incubator-pinot/pull/6354 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6360: compatibility test: create/delete table operations

2020-12-21 Thread GitBox
codecov-io edited a comment on pull request #6360: URL: https://github.com/apache/incubator-pinot/pull/6360#issuecomment-748383568 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6360?src=pr&el=h1) Report > Merging [#6360](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6354: Ingestion resource with APIs for ingestion via file/URI

2020-12-21 Thread GitBox
codecov-io edited a comment on pull request #6354: URL: https://github.com/apache/incubator-pinot/pull/6354#issuecomment-745041431 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6354?src=pr&el=h1) Report > Merging [#6354](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] mcvsubbu commented on a change in pull request #6360: compatibility test: create/delete table operations

2020-12-21 Thread GitBox
mcvsubbu commented on a change in pull request #6360: URL: https://github.com/apache/incubator-pinot/pull/6360#discussion_r546999377 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/compat/tests/TableOp.java ## @@ -92,4 +101,40 @@ boolean runOp() { }

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6360: compatibility test: create/delete table operations

2020-12-21 Thread GitBox
codecov-io edited a comment on pull request #6360: URL: https://github.com/apache/incubator-pinot/pull/6360#issuecomment-748383568 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6360?src=pr&el=h1) Report > Merging [#6360](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] npawar commented on a change in pull request #6354: Ingestion resource with APIs for ingestion via file/URI

2020-12-21 Thread GitBox
npawar commented on a change in pull request #6354: URL: https://github.com/apache/incubator-pinot/pull/6354#discussion_r546990341 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/util/FileIngestionUtils.java ## @@ -0,0 +1,186 @@ +/** + * Licensed to th

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6354: Ingestion resource with APIs for ingestion via file/URI

2020-12-21 Thread GitBox
codecov-io edited a comment on pull request #6354: URL: https://github.com/apache/incubator-pinot/pull/6354#issuecomment-745041431 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6354?src=pr&el=h1) Report > Merging [#6354](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6354: Ingestion resource with APIs for ingestion via file/URI

2020-12-21 Thread GitBox
codecov-io edited a comment on pull request #6354: URL: https://github.com/apache/incubator-pinot/pull/6354#issuecomment-745041431 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6354?src=pr&el=h1) Report > Merging [#6354](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] fx19880617 commented on a change in pull request #6354: Ingestion resource with APIs for ingestion via file/URI

2020-12-21 Thread GitBox
fx19880617 commented on a change in pull request #6354: URL: https://github.com/apache/incubator-pinot/pull/6354#discussion_r546328688 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/helix/ControllerRequestURLBuilder.java ## @@ -289,4 +292,18 @@ public

[GitHub] [incubator-pinot] amarnathkarthik commented on issue #6349: Standalone ingestion jobs do not clean up output files after completing loading

2020-12-21 Thread GitBox
amarnathkarthik commented on issue #6349: URL: https://github.com/apache/incubator-pinot/issues/6349#issuecomment-749209495 Here is my analysis, Looked at `LaunchDataIngestionJobCommand.java` and it's all job runner (Segment Generator and Push job). Did not see implementation to clean up

[incubator-pinot] branch master updated: Fixing the issue for realtime table creation with env variables in stream configs (#6373)

2020-12-21 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git The following commit(s) were added to refs/heads/master by this push: new 85cf696 Fixing the issue for realtime

[GitHub] [incubator-pinot] fx19880617 merged pull request #6373: Fixing the issue for realtime table creation with env variables in stream configs

2020-12-21 Thread GitBox
fx19880617 merged pull request #6373: URL: https://github.com/apache/incubator-pinot/pull/6373 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6354: Ingestion resource with APIs for ingestion via file/URI

2020-12-21 Thread GitBox
codecov-io edited a comment on pull request #6354: URL: https://github.com/apache/incubator-pinot/pull/6354#issuecomment-745041431 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6354?src=pr&el=h1) Report > Merging [#6354](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6354: Ingestion resource with APIs for ingestion via file/URI

2020-12-21 Thread GitBox
codecov-io edited a comment on pull request #6354: URL: https://github.com/apache/incubator-pinot/pull/6354#issuecomment-745041431 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6354?src=pr&el=h1) Report > Merging [#6354](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] cbalci commented on pull request #6346: Introduce DimensionTableDataManager

2020-12-21 Thread GitBox
cbalci commented on pull request #6346: URL: https://github.com/apache/incubator-pinot/pull/6346#issuecomment-749187775 Thanks folks! @Jackie-Jiang can you please merge the branch so I can move to the next step? This i

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6354: Ingestion resource with APIs for ingestion via file/URI

2020-12-21 Thread GitBox
codecov-io edited a comment on pull request #6354: URL: https://github.com/apache/incubator-pinot/pull/6354#issuecomment-745041431 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6354?src=pr&el=h1) Report > Merging [#6354](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] npawar commented on pull request #6354: Ingestion resource with APIs for ingestion via file/URI

2020-12-21 Thread GitBox
npawar commented on pull request #6354: URL: https://github.com/apache/incubator-pinot/pull/6354#issuecomment-749177669 > some thoughts re API design. I understand that this one is mainly for testing purposes so it probably doesn't matter too much. > > If this is to ever become a pro

[GitHub] [incubator-pinot] mcvsubbu commented on a change in pull request #6360: compatibility test: create/delete table operations

2020-12-21 Thread GitBox
mcvsubbu commented on a change in pull request #6360: URL: https://github.com/apache/incubator-pinot/pull/6360#discussion_r546908744 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/compat/tests/TableOp.java ## @@ -92,4 +101,45 @@ boolean runOp() { }

[GitHub] [incubator-pinot] npawar commented on a change in pull request #6354: Ingestion resource with APIs for ingestion via file/URI

2020-12-21 Thread GitBox
npawar commented on a change in pull request #6354: URL: https://github.com/apache/incubator-pinot/pull/6354#discussion_r546904614 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/util/FileIngestionHelper.java ## @@ -0,0 +1,140 @@ +/** + * Licensed to t

[GitHub] [incubator-pinot] npawar commented on a change in pull request #6354: Ingestion resource with APIs for ingestion via file/URI

2020-12-21 Thread GitBox
npawar commented on a change in pull request #6354: URL: https://github.com/apache/incubator-pinot/pull/6354#discussion_r546903819 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotIngestionRestletResource.java ## @@ -0,0 +1,145 @@ +/*

[GitHub] [incubator-pinot] npawar commented on a change in pull request #6354: Ingestion resource with APIs for ingestion via file/URI

2020-12-21 Thread GitBox
npawar commented on a change in pull request #6354: URL: https://github.com/apache/incubator-pinot/pull/6354#discussion_r546897922 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/util/FileIngestionHelper.java ## @@ -0,0 +1,140 @@ +/** + * Licensed to t

[incubator-pinot] branch h3-index updated: Removing H3WITHIN UDF and adding logic to use h3 index for st_distance udf

2020-12-21 Thread kishoreg
This is an automated email from the ASF dual-hosted git repository. kishoreg pushed a commit to branch h3-index in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git The following commit(s) were added to refs/heads/h3-index by this push: new bab10b9 Removing H3WITHIN UDF an

[GitHub] [incubator-pinot] npawar commented on a change in pull request #6354: Ingestion resource with APIs for ingestion via file/URI

2020-12-21 Thread GitBox
npawar commented on a change in pull request #6354: URL: https://github.com/apache/incubator-pinot/pull/6354#discussion_r546814422 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotIngestionRestletResource.java ## @@ -0,0 +1,145 @@ +/*

[GitHub] [incubator-pinot] codecov-io commented on pull request #6375: make MAX_NUM_THREADS_PER_QUERY configurable for pinto server

2020-12-21 Thread GitBox
codecov-io commented on pull request #6375: URL: https://github.com/apache/incubator-pinot/pull/6375#issuecomment-748898114 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6375?src=pr&el=h1) Report > Merging [#6375](https://codecov.io/gh/apache/incubator-pinot/pull/6375?s

[GitHub] [incubator-pinot] samarth-gupta-traceable commented on issue #6374: make MAX_NUM_THREADS_PER_QUERY configurable

2020-12-21 Thread GitBox
samarth-gupta-traceable commented on issue #6374: URL: https://github.com/apache/incubator-pinot/issues/6374#issuecomment-748879492 created PR" https://github.com/apache/incubator-pinot/pull/6375 This is an automated message

[GitHub] [incubator-pinot] samarth-gupta-traceable opened a new pull request #6375: make MAX_NUM_THREADS_PER_QUERY configurable for pinto server

2020-12-21 Thread GitBox
samarth-gupta-traceable opened a new pull request #6375: URL: https://github.com/apache/incubator-pinot/pull/6375 ## Description Fix for https://github.com/apache/incubator-pinot/issues/6374 ## Upgrade Notes Does this PR otherwise need attention when creating release notes? Thin

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6373: Fixing the issue for realtime table creation with env variables in stream configs

2020-12-21 Thread GitBox
codecov-io edited a comment on pull request #6373: URL: https://github.com/apache/incubator-pinot/pull/6373#issuecomment-748763075 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6373?src=pr&el=h1) Report > Merging [#6373](https://codecov.io/gh/apache/incubator-pinot/pull

[incubator-pinot] branch fixing_table_config_with_env_var_during_table_creation updated (6db99dd -> f357983)

2020-12-21 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch fixing_table_config_with_env_var_during_table_creation in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard 6db99dd Fixing the issue for realtime table creation with

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6120: Add FST Index using lucene lib to speedup regexp queries

2020-12-21 Thread GitBox
codecov-io edited a comment on pull request #6120: URL: https://github.com/apache/incubator-pinot/pull/6120#issuecomment-705891235 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6120?src=pr&el=h1) Report > Merging [#6120](https://codecov.io/gh/apache/incubator-pinot/pull