Eywek commented on issue #7842: URL: https://github.com/apache/pinot/issues/7842#issuecomment-982655500
> how slow is "very slow"? ~600-800ms for 21 documents (vs 22-40ms without this filter) > Is there a natural way for you to filter the JSON documents before applying the `JSONEXTRACTSCALAR` and `REGEXP_LIKE` functions? Without an index structured to support these functions, they are naturally quite expensive. I'm using a JSON index on the column and operations like `JSON_MATCH(labels, 'demande_intention = ''foo''')` are fast (30-40ms) > Have you considered extracting `$.demande_intention` into a text column during ingestion so you can create a text index on it, instead of storing it embedded in JSON? Yep I know it would be the best way to do it but since the `labels` column contains dynamic data, we don't want to add each field of the JSON object to the schema -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
