Re: [PR] Add column name to JSONParsing exception message during index build [pinot]

2024-01-03 Thread via GitHub
walterddr merged PR #12151: URL: https://github.com/apache/pinot/pull/12151 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.ap

Re: [PR] Add column name to JSONParsing exception message during index build [pinot]

2023-12-19 Thread via GitHub
vrajat commented on code in PR #12151: URL: https://github.com/apache/pinot/pull/12151#discussion_r1432299319 ## pinot-core/src/test/java/org/apache/pinot/queries/JsonMalformedIndexTest.java: ## @@ -0,0 +1,139 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under on

Re: [PR] Add column name to JSONParsing exception message during index build [pinot]

2023-12-19 Thread via GitHub
Jackie-Jiang commented on code in PR #12151: URL: https://github.com/apache/pinot/pull/12151#discussion_r1432040654 ## pinot-core/src/test/java/org/apache/pinot/queries/JsonMalformedIndexTest.java: ## @@ -0,0 +1,139 @@ +/** + * Licensed to the Apache Software Foundation (ASF) un

Re: [PR] Add column name to JSONParsing exception message during index build [pinot]

2023-12-19 Thread via GitHub
vrajat commented on PR #12151: URL: https://github.com/apache/pinot/pull/12151#issuecomment-1862440379 Ran a manual test and was able to repro the error as well get the modified error message. I used this diff and ran `JsonIndexQuickStart`: ``` diff --git a/pinot-tools/src/

Re: [PR] Add column name to JSONParsing exception message during index build [pinot]

2023-12-18 Thread via GitHub
vrajat commented on PR #12151: URL: https://github.com/apache/pinot/pull/12151#issuecomment-1861065440 I'll do the manual test. re: integration test, the current test builds a segment for real. I copied the idea from another test that tests segment build. So hopefully this test is en

Re: [PR] Add column name to JSONParsing exception message during index build [pinot]

2023-12-18 Thread via GitHub
ege-st commented on PR #12151: URL: https://github.com/apache/pinot/pull/12151#issuecomment-1860961248 > > By the way, besides unit tests, were you able to do a manual test and see what happens when Pinot is running and this error happens? > > No I did not. Do I have to implement an i

Re: [PR] Add column name to JSONParsing exception message during index build [pinot]

2023-12-18 Thread via GitHub
vrajat commented on PR #12151: URL: https://github.com/apache/pinot/pull/12151#issuecomment-1860951021 > By the way, besides unit tests, were you able to do a manual test and see what happens when Pinot is running and this error happens? No I did not. Do I have to implement an integra

Re: [PR] Add column name to JSONParsing exception message during index build [pinot]

2023-12-18 Thread via GitHub
ege-st commented on PR #12151: URL: https://github.com/apache/pinot/pull/12151#issuecomment-1860774295 By the way, besides unit tests, were you able to do a manual test and see what happens when Pinot is running and this error happens? -- This is an automated message from the Apache Git S

Re: [PR] Add column name to JSONParsing exception message during index build [pinot]

2023-12-17 Thread via GitHub
vrajat commented on code in PR #12151: URL: https://github.com/apache/pinot/pull/12151#discussion_r1429450578 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/creator/impl/ColumnJsonParserException.java: ## @@ -0,0 +1,55 @@ +/** + * Licensed to the Apa

Re: [PR] Add column name to JSONParsing exception message during index build [pinot]

2023-12-15 Thread via GitHub
ege-st commented on code in PR #12151: URL: https://github.com/apache/pinot/pull/12151#discussion_r1428227636 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/creator/impl/SegmentColumnarIndexCreator.java: ## @@ -315,11 +316,14 @@ public void indexRow(

Re: [PR] Add column name to JSONParsing exception message during index build [pinot]

2023-12-15 Thread via GitHub
codecov-commenter commented on PR #12151: URL: https://github.com/apache/pinot/pull/12151#issuecomment-1857756476 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/12151?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) R

Re: [PR] Add column name to JSONParsing exception message during index build [pinot]

2023-12-14 Thread via GitHub
vrajat commented on code in PR #12151: URL: https://github.com/apache/pinot/pull/12151#discussion_r1427520654 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/creator/impl/ColumnJsonParserException.java: ## @@ -0,0 +1,59 @@ +/** + * Licensed to the Apa

Re: [PR] Add column name to JSONParsing exception message during index build [pinot]

2023-12-14 Thread via GitHub
vrajat commented on code in PR #12151: URL: https://github.com/apache/pinot/pull/12151#discussion_r1427519144 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/creator/impl/SegmentColumnarIndexCreator.java: ## @@ -315,11 +316,14 @@ public void indexRow(

Re: [PR] Add column name to JSONParsing exception message during index build [pinot]

2023-12-14 Thread via GitHub
swaminathanmanish commented on code in PR #12151: URL: https://github.com/apache/pinot/pull/12151#discussion_r1427440402 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/creator/impl/SegmentColumnarIndexCreator.java: ## @@ -315,11 +316,14 @@ public voi

Re: [PR] Add column name to JSONParsing exception message during index build [pinot]

2023-12-14 Thread via GitHub
swaminathanmanish commented on code in PR #12151: URL: https://github.com/apache/pinot/pull/12151#discussion_r1427440402 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/creator/impl/SegmentColumnarIndexCreator.java: ## @@ -315,11 +316,14 @@ public voi

Re: [PR] Add column name to JSONParsing exception message during index build [pinot]

2023-12-14 Thread via GitHub
swaminathanmanish commented on code in PR #12151: URL: https://github.com/apache/pinot/pull/12151#discussion_r1427436376 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/creator/impl/SegmentColumnarIndexCreator.java: ## @@ -315,11 +316,14 @@ public voi

[PR] Add column name to JSONParsing exception message during index build [pinot]

2023-12-14 Thread via GitHub
vrajat opened a new pull request, #12151: URL: https://github.com/apache/pinot/pull/12151 JSON Index build may fail due to errors in JSON content. When there are multiple JSON indices or when the schema is not immediately available, the column for which index build broke is not clear.