This is an automated email from the ASF dual-hosted git repository.
jlli pushed a commit to branch testPBNJ
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git
The following commit(s) were added to refs/heads/testPBNJ by this push:
new 2e9a8f8 Test pbnj, create 1 segment instead of multiple for each push
job. (#6906)
2e9a8f8 is described below
commit 2e9a8f889a80aa50a7fb4d79677ef7727c6220ff
Author: Jiapeng Tao <jia...@linkedin.com>
AuthorDate: Wed May 12 17:13:56 2021 -0700
Test pbnj, create 1 segment instead of multiple for each push job. (#6906)
---
.../main/java/org/apache/pinot/hadoop/job/HadoopSegmentCreationJob.java | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/HadoopSegmentCreationJob.java
b/pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/HadoopSegmentCreationJob.java
index 474d9a4..9ecff20 100644
---
a/pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/HadoopSegmentCreationJob.java
+++
b/pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/HadoopSegmentCreationJob.java
@@ -69,7 +69,7 @@ public class HadoopSegmentCreationJob extends
SegmentCreationJob {
// Gather all data files
List<Path> dataFilePaths = getDataFilePaths(_inputPattern);
- int numDataFiles = dataFilePaths.size();
+ int numDataFiles = 1;
if (numDataFiles == 0) {
String errorMessage = "No data file founded with pattern: " +
_inputPattern;
_logger.error(errorMessage);
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org
