[
https://issues.apache.org/jira/browse/SOLR-14673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17166776#comment-17166776
]
Joel Bernstein edited comment on SOLR-14673 at 7/29/20, 12:51 AM:
------------------------------------------------------------------
I'd like to get this in so it can start being used. It's already done.
But, I agree it's time to start working on Streaming Expression package. The
timing is right. But, I'd like to not rush the implementation. Let's make sure
it all works right and take our time with it.
So basically I'd like to commit this so people can start using it and getting
from it. But I'm ready to start moving Streaming Expressions to a package, in
separate branch, which we can merge when ready. My preference would be to
release Streaming Expressions as package in 9.0. It's too big a change for 8.x.
was (Author: joel.bernstein):
I'd like to get this in so it can start being used. It's already done.
But, I agree it's time to start working on Streaming Expression package. The
timing is right. But, I'd like to not rush the implementation. Let's make sure
it all works right and take our time with it.
So basically I'd like to commit this so people can start using it and getting
from it. But I'm ready to start moving Streaming Expressions to a package, in
separate branch, which we can merge when ready.
> Add CLI for Streaming Expressions
> ---------------------------------
>
> Key: SOLR-14673
> URL: https://issues.apache.org/jira/browse/SOLR-14673
> Project: Solr
> Issue Type: New Feature
> Security Level: Public(Default Security Level. Issues are Public)
> Reporter: Joel Bernstein
> Assignee: Joel Bernstein
> Priority: Major
> Attachments: SOLR-14673.patch, SOLR-14673.patch, SOLR-14673.patch,
> SOLR-14673.patch, SOLR-14673.patch
>
>
> This ticket will provide a simple CLI that will run a Streaming Expression
> from the command line and return the results as a delimited result set. This
> will allow Streaming Expressions to be used from the command line to extract
> data as well as load data into Solr.
> Sample syntax:
> {code:java}
> bin/expr expr_file{code}
> This will run the expression in _expr_file_.
> Output will be to standard out as delimited records.
> *Standard-In, Standard-out and Pipe Composition.*
> The CLI can read from *standard-in* and write to *standard-out* in delimited
> records. This allows Streaming Expressions to be composed using unix pipes
> with other command line tools and other streaming expressions. Example syntax:
> {code:java}
> cat data.csv | ./bin/expr load.expr {code}
> The load.expr file uses the *stndin()* function to read from standard-in and
> load date to Solr. Here is a sample load.expr
> {code:java}
> let(cli-zkhost="localhost:9983",
>
> update(collection1,
> parseCSV(stndin()))
> {code}
> In the example above the *let* expression is used to set the *cli-zkhost* and
> then run the Streaming Expression:
> {code:java}
> update(collection1,
> parseCSV(stndin()){code}
> The *stndin* function reads the data from standard-in. The *parseCSV*
> function parses the lines into tuples and the *update* function sends the
> data to collection1 for indexing.
>
> *Querying Solr and Pipe Composition*
> The CLI can also be used to query Solr and pipe the result to other
> applications on the command line. This can automate activities like alerting,
> data backup, replication etc...
>
>
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
