Re: Using multiple language stop words in Solr Core

2021-02-11 Thread Markus Jelsma
Hell Abhay, Do not enable stopwords unless you absolutely know what you are doing. In general, it is a bad practice that somehow still lingers on. But to answer the question, you must have one field and fieldType for each language, so language specific filters go there. Also, using edismax and mu

Re: Using fromIndex for single collection

2020-11-19 Thread Jason Gerlowski
Hi Irina, Yes, the "fromIndex" parameter can be used to perform a join from the host collection to a separate, single-shard collection in SolrCloud. If specified, this "fromIndex" collection must be present on whichever host is processing the request. (Often this involves over-replicating your "f

RE: Using Multiple collections with streaming expressions

2020-11-12 Thread ufuk yılmaz
Many thanks for the info Joel --ufuk Sent from Mail for Windows 10 From: Joel Bernstein Sent: 12 November 2020 17:00 To: solr-user@lucene.apache.org Subject: Re: Using Multiple collections with streaming expressions T

Re: Using Multiple collections with streaming expressions

2020-11-12 Thread Joel Bernstein
> > From: Erick Erickson > Sent: 10 November 2020 16:48 > To: solr-user@lucene.apache.org > Subject: Re: Using Multiple collections with streaming expressions > > Y > >

RE: Using Multiple collections with streaming expressions

2020-11-10 Thread ufuk yılmaz
16:48 To: solr-user@lucene.apache.org Subject: Re: Using Multiple collections with streaming expressions Y

Re: Using Multiple collections with streaming expressions

2020-11-10 Thread Erick Erickson
You need to open multiple streams, one to each collection then combine them. For instance, open a significantTerms stream to collection1, another to collection2 and wrap both in a merge stream. Best, Erick > On Nov 9, 2020, at 1:58 PM, ufuk yılmaz wrote: > > For example the streaming expressi

RE: Using streaming expressions with shards filter

2020-10-06 Thread Gael Jourdan-Weil
Thanks Joel. I will try it in the future if I still need it (for now I went for another solution that fits my needs). Gaël

Re: Using streaming expressions with shards filter

2020-10-06 Thread Joel Bernstein
Actually it's: .shards=shard1,shard2,shard3... Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Oct 6, 2020 at 2:38 PM Joel Bernstein wrote: > > There is a parameter in streaming expressions for this but it is not > available for use in every stream source. The search expression should

Re: Using streaming expressions with shards filter

2020-10-06 Thread Joel Bernstein
There is a parameter in streaming expressions for this but it is not available for use in every stream source. The search expression should honor it though. If you pass the .shard=shard1,shard2,shard3... The search stream will honor this. This work was originally done for supporting no-SolrCloud

RE: Using Solr's zkcli.sh

2020-09-02 Thread Victor Kretzer
ginal Message- From: Vincent Brehin Sent: Wednesday, September 2, 2020 6:10 AM To: solr-user@lucene.apache.org Subject: Re: Using Solr's zkcli.sh Hi Victor, For me also it's a first post to the list. Even if I am quite old to solr, I am a recent subscriber. I guess you used install_

Re: Using Solr's zkcli.sh

2020-09-02 Thread Vincent Brehin
Hi Victor, For me also it's a first post to the list. Even if I am quite old to solr, I am a recent subscriber. I guess you used install_solr_service.sh script for installing (either directly or through ansible role, or another wrapper). IIRC this script removes exec permission for some other comma

Re: using solr to extarct keywords from a long text?

2020-06-11 Thread David Zimmermann
Hi Mikhail Your suggested solution does seem to work for me. Thank you so much for the help! Best regards David For future reference in case someone else wants do the same, here are some more details about the steps needed: - The more like this handler is not in the default solrconfig.xml anym

Re: using solr to extarct keywords from a long text?

2020-06-10 Thread Mikhail Khludnev
Hello, David. >From the code I noticing that MoreLikeThisHandler consumes request body when there's no ?q= and analyzes it for doing what are you asking for. I see that ref guide obscured this feature. On Wed, Jun 10, 2020 at 4:37 PM David Zimmermann wrote: > Dear solr community > > I’m suppose

Re: using aliases in topic stream

2020-05-16 Thread Joel Bernstein
haven't taken the effort to > try and change it. Do you think this could be it? > > Jonathan > -Original Message- > From: Joel Bernstein > Sent: Thursday, May 14, 2020 6:32 PM > To: solr-user@lucene.apache.org > Subject: Re: using aliases in topic stream >

RE: using aliases in topic stream

2020-05-16 Thread Nightingale, Jonathan A (US)
Bernstein Sent: Thursday, May 14, 2020 6:32 PM To: solr-user@lucene.apache.org Subject: Re: using aliases in topic stream *** WARNING *** EXTERNAL EMAIL -- This message originates from outside our organization. This is where the alias work was done: https://issues.apache.org/jira/browse/SOL

Re: using aliases in topic stream

2020-05-14 Thread Joel Bernstein
che/solr/client/solrj/io/stream/StreamDecoratorTest.java > > @Test > public void testTerminatingDaemonStream() throws Exception { > Assume.assumeTrue(!useAlias); > > -Original Message- > From: Joel Bernstein > Sent: Wednesday, May 13, 2020 1:11 PM > To: solr-user@luce

RE: using aliases in topic stream

2020-05-14 Thread Nightingale, Jonathan A (US)
void testTerminatingDaemonStream() throws Exception { Assume.assumeTrue(!useAlias); -Original Message- From: Joel Bernstein Sent: Wednesday, May 13, 2020 1:11 PM To: solr-user@lucene.apache.org Subject: Re: using aliases in topic stream *** WARNING *** EXTERNAL EMAIL -- This message origi

RE: using aliases in topic stream

2020-05-14 Thread Nightingale, Jonathan A (US)
Currently playing with 8.1 but 7.4 is what's in our production environment. -Original Message- From: Joel Bernstein Sent: Wednesday, May 13, 2020 1:11 PM To: solr-user@lucene.apache.org Subject: Re: using aliases in topic stream *** WARNING *** EXTERNAL EMAIL -- This message origi

Re: using aliases in topic stream

2020-05-13 Thread Joel Bernstein
What version of Solr are you using? The topic stream in master seems to have the code in place to query aliases. Joel Bernstein http://joelsolr.blogspot.com/ On Wed, May 13, 2020 at 12:33 PM Nightingale, Jonathan A (US) < jonathan.nighting...@baesystems.com> wrote: > Hi Everyone, > > I'm trying

Re: using aliases in topic stream

2020-05-13 Thread ART GALLERY
check out the videos on this website TROO.TUBE don't be such a sheep/zombie/loser/NPC. Much love! https://troo.tube/videos/watch/aaa64864-52ee-4201-922f-41300032f219 On Wed, May 13, 2020 at 11:32 AM Nightingale, Jonathan A (US) wrote: > > Hi Everyone, > > I'm trying to run this stream and I get t

Re: using S3 as the Directory for Solr

2020-04-25 Thread Kevin Risden
Solr's use of the HdfsDirectory may work over S3 directly if you use the Hadoop AWS binding - s3a [1]. The idea is to replace hdfs:// with s3a://bucket/. Since S3 is eventually consistent, the Hadoop AWS s3a project has s3guard to help with consistent listing. If you are only doing queries (no inde

Re: using S3 as the Directory for Solr

2020-04-24 Thread dhurandar S
Its 10 PB of source data, But we do have indexes on most of the attributes. 80% or so We have a need to support such large data and we have use cases of finding a needle in the haystack kinda scenario. Most of our users are used to Search query language or Solr in addition to SQL. So we would have

Re: using S3 as the Directory for Solr

2020-04-23 Thread Walter Underwood
It will be a lot more than 2X or 3X slower. Years ago, I accidentally put Solr indexes on an NFS mounted filesystem and it was 100X slower. S3 would be a lot slower than that. Are you doing relevance-ranked searches on all that data? That is the only reason to use Solr instead of some other sol

Re: using S3 as the Directory for Solr

2020-04-23 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Rahul, On 4/23/20 21:49, dhurandar S wrote: > Thank you for your reply. The reason we are looking for S3 is since > the volume is close to 10 Petabytes. We are okay to have higher > latency of say twice or thrice that of placing data on the local >

Re: using S3 as the Directory for Solr

2020-04-23 Thread dhurandar S
Hi Jan, Thank you for your reply. The reason we are looking for S3 is since the volume is close to 10 Petabytes. We are okay to have higher latency of say twice or thrice that of placing data on the local disk. But we have a requirement to have long-range data and providing Seach capability on tha

Re: using S3 as the Directory for Solr

2020-04-23 Thread Jan Høydahl
Hi, Is your data so partitioned that it makes sense to consider splitting up in multiple collections and make some arrangement that will keep only a few collections live at a time, loading index files from S3 on demand? I cannot see how an S3 directory would be able to effectively cache files in

Re: Re: Re: Using Synonym Graph Filter with StandardTokenizer does not tokenize the query string if it has multi-word synonym

2020-03-16 Thread Audrey Lorberfeld - audrey.lorberf...@ibm.com
I don't think you can synonym-ize both the multi-token phrase and each individual token in the multi-token phrase at the same time. But anyone else feel free to chime in! Best, Audrey Lorberfeld On 3/16/20, 12:40 PM, "atin janki" wrote: I aim to achieve an expansion like - Syno

Re: Re: Using Synonym Graph Filter with StandardTokenizer does not tokenize the query string if it has multi-word synonym

2020-03-16 Thread atin janki
I aim to achieve an expansion like - Synonym(soap powder) + Synonym(soap) + Synonym (powder) which is not happening because of the Synonym expansion is being done at the moment. At the moment, using Synonym Graph Filter with StandardTokenizer and sow = false , expands as - Synonym(soap powd

Re: Re: Using Synonym Graph Filter with StandardTokenizer does not tokenize the query string if it has multi-word synonym

2020-03-16 Thread Audrey Lorberfeld - audrey.lorberf...@ibm.com
To confirm, you want a synonym like "soap powder" to map onto synonyms like "hand soap," "hygiene products," etc? As in, more of a cognitive synonym mapping where you feed synonyms that only apply to the multi-token phrase as a whole? On 3/16/20, 12:17 PM, "atin janki" wrote: Using sow=t

Re: Using Synonym Graph Filter with StandardTokenizer does not tokenize the query string if it has multi-word synonym

2020-03-16 Thread atin janki
Using sow=true, does split the word on whitespaces but it will not look for synonyms of "soap powder" anymore, rather it expands separate synonyms for "soap" and "powder". Best Regards, Atin Janki On Mon, Mar 16, 2020 at 4:59 PM Audrey Lorberfeld - audrey.lorberf...@ibm.com wrote: > Have you

Re: Using Synonym Graph Filter with StandardTokenizer does not tokenize the query string if it has multi-word synonym

2020-03-16 Thread Audrey Lorberfeld - audrey.lorberf...@ibm.com
Have you set sow=true in your search handler? I know that we have it set to false (sow = split on whitespace) because we WANT multi-token synonyms retained as multiple tokens. On 3/16/20, 10:49 AM, "atin janki" wrote: Hello everyone, I am using solr 8.3. After I include

Re: Using QT param with /select

2020-03-10 Thread Atita Arora
Hi, Thanks for looping back in. We use Master-Slave! I resolved this one with handleSelect=true , removing /select handler from config and created another requesthandler (with a different name - other than select) and marking that as default="true". Now all the requests with qt param are handled by

Re: Using QT param with /select

2020-03-10 Thread Mikhail Khludnev
Hello, Atita. My question here is that on Solr 6.2.6 to enable using 'qt' param I need to > do handleSelect=false Can you elaborate on that? What exactly happens? Also, please clarify whether you use SolrCloud or standalone? On Mon, Mar 2, 2020 at 7:37 PM Atita Arora wrote: > Hi, > > I am wo

Re: Using Synonym Graph Filter does not tokenize the query string if it has multi-word synonym

2020-03-01 Thread Paras Lehana
Hi Atin, Please host your images on some other site as they won't reach the mailing list as attachments. I had researched about Synonym support for a week before enabling them in Auto-Suggest. Why do you want multi-term synonyms to break? I guess only for matching documents and not tokenized synon

Re: Using MM efficiently to get right number of results

2020-02-13 Thread Erick Erickson
It can be basically any thing you can do with a standard Solr query. > On Feb 13, 2020, at 9:09 AM, Nitin Arora wrote: > > Thanks Erick, a follow-up question for RerankQParser: > How complex can the rerank query itself be? Can we add multiple boost > factors based on different conditions - say,

Re: Using MM efficiently to get right number of results

2020-02-13 Thread Nitin Arora
Thanks Erick, a follow-up question for RerankQParser: How complex can the rerank query itself be? Can we add multiple boost factors based on different conditions - say, if category is X boost by 2, if brand is Y boost by 3, etc.? On Mon, 10 Feb 2020 at 18:12, Erick Erickson wrote: > There isn’t

Re: Using MM efficiently to get right number of results

2020-02-10 Thread Erick Erickson
There isn’t really an “industry standard”, since the reasons someone wants this kind of behavior vary from situation to situation. That said, Solr has RerankQParserPlugin that’s designed for this. Best, Erick > On Feb 10, 2020, at 4:23 AM, Nitin Arora wrote: > > I am looking for an efficient w

Re: Using solr 7.7.2, Is it safe to manually delete tlog after doing commit?

2019-12-21 Thread Erick Erickson
I wouldn’t remove the entire directory, but yeah, after a commit you should be fine to remove all of the files/directories _under_ tlog. > On Dec 20, 2019, at 5:35 PM, alwaysbluesky wrote: > > Using solr 7.7.2. > > Our CDCR is broken for some reason as I posted the other > question(https://l

Re: Using Deep Paging with Graph Query Parser

2019-12-17 Thread Chris Hostetter
: Is there a way to use combine paging's cursor feature with graph query : parser? it should work just fie -- the cursorMark logic doesn't care what query parser you use. Is there a particular problem you are running into when you send requests using both? -Hoss http://www.lucidworks.com/

Re: Using an & in an indexed field and then querying for it.

2019-11-25 Thread David Hastings
This again is why its recommended to have something inbetween your js and solr, also gets have limitations so if eventually you start getting more complications you may hit it: https://stackoverflow.com/questions/2659952/maximum-length-of-http-get-request On Mon, Nov 25, 2019 at 2:40 PM rhys J w

Re: Using an & in an indexed field and then querying for it.

2019-11-25 Thread rhys J
On Mon, Nov 25, 2019 at 2:36 PM David Hastings wrote: > its breaking on the & because its in the url and you are most likely > sending a get request to solr. you should send it as post or as %26 > > The package I am using doesn't have a postJSON function available, so I'm using their getJSON fun

Re: Using an & in an indexed field and then querying for it.

2019-11-25 Thread David Hastings
its breaking on the & because its in the url and you are most likely sending a get request to solr. you should send it as post or as %26 On Mon, Nov 25, 2019 at 2:32 PM rhys J wrote: > I have some fields that have text like so: > > Reliable Van & Storage. > > They indexed fine when I used curl

Re: using scoring to find exact matches while using a cursormark

2019-11-18 Thread rhys J
> ...so w/o a score param you're getting the default sort: score "desc" > (descending)... > > > https://lucene.apache.org/solr/guide/8_3/common-query-parameters.html#CommonQueryParameters-ThesortParameter > > "If the sort parameter is omitted, sorting is performed as though > the >

Re: using scoring to find exact matches while using a cursormark

2019-11-18 Thread Chris Hostetter
: If I use the following query:in the browser, I get the expected results at : the top of the returned values from Solr. : : { : "responseHeader":{ : "status":0, : "QTime":41, : "params":{ : "q":"( clt_ref_no:OWL-2924-8 ^2 OR contract_number:OWL-2924-8^2 )", : "indent":

Re: using NOT or - to exclude results with a textField type

2019-11-15 Thread Shawn Heisey
On 11/15/2019 10:15 AM, rhys J wrote: I'm trying to exclude results based on the documentation about the boolean NOT symbol, but I keep getting errors. I've tried: http://localhost:8983/solr/debt/select?q=clt_ref_no:-”owl-2924-8” and http://localhost:8983/solr/debt/select?q=clt_ref_no:NOT”owl

Re: using NOT or - to exclude results with a textField type

2019-11-15 Thread Erick Erickson
On of Solr’s little quirks… Solr does _not_ implement Boolean logic. See: https://lucidworks.com/post/why-not-and-or-and-not/ What you want is something like: ../select/q=*:* -clt_ref_no:“owl-2924-8” Best, Erick > On Nov 15, 2019, at 12:15 PM, rhys J wrote: > > I'm trying to exclude results b

Re: using gt and lt in a query

2019-11-14 Thread rhys J
On Thu, Nov 14, 2019 at 1:28 PM Erick Erickson wrote: > You might be able to make this work with function queries…. > > > I managed to decipher something along the lines of this: http://10.40.10.14:8983/solr/debt/select?q=orig_princ_amt: 0 TO

Re: using gt and lt in a query

2019-11-14 Thread Erick Erickson
You might be able to make this work with function queries…. Best, Erick > On Nov 14, 2019, at 1:26 PM, Shawn Heisey wrote: > > On 11/14/2019 11:09 AM, rhys J wrote: >> But I'm not doing a range, I'm doing a query on whether one field is >> greater than another field. Or am I missing something h

Re: using gt and lt in a query

2019-11-14 Thread Shawn Heisey
On 11/14/2019 11:09 AM, rhys J wrote: But I'm not doing a range, I'm doing a query on whether one field is greater than another field. Or am I missing something here? I am unaware of any way to do that with simple query syntax. Sometimes there is capability that I do not know about, though.

Re: using gt and lt in a query

2019-11-14 Thread rhys J
> Range queries are done with brackets and/or braces. A square bracket > indicates that the range should include the precise value mentioned, and > a curly brace indicates that the range should exclude the precise value > mentioned. > > > https://lucene.apache.org/solr/guide/8_2/the-standard-query

Re: using gt and lt in a query

2019-11-14 Thread Shawn Heisey
On 11/14/2019 10:49 AM, rhys J wrote: I am trying to duplicate this line from a db query: (debt.orig_princ_amt > 0 AND debt.princ_paid > 0 AND debt.orig_princ_amt > debt.princ_paid) I have the following, but it returns no results: Range queries are done with brackets and/or braces. A square

Re: using fq means no results

2019-11-12 Thread Erik Hatcher
To add bq in there makes it query parser specific. But I’m being pedantic since most folks are using edismax where that applies (along with a bunch of other params that would also deserve mention, like boost and bf). q and fq, agreed for the explanation. bq mentioned only if specifics and sib

Re: using fq means no results

2019-11-12 Thread Walter Underwood
I explain it this way: * fq: filtering * q: filtering and scoring * bq: scoring wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Nov 12, 2019, at 9:08 AM, Erik Hatcher wrote: > > > >> On Nov 12, 2019, at 12:01 PM, rhys J wrote: >> >> On Tue, Nov

Re: using fq means no results

2019-11-12 Thread Erik Hatcher
> On Nov 12, 2019, at 12:01 PM, rhys J wrote: > > On Tue, Nov 12, 2019 at 11:57 AM Erik Hatcher > wrote: > >> fq is a filter query, and thus narrows the result set provided by the q >> down to what also matches all specified fq's. >> >> > So this can be used instead of scoring? Or alongsid

Re: using fq means no results

2019-11-12 Thread rhys J
On Tue, Nov 12, 2019 at 11:57 AM Erik Hatcher wrote: > fq is a filter query, and thus narrows the result set provided by the q > down to what also matches all specified fq's. > > So this can be used instead of scoring? Or alongside scoring? > You gave it a query, "cat_ref_no", which literally l

Re: using fq means no results

2019-11-12 Thread Erik Hatcher
fq is a filter query, and thus narrows the result set provided by the q down to what also matches all specified fq's. You gave it a query, "cat_ref_no", which literally looks for that string in your default field. Looking at your q parameter, cat_ref_no looks like a field name, and your fq sh

Re: Using solr API to return csv results

2019-11-07 Thread Paras Lehana
Hi Rhys, There's already a JIRA for this: https://issues.apache.org/jira/browse/SOLR-2731. You can comment on the ticket. I also recommend you to read about /export handler. On Fri, 8 Nov 2019 at 01:39, rhys J wrote: > If I

Re: Re: using the df parameter to set a default to search all fields

2019-10-22 Thread Audrey Lorberfeld - audrey.lorberf...@ibm.com
Eek, Shawn, you're right -- I'm sorry, all! I meant to say the the QF (!) parameter. And pasted the wrong thing too ☹ This is what ours looks like with the qf parameter (and the edismax parser) title_en^1.5 description_en^0.5 content_en^0.5 headings_en^1.3 keywords_en^1.5 url^0

Re: using the df parameter to set a default to search all fields

2019-10-22 Thread Shawn Heisey
On 10/22/2019 11:42 AM, Audrey Lorberfeld - audrey.lorberf...@ibm.com wrote: I think you actually can search over all fields, but not in the df parameter. We have a big list of fields we want to search over. So, we just put a dummy one in the df param field, and then we use the fl parameter. Wi

Re: using the df parameter to set a default to search all fields

2019-10-22 Thread Shawn Heisey
On 10/22/2019 11:17 AM, rhys J wrote: How would I enter qf parameters in the solrconfig.xml? In the handler definition you would simply add the parameter like you did when you added df. edismax field1 field2 field3 I included the parameter in the above example that sw

Re: Re: using the df parameter to set a default to search all fields

2019-10-22 Thread Audrey Lorberfeld - audrey.lorberf...@ibm.com
I think you actually can search over all fields, but not in the df parameter. We have a big list of fields we want to search over. So, we just put a dummy one in the df param field, and then we use the fl parameter. With the edismax parser, this works. It looks something like this:

Re: using the df parameter to set a default to search all fields

2019-10-22 Thread rhys J
> Solr does not have a way to ask for all fields on a search. If you use > the edismax query parser, you can specify multiple fields with the qf > parameter, but there is nothing you can put in that parameter as a > shortcut for "all fields." Using qf with multiple fields is the > cleanest way to

Re: using the df parameter to set a default to search all fields

2019-10-22 Thread Shawn Heisey
On 10/22/2019 10:26 AM, rhys J wrote: How do I make Solr search on all fields in a document? Solr does not have a way to ask for all fields on a search. If you use the edismax query parser, you can specify multiple fields with the qf parameter, but there is nothing you can put in that parame

Re: Using Tesseract OCR to extract PDF files in EML file attachment

2019-10-16 Thread Charlie Hull
My colleagues Eric Pugh and Dan Worley covered OCR and Solr in a presentation at our recent London Lucene/Solr Meetup: https://www.meetup.com/Apache-Lucene-Solr-London-User-Group/events/264579498/ (direct link to slides if you can't find it in the comments https://www.slideshare.net/o19s/payload

RE: Using Tesseract OCR to extract PDF files in EML file attachment

2019-10-14 Thread Retro
Hello, thanks for answer, but let me explain the setup. We are running our own backup solution for emails (messages from Exchange in MSG format). Content of these messages then indexed in SOLR. But SOLR can not process attachments within those MSG files, can not OCR them. This is what I need - to O

RE: Using Tesseract OCR to extract PDF files in EML file attachment

2019-10-11 Thread Davis, Daniel (NIH/NLM) [C]
rg > Subject: Re: Using Tesseract OCR to extract PDF files in EML file attachment > > AJ Weber wrote > > There are alternative, paid, libraries to parse and extract attachments > > from EML files as well > > EML attachments will have a mimetype associated with their metadat

Re: Using Tesseract OCR to extract PDF files in EML file attachment

2019-10-11 Thread Retro
AJ Weber wrote > There are alternative, paid, libraries to parse and extract attachments > from EML files as well > EML attachments will have a mimetype associated with their metadata. Hello, can you give a hint what are those commercial libraries that would do the job? We need to index MSG files

Re: using let() with other streaming expressions

2019-08-16 Thread Joel Bernstein
Yes, the examples you show will fail because the "let" expression reads streams into an in-memory List. All the Streaming Expressions expect a TupleStream to be passed in rather that a List. There is an undocumented function that turns a List of tuples back into a Stream. The function is called "s

Re: Using custom scoring formula

2019-08-08 Thread Chee Yee Lim
Hi Arnold, One way to approach this is to store the topic vector you calculated with each of the associated Solr document into a pseudo-vector field (i.e. formatted string field). Then parse the string field into actual vector for calculation when you need it. Something similar to this, https://gi

Re: Using Solr as a Database?

2019-06-05 Thread Ralph Soika
Hello Christopher, On 03.06.19 23:13, Christopher Schultz wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Ralph, On 6/2/19 16:32, Ralph Soika wrote: The whole system is highly transactional as it runs on Java EE with JPA and Session EJBs. And you write-through from your application ->

Re: Using Solr as a Database?

2019-06-03 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Daniel, On 6/3/19 16:26, Davis, Daniel (NIH/NLM) [C] wrote: > I think the sweet spot of Cassandra and Solr should be mentioned > in this discussion. Cassandra is more scalable/clusterable than > an RDBMS, without losing all of the structure that i

Re: Using Solr as a Database?

2019-06-03 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Ralph, On 6/2/19 16:32, Ralph Soika wrote: > The whole system is highly transactional as it runs on Java EE with > JPA and Session EJBs. And you write-through from your application -> RDBMS -> Lucene/Solr? How are you handling commits (both soft a

RE: Using Solr as a Database?

2019-06-03 Thread Davis, Daniel (NIH/NLM) [C]
I think the sweet spot of Cassandra and Solr should be mentioned in this discussion. Cassandra is more scalable/clusterable than an RDBMS, without losing all of the structure that is desirable in an RDBMS. In contrast, if you use a full document store such as MongoDB, you lose some of the

Re: Using Solr as a Database?

2019-06-03 Thread Shawn Heisey
On 6/2/2019 7:28 AM, Ralph Soika wrote: This is not intended to contradict the other replies you've gotten, only supplement them. Now as far as I understand is solr a cluster enabled datastore which can be used to store also all the data form our document. The problem with relational database

Re: Using Solr as a Database?

2019-06-02 Thread Ralph Soika
Thanks a lot again for your answers. I do now better understand the operation purpose of Solar Thanks for your help === Ralph On 02.06.19 23:27, Erick Erickson wrote: Not exactly. If I’m reading this right, you do now, and will continue, to have all the data in the RDBMS, correct? That’s wha

Re: Using Solr as a Database?

2019-06-02 Thread Erick Erickson
Not exactly. If I’m reading this right, you do now, and will continue, to have all the data in the RDBMS, correct? That’s what I call the “system of record”. So you’re not talking about getting rid of the RDBMS, rather basically copying it all over in to Solr and periodically updating your Solr

Re: Using Solr as a Database?

2019-06-02 Thread Dave
You *can use solr as a database, in the same sense that you *can use a chainsaw to remodel your bathroom. Is it the right tool for the job? No. Can you make it work? Yes. As for HA and cluster rdbms gallera cluster works great for Maria db, and is acid compliant. I’m sure any other database h

Re: Using Solr as a Database?

2019-06-02 Thread Walter Underwood
> On Jun 2, 2019, at 6:28 AM, Ralph Soika wrote: > > Now as far as I understand is solr a cluster enabled datastore which can be > used to store also all the data form our document. That understanding is incorrect. Solr is not a data store. Reasoning based on that false assumption leads to fa

Re: Using Solr as a Database?

2019-06-02 Thread Ralph Soika
Thanks Jörn and Erick for your explanations. What I do so far is the following:  * I have a RDBMS with one totally flatten table holding all the data and the id.  * The data is unstructured. Fields can vary from document to document. I have no fixed schema. A dataset is represented by a Hashma

Re: Using Solr as a Database?

2019-06-02 Thread Erick Erickson
You must be able to rebuild your index completely when, at some point, you change your schema in incompatible ways. For that reason, either you have to play tricks with Solr (i.e. store all fields or the original document or….) or somehow have access to the original document. Furthermore, star

Re: Using Solr as a Database?

2019-06-02 Thread Jörn Franke
It depends what you want to do with it. You can store all fields in Solr and filter on them. However, as soon as it comes to Acid guarantees or if you need to join the data you will be probably needing something else than Solr (or have other workarounds eg flatten the table ). Maybe you can des

Re: Using copyFields

2019-03-28 Thread Sharmadha
Thanks. Adding default field in solrconfig.xml worked. -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Using copyFields

2019-03-28 Thread Toke Eskildsen
On Thu, 2019-03-28 at 05:03 -0700, Sharmadha wrote: > I created my own field named "cfield1" of type text_general and added > a copyField with src = "*" and dest = "cfield1". Posted the films > data. After this , on typing "comedy" in query field , the query > doesn't fetch results. You need to te

Re: Using copyFields

2019-03-28 Thread Sharmadha
As mentioned in https://lucene.apache.org/solr/guide/7_7/solr-tutorial.html#create-a-catchall-copy-field , instead of having a copyField on src="*" ,dest ="_text_" , I added a copyField with src="*" ,dest ="cfield". when I did copyField on src="*" ,dest ="_text_" , on firing query=comedy , it list

Re: Using copyFields

2019-03-28 Thread Jörn Franke
What do you mean does not fetch results? It returns the found documents, but not the text content? In this case you need to store the field. Is comedy a stop word defined by you? > Am 28.03.2019 um 13:03 schrieb Sharmadha : > > Following solr tutorial , > https://lucene.apache.org/solr/guide/7_

Re: Using solr graph to traverse N relationships

2019-03-13 Thread Pratik Patel
Problem #1 can probably be solved by using "fetch" function. ( https://lucene.apache.org/solr/guide/6_6/stream-decorators.html#fetch) Problem #2 and #3 can be solved by normalizing the graph connections and by applying cartesianProduct on multi valued field, as described here. http://lucene.472066

Re: Using the terms component in Solr Cloud gives random result

2019-02-01 Thread Markus Kalkbrenner
I’ll answer my own question: setting distrib=true solved the issue … mostly Our client requests wt=json&json.nl =flat But the result isn’t flat! As soon I set distrib=true the json response is formatted as a map instead go being flat. Did I find a bug or this a known limitati

Re: Using function in fiter query

2018-10-08 Thread Emir Arnautović
Hi Skanth, You can use FunctionRangeQueryParser to do that: https://lucene.apache.org/solr/guide/6_6/other-parsers.html#OtherParsers-FunctionRangeQueryParser Let us know if you are having troubles

Re: using uuid for documents

2018-09-21 Thread Zahra Aminolroaya
Hello Alfonso, I expected that we could use *uuid* updateRequestProcessorChain like below for generating unique value for unique key: uniqueKey However, I saw that you used *dedupe* updateRequestProcessorChain as below; true ……… I wonder if we can use *UUIDUpdateP

Re: using uuid for documents

2018-09-18 Thread Alfonso Muñoz-Pomer Fuentes
Hi Zahra, I’m not sure I understand your question. Could you explain with more detail what it is that you want to achieve? > On 18 Sep 2018, at 06:00, Zahra Aminolroaya wrote: > > Hello Alfonso, > > > Thanks. You used the dedupe updateRequestProcessorChain, so for this > application we canno

Re: using uuid for documents

2018-09-17 Thread Zahra Aminolroaya
Hello Alfonso, Thanks. You used the dedupe updateRequestProcessorChain, so for this application we cannot use the uuid updateRequestProcessorChain individually?! Best, Zahra -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: using uuid for documents

2018-09-16 Thread Alfonso Muñoz-Pomer Fuentes
Hi Zahra, We had a similar issue in our collections and we solved this by generating a UUID value using the content of other fields, in reply to your first question. Have a look at the section https://lucene.apache.org/solr/guide/7_4/update-request-processors.html#custom-update-request-processo

Re: Using LUWAK in SOLR

2018-06-25 Thread SOLR4189
Ok. If somebody needs I found solution: https://github.com/flaxsearch/luwak/issues/173 -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Using Solr / Lucene with OpenJDK

2018-05-10 Thread Shawn Heisey
On 5/10/2018 8:56 AM, Christopher Schultz wrote: What version of OpenJDK did you happen to run? I don't remember for sure, but it was probably version 8. All my current Solr installs are on machines with Oracle Java. My preference would be for Java 8, but on my Debian Wheezy install only Ja

Re: Using Solr / Lucene with OpenJDK

2018-05-10 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Shawn, On 4/24/18 11:23 AM, Shawn Heisey wrote: > On 4/24/2018 8:50 AM, Steven White wrote: >> Does anyone use Solr, any version, with OpenJDK? If so, what >> has been you experience? Also, what platforms have you used it >> on? > > I've used it

Re: Using Solr / Lucene with OpenJDK

2018-04-24 Thread Shawn Heisey
On 4/24/2018 8:50 AM, Steven White wrote: We currently support both Oracle and IBM Java to run Solr and I'm task to switch over to OpenJDK. Oracle Java is the preferred choice.  OpenJDK should be work very well, as long as it's at least version 7.  Recent Solr versions require Java 8, so that

Re: Using Solr to search website and external Oracle ServiceCloud

2018-04-11 Thread Emir Arnautović
Hi, You have several options: 1. keep date as is and implement federated search logic with two queries - one to Solr and other to Oracle. PRO: no need to change data flow. CON: Results are not comparable when it comes to scores and you will probably need to present it as separate groups 2. impor

Re: Using Solr to build a product matcher, with learning to rank

2018-03-29 Thread Rahul Singh
Maybe overthinking this. There is a “more like this” feature at basically does this. Give that a try before digging deeper into the LTR methods. It may be good enough for rock and roll. -- Rahul Singh rahul.si...@anant.us Anant Corporation On Mar 28, 2018, 12:25 PM -0400, Xavier Schepler , wr

Re: Using multi valued field in solr cloud Graph Traversal Query

2018-03-16 Thread Jan Høydahl
> Adding multi-value field support is a fairly high priority so I would > expect this to be coming in a future release. I got this question from a client of mine as well. Trying to find a JIRA issue for multi value support, is there one? -- Jan Høydahl, search solution architect Cominvent AS - w

Re: Using Synonyms as a feature with LTR

2018-02-14 Thread Roopa Rao
I see okay, thank you. On Wed, Feb 14, 2018 at 10:34 AM, Alessandro Benedetti wrote: > I see, > According to what I know it is not possible to run for the same field > different query time analysis. > > Not sure if anyone was working on that. > > Regards > > > > - > --- > Alessan

  1   2   3   4   5   6   7   8   9   10   >