Re: Solr File based spellchecker is not returning expected result

2018-09-12 Thread Rajdeep Sahoo
Another ask is , how can I use multiple spellchecker at the same time based on condition Currently we are using two spellchecker [spellcheck.dictionary= wordbreak , spellcheck.dictionary=en ] If wordbreak dictionary is having suggesion it will make a second call for fethching the result and in

Re: how to access solr in solrcloud

2018-09-12 Thread Florian Gleixner
On 9/12/18 8:21 PM, Shawn Heisey wrote: > On 9/12/2018 7:38 AM, Gu, Steve (CDC/OD/OADS) (CTR) wrote: >> I am upgrading our solr to 7.4 and would like to set up solrcloud for >> failover and load balance.   There are three zookeeper servers >> (zk1:2181, zk1:2182) and two solr instance solr1:8983, s

Re: switch query parser and solr cloud

2018-09-12 Thread Dwane Hall
Thanks for the suggestions and responses Erick and Shawn. Erick I only return 30 records irrespective of the query (not the entire payload) I removed some of my configuration settings for readability. The parameter "allResults" was a little misleading I apologise for that but I appreciate your

Re: Solr Usage Question

2018-09-12 Thread Alexandre Rafalovitch
Your use case should not start from data stored, but from the queries you want to search. Then you massage your data to fit that. Don't worry too much about 'duplicate' too much at this stage. You could delete the historical records if needed. Or index them without storing. What you should try to

Re: Solr Usage Question

2018-09-12 Thread Walter Underwood
My recommendation is to put that data in a relational database. That does not look like an appropriate use for Solr. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Sep 12, 2018, at 1:10 PM, Samatha Sajja > wrote: > > Hi, > > I have a use case wh

Solr Usage Question

2018-09-12 Thread Samatha Sajja
Hi, I have a use case where I am not sure which type of fields to use. Use case: For every order line we would like to store statuses and quantities For ex, I have placed an order with some item quantity of 6. 4 of them got shipped and 2 of them in processing. I would like to search on status an

Solr File based spellchecker is not returning expected result

2018-09-12 Thread Rajdeep Sahoo
Hi , I am using solr 4.6 version. My document is having a "iphone 7" but when I am searching with with "iphone7" I am getting the result because here worddelimiterfilterfactory is taking care by slipt on numerics functionality. (Iphone7-->iphone 7) But I want solr to return a spellcheck suggestio

Re: 6.x to 7.x differences

2018-09-12 Thread John Blythe
thanks, shawn. yep, i saw the multi term synonym discussion when googling around a bit after your first reply. pretty jazzed about finally getting to tinker w that instead of creating our regex ducktape solution for_multi_term_synonyms! thanks again- -- John Blythe On Wed, Sep 12, 2018 at 2:15

Re: how to access solr in solrcloud

2018-09-12 Thread Shawn Heisey
On 9/12/2018 7:38 AM, Gu, Steve (CDC/OD/OADS) (CTR) wrote: I am upgrading our solr to 7.4 and would like to set up solrcloud for failover and load balance. There are three zookeeper servers (zk1:2181, zk1:2182) and two solr instance solr1:8983, solr2:8983. So what will be the solr url should

enquoted searches

2018-09-12 Thread John Blythe
hi (again!). hopefully this will be the last question for a while—i've really gotten my money's worth the last day or two :) searches like "foo bar" aren't working the same way they used to for us since our 7.4 upgrade this weekend. in both cases our phrase was wrapped in double quotes. the case

Re: 6.x to 7.x differences

2018-09-12 Thread Shawn Heisey
On 9/12/2018 8:12 AM, John Blythe wrote: shawn: at first, no. we rsynced data up after running it through the migration tool. we'd gotten errors when using WDF so updated all instances of it to WDGF (and subsequently added FlattenGraphFilterFactory to each index analyzer that used WDGF to avoid e

Re: Docker and Solr Indexing

2018-09-12 Thread Shawn Heisey
On 9/12/2018 7:43 AM, Dominique Bejean wrote: Are you aware about issues in Java applications in Docker if java version is not 10 ? https://blog.docker.com/2018/04/improved-docker-container-integration-with-java-10/ Solr explicitly sets heap size when it starts, so Java is *NOT* determining th

Re: large query producing graph error ... maybe?

2018-09-12 Thread John Blythe
well, it's our general text field that things get dumped into. this special use case that is sku specific just ends up being done on the general input. ended up raising the Xss value and i'm able to get results :) i imagine this is a n00b or stupid question but imma go for it: what would be the v

Re: large query producing graph error ... maybe?

2018-09-12 Thread Erick Erickson
Looks like your SKU field is points-based? Strings would probably be better, if you switched to points-based it's new code. And maxBooleanClauses is so old-school ;) You're better off with TermsQueryParser, especially if you pre-sort the tokens. see: https://lucene.apache.org/solr/guide/6_6/ot

Re: solr, multiple ports

2018-09-12 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 David, On 9/12/18 12:21 PM, David Hastings wrote: >> On Sep 12, 2018, at 12:15 PM, Christopher Schultz >> mailto:ch...@christopherschultz.net>> >> wrote: >> >> David, >> >> On 9/12/18 11:03 AM, David Hastings wrote: >>> is there a way to start the

Re: solr, multiple ports

2018-09-12 Thread David Hastings
Use case is we are upgrading our servers, and have been running solr 5 and 7 side by side on the same machines to make sure we got 7 to reflect the results of our current install. However to finally make the switch, it would require changing many many scripts and servers that have already been m

Re: solr, multiple ports

2018-09-12 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 David, On 9/12/18 11:03 AM, David Hastings wrote: > is there a way to start the default solr installation on more than > one port? Only thing I could find was adding another connector to > Jetty, via > https://stackoverflow.com/questions/6905098/h

Re: Unable to enable SSL with self-sign certs

2018-09-12 Thread Chris Hostetter
: WARN: (main) AbstractLifeCycle FAILED org.eclipse.jetty.server.Server@... : java.io.FileNotFoundException: /opt/solr-5.4.1/server (Is a directory) : java.io.FileNotFoundException: /opt/solr-5.4.1/server (Is a directory) : at java.io.FileInputStream.open0(Native Method) : at java

Faceting with EnumFieldType in 7.1

2018-09-12 Thread Peter Tyrrell
I updated an older Solr 4.10 core to Solr 7.1 recently. In so doing, I took an old 'gradeLevel_enum' field of type EnumField and made it an EnumFieldType, since the former has been deprecated. The old core was able to facet on gradeLevel_enum, but the new 7.1 core just returns no facet values wh

large query producing graph error ... maybe?

2018-09-12 Thread John Blythe
hey all! i'm having an issue w large queries. one of our use cases is for users to drop in an untold amount of product skus. we previously had our maxBooleanClause limit set to 20k (eek!). but it worked phenomenally well and i think our record amount from a user was ~19k items. we're now on 7.4 C

solr, multiple ports

2018-09-12 Thread David Hastings
is there a way to start the default solr installation on more than one port? Only thing I could find was adding another connector to Jetty, via https://stackoverflow.com/questions/6905098/how-to-configure-jetty-to-listen-to-multiple-ports however the default solr start command takes the -p parame

RE: how to access solr in solrcloud

2018-09-12 Thread Gu, Steve (CDC/OD/OADS) (CTR)
Vadim, That makes perfect sense. Thanks Steve -Original Message- From: Vadim Ivanov Sent: Wednesday, September 12, 2018 10:23 AM To: solr-user@lucene.apache.org Subject: RE: how to access solr in solrcloud Hi, Steve If you are using solr1:8983 to access solr and solr1 is down IMHO n

RE: how to access solr in solrcloud

2018-09-12 Thread Gu, Steve (CDC/OD/OADS) (CTR)
Thanks, Walter -Original Message- From: Walter Underwood Sent: Wednesday, September 12, 2018 10:41 AM To: solr-user@lucene.apache.org Subject: Re: how to access solr in solrcloud Use a load balancer. It doesn’t have to be fancy, we use the Amazon ALB because our clusters are in AWS. Z

RE: how to access solr in solrcloud

2018-09-12 Thread Gu, Steve (CDC/OD/OADS) (CTR)
Thanks, David -Original Message- From: David Santamauro Sent: Wednesday, September 12, 2018 10:28 AM To: solr-user@lucene.apache.org Cc: David Santamauro Subject: Re: how to access solr in solrcloud ... or haproxy. On 9/12/18, 10:23 AM, "Vadim Ivanov" wrote: Hi, Steve If y

Re: how to access solr in solrcloud

2018-09-12 Thread Walter Underwood
Use a load balancer. It doesn’t have to be fancy, we use the Amazon ALB because our clusters are in AWS. Zookeeper never handles queries. It coordinates cluster changes with the Solr instances. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Sep 12

Re: how to access solr in solrcloud

2018-09-12 Thread David Santamauro
... or haproxy. On 9/12/18, 10:23 AM, "Vadim Ivanov" wrote: Hi, Steve If you are using solr1:8983 to access solr and solr1 is down IMHO nothing helps you to access dead ip. You should switch to any other live node in the cluster or I'd propose to have nginx as frontend to

RE: how to access solr in solrcloud

2018-09-12 Thread Vadim Ivanov
Hi, Steve If you are using solr1:8983 to access solr and solr1 is down IMHO nothing helps you to access dead ip. You should switch to any other live node in the cluster or I'd propose to have nginx as frontend to access Solrcloud. -- BR, Vadim -Original Message- From: Gu, Steve (CDC

Re: switch query parser and solr cloud

2018-09-12 Thread Erick Erickson
You will run into significant problems if, when returning "all results", you return large result sets. For regular queries I like to limit the return to 100, although 1,000 is sometimes OK. Millions will blow you out of the water, use CursorMark or Streaming for very large result sets. CursorMark

Re: 6.x to 7.x differences

2018-09-12 Thread John Blythe
hey guys. preeti: good thought, but this was something we were already aware of and had accounted for. thanks tho! shawn: at first, no. we rsynced data up after running it through the migration tool. we'd gotten errors when using WDF so updated all instances of it to WDGF (and subsequently added

Re: Docker and Solr Indexing

2018-09-12 Thread Dominique Bejean
Hi, Are you aware about issues in Java applications in Docker if java version is not 10 ? https://blog.docker.com/2018/04/improved-docker-container-integration-with-java-10/ Regards. Dominique Le mer. 12 sept. 2018 à 05:42, Shawn Heisey a écrit : > On 9/11/2018 9:20 PM, solrnoobie wrote: > >

how to access solr in solrcloud

2018-09-12 Thread Gu, Steve (CDC/OD/OADS) (CTR)
Hi, all I am upgrading our solr to 7.4 and would like to set up solrcloud for failover and load balance. There are three zookeeper servers (zk1:2181, zk1:2182) and two solr instance solr1:8983, solr2:8983. So what will be the solr url should the client to use for access? Will it be solr1:89

Idle Timeout while DIH indexing and implicit sharding in 7.4

2018-09-12 Thread Вадим Иванов
Hello gurus,  I am using solrCloud with DIH for indexing my data. Testing 7.4.0 with implicitly sharded collection I have noticed that any indexing longer then 2 minutes always failing with many timeout records in log coming from all replicas in collection. Such as: x:Mycol_s_0_replica_t40 Reque

Re: switch query parser and solr cloud

2018-09-12 Thread Shawn Heisey
On 9/12/2018 5:47 AM, Dwane Hall wrote: Good afternoon Solr brains trust I'm seeking some community advice if somebody can spare a minute from their busy schedules. I'm attempting to use the switch query parser to influence client search behaviour based on a client specified request parameter.

Re: Retrieving binary fields

2018-09-12 Thread Mikhail Khludnev
Hello, Dominik. IIRC, fl=field(foo_field_1) On Wed, Sep 12, 2018 at 1:49 PM Dominik Safaric wrote: > Hi, > > I've implemented a custom FieldType, BinaryDocValuesField, that stores > binary values as doc-values. > > I am interested onto how can I retrieve the stored values via a Solr query > as b

switch query parser and solr cloud

2018-09-12 Thread Dwane Hall
Good afternoon Solr brains trust I'm seeking some community advice if somebody can spare a minute from their busy schedules. I'm attempting to use the switch query parser to influence client search behaviour based on a client specified request parameter. Essentially I want the following to occu

Retrieving binary fields

2018-09-12 Thread Dominik Safaric
Hi, I've implemented a custom FieldType, BinaryDocValuesField, that stores binary values as doc-values. I am interested onto how can I retrieve the stored values via a Solr query as base64 encoded string? Because if I issue a "*" query with all fields selected, I get all fields expect the binary

Re: Error casting to PointField

2018-09-12 Thread Shawn Heisey
On 9/11/2018 10:15 PM, Zahra Aminolroaya wrote: Thanks Erick. We used to use TrieLongField for our unique id and in the document it is said that all Trie* fieldtypes are casting to *pointfieldtypes. What would be the alternative solution? I've never heard of Trie casting to Point. Point is the

Re: 6.x to 7.x differences

2018-09-12 Thread Shawn Heisey
On 9/11/2018 8:32 PM, John Blythe wrote: we recently migrated to cloud. part of that migration jumped us from 6.1 to 7.4. one example query between our old solr instance and our new cloud instance produces 42 results and 19k results. the analyzer is the same aside from WordDelimiterFilterFactor

Merge update request with existing documents

2018-09-12 Thread Vincenzo D'Amore
Hi all, I have to update a bunch of documents but in the update requests there are only parts of the documents. Given that the atomic update is not a feasible option, because sometimes I have to remove one or more instances of a dynamic field but I'm unable to know their name(s) at update time.