Re: Number of occurrences in Solr Documents

2017-06-29 Thread David Hastings
I am using 5.2 and this works: select?q=*%3A*&wt=csv&indent=true&fl=totaltermfreq(text%2WORDIWANTTOFIND)&rows=1 On Thu, Jun 29, 2017 at 11:52 AM, Kaushik wrote: > Thanks to Susheel and Shawn. Unfortunately the Solr version we have is Solr > 5.3 and it does not include the totaltermfrequency fea

Re: Not highlighting "and" and "or"?

2017-06-29 Thread David Hastings
Agreed. Stop words from the moment I started using them caused complaints and problems right off the bat. They may have been implemented less than a week before needing a re-index to fix all the problems they caused. On Thu, Jun 29, 2017 at 4:55 PM, Walter Underwood wrote: > Ultraseek (and Inf

Re: Allow Join over two sharded collection

2017-07-01 Thread Glick, David
Unsubscribe Sent from my iPhone > On Jul 1, 2017, at 8:02 PM, Susheel Kumar wrote: > > Depending on your use case people also use collection aliasing for time > series data. See below > > https://blog.cloudera.com/blog/2013/10/collection-aliasing-near-real-time-search-for-really-big-data/ >

Optimization/Merging space

2017-07-05 Thread David Hastings
-David

Re: Issue: Hit Highlighting Working Inconsistently in Solr 6.6

2017-07-14 Thread David Smiley
Does hl.method=unified help any? Perhaps you need to set hl.fl? or hl.requireFieldMatch=false? (although it should default to false already) On Fri, Jul 14, 2017 at 6:52 PM Vikram Oberoi wrote: > Hi! > > Just wanted to close the loop here. > > I'm pretty sure this has something to do with the

Re: The unified highlighter html escaping. Seems rather extreme...

2017-07-20 Thread David Smiley
ne Carola A. Arndt Carolyn F. Levy Chitose Ogawa Christopher Mpofu Christopher P. Keuker Conrad V. Fernandez Craig Lotterman Daniel J. Greenfield David B. Dix David B. Wilson David L. Becton David S. Dickens Denise A. Rokitka Donna L. Johnston Douglas J. Scothorn Douglas R. Strother Douglas S. Hawkins

Json facet sort by subfacet

2017-07-25 Thread David Svånå
Hi, According to http://yonik.com/solr-facet-functions/, we can sort on "any facet function that appears in each bucket": $ curl http://localhost:8983/solr/query -d 'q=*:*& json.facet={ categories:{ type : terms, field : cat, sort : "x desc", // can also use sort:{x:desc}

Optimize stalls at the same point

2017-07-25 Thread David Hastings
I am trying to optimize a rather large index (417gb) because its sitting at 28% deletions. However when optimizing, it stops at exactly 492.24 GB every time. When I restart solr it will fall back down to 417 gb, and again, if i send an optimize command, the exact same 492.24 GB and it stops optim

Re: Optimize stalls at the same point

2017-07-25 Thread David Hastings
; wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > > > > On Jul 25, 2017, at 12:03 PM, David Hastings < > hastings.recurs...@gmail.com> wrote: > > > > I am trying to optimize a rather large index (417gb) because its sitting > at > > 28% deleti

Re: Optimize stalls at the same point

2017-07-25 Thread David Hastings
> >> XX:+ParallelRefProcEnabled verbose:gc XX:+PrintHeapAtGC > XX:+PrintGCDetails > >> XX:+PrintGCDateStamps XX:+PrintGCTimeStamps > XX:+PrintTenuringDistribution > >> XX:+PrintGCApplicationStoppedTime Xloggc:/SSD2TB01/solr > >> 5.2.1/server/logs/solr_gc.log >

Re: Disadvantages of having many cores

2017-07-28 Thread David Hastings
You're better off just using one core. Perhaps think about pre-processing the logs to "summarize" them into less "documents" I do this and in my situation i summarize things like, user-hits-item, for example. so i find all the times a certain user had hits on a certain item in one day and put tha

Re: Arabic words search in solr

2017-08-02 Thread David Hastings
perhaps change your default operator to AND instead of OR if thats what you are expecting for a result On Wed, Aug 2, 2017 at 8:57 AM, mohanmca01 wrote: > Hi Phil Scadden, > > Thank you for your reply, > > we tried your suggested solution by removing hyphen while indexing, but it > was getting

mixed index with commongrams

2017-08-03 Thread David Hastings
Hey all, I have yet to run an experiment to test this but was wondering if anyone knows the answer ahead of time. If i have an index built with documents before implementing the commongrams filter, then enable it, and start adding documents that have the filter/tokenizer applied, will searches that

Re: mixed index with commongrams

2017-08-03 Thread David Hastings
ction and then use, say, collection > aliasing to make the switch atomically. > > Best, > Erick > > On Thu, Aug 3, 2017 at 8:07 AM, David Hastings > wrote: > > Hey all, I have yet to run an experiment to test this but was wondering > if > > anyone knows the answe

Re: mixed index with commongrams

2017-08-03 Thread David Hastings
erwood > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > > > > On Aug 3, 2017, at 8:48 AM, David Hastings > wrote: > > > > Thanks, thats what i kind of expected. still debating whether the space > > increase is worth it, right now Im at .7% of searches tak

Re: MongoDb vs Solr

2017-08-04 Thread David Hastings
Also, id love to see an example of a many to many relationship in a nosql db as you described, since that's a rdbms concept. If it exists in a nosql environment I would like to learn how... > On Aug 4, 2017, at 10:56 PM, Dave wrote: > > Uhm. Dude are you drinking? > > 1. Lucidworks would neve

Re: Need help with query syntax

2017-08-10 Thread David Hastings
type:value AND (name:america^1+name:state^1+name:united^1) but in reality what you want to do is use the fq parameter with type:value On Thu, Aug 10, 2017 at 4:36 PM, OTH wrote: > Hello, > > I have the following use case: > > I have two fields (among others); one is 'name' and the other is 'typ

Re: [bulk]: Re: Optimizing Dataimport from Oracle; cursor sharing; changing oracle session parameters

2017-08-15 Thread David Hastings
If you dont want to use your own Solj code, why not try many concurrent indexers that index different data sets. So run seven indexers each getting 500,000 rows at the exact same time perhaps. Its a hack, if it works, but if you have the machinery to do it, why not. or use the deltaquery, but i h

Re: Spatial search with arbitrary rectangle?

2017-08-29 Thread David Smiley
or false. BTW sorry for my delayed response; I was on vacation. ~ David On Wed, Aug 23, 2017 at 11:21 AM Paweł Kordek wrote: > Hi All > > > I've been skimming through the spatial search docs and came across this > section: > > > > https://lucene.apache.org/solr/guide

Re: Index relational database

2017-08-31 Thread David Hastings
when indexing a relational database its generally always best to denormalize it in a view or in your indexing code On Thu, Aug 31, 2017 at 3:54 AM, Renuka Srishti wrote: > Thanks Erick, Walter > But I think join query will reduce the performance. Denormalization will be > the better way than joi

Re: Solr index getting replaced instead of merged

2017-08-31 Thread David Hastings
>Can anyone tell is it possible to paginate the data using Solr UI? use the start/rows input fields using standard array start as 0, ie start=0, rows=10 start=10, rows=10 start=20, rows=10 On Thu, Aug 31, 2017 at 8:21 AM, Agrawal, Harshal (GE Digital) < harshal.agra...@ge.com> wrote: > Hello A

Re: query with wild card with AND taking lot of time

2017-08-31 Thread David Hastings
> > 2) Because all your clauses are more like filters and are ANDed together, > you'll likely get better performance by putting them _each_ in an fq > E.g. > fq=product_identifier_type:DOTCOM_OFFER > fq=abstract_or_primary_product_id:[* TO *] why is this the case? is it just better to have no lo

Re: query with wild card with AND taking lot of time

2017-08-31 Thread David Hastings
a field:* query always takes a long time, and should be avoided if at all possible. solr/lucene is still going to try to rank the documents based on that, even thought theres nothing to really rank. every single document where that field is not empty will have the same score for that part of the

Re: Consecutive calls to a query give different results

2017-09-07 Thread David Hastings
"I am concerned that the same search gives different results after each search. The top document seems to cycle between 3 different documents" if you do debug query on the search, are the scores for the top 3 documents the same or not? you can easily have three documents with the same score, so

Re: Using SOLR J 5.5.4 with SOLR 6.5

2017-09-19 Thread David Hastings
What about the ConcurrentUpdateSolrServer for solrj? That is what almost all of my indexing code is using for solr 5.x, Its been a while since I experimented with upgrading but i seem to remember having to go to HttpSolrClient and couldnt get the code to compile, so i tabled the experiment for a w

Re: Using SOLR J 5.5.4 with SOLR 6.5

2017-09-19 Thread David Hastings
rwood > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > > > > On Sep 19, 2017, at 9:05 AM, David Hastings < > hastings.recurs...@gmail.com> wrote: > > > > What about the ConcurrentUpdateSolrServer for solrj? That is what almost

Re: Using SOLR J 5.5.4 with SOLR 6.5

2017-09-19 Thread David Hastings
erwood > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > > > > On Sep 19, 2017, at 9:54 AM, David Hastings < > hastings.recurs...@gmail.com> wrote: > > > > Do you use HttpSolrClient then? > > > > On Tue, Sep 19, 2017 at 12:26 PM, Wal

Re: Sorting by distance resources with WKT polygon data

2017-09-19 Thread David Smiley
th it; use one of the others just mentioned. ~ David On Tue, Sep 12, 2017 at 5:09 PM Grondin Luc wrote: > Hello, > > I am having difficulties with sorting by distance resources indexed with > WKT geolocation data. I have tried different field configurations and query > paramete

Re: Solrcloud configuration

2017-09-19 Thread David Hastings
Did you read the documentation on the schema and the DIH? On Tue, Sep 19, 2017 at 3:04 PM, Shashi Roushan wrote: > Hi All, > > I need your help to configure solrcloud with shards. > I have created collection and shards using solr6 and Zookeeper. Its working > fine. > My problems are: > Where I p

Re: Solr Streaming Question

2017-09-19 Thread David Hastings
I am also curious about this, specifically about indexed/non stored fields. On Tue, Sep 19, 2017 at 3:33 PM, Webster Homer wrote: > Is it possible to use the streaming API to stream documents from a > collection and load them into a new collection? I was thinking that this > would be a great way

Re: upgrade to 7.0.0

2017-09-29 Thread David Haynie
It's a known bug https://issues.apache.org/jira/browse/SOLR-11406 -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Solr Spatial Query Problem Hk.

2017-10-04 Thread David Smiley
Hi, Firstly, if Solr returns an error referencing an exception then you can look in Solr's logs for the stack trace, which helps debugging problems a ton (at least for Solr devs). I suspect that the problem here is that your schema might have a dynamic field where *coordinates is defined to be a

Semantic Knowledge Graph

2017-10-09 Thread David Hastings
Hey All, slides form the 2017 lucene revolution were put up recently, but unfortunately, the one I have the most interest in, the semantic knowledge graph, have not been put up: https://lucenesolrrevolution2017.sched.com/event/BAwX/the-apache-solr-semantic-knowledge-graph?iframe=no&w=100%&sidebar=

Re: Semantic Knowledge Graph

2017-10-09 Thread David Hastings
Thank you! from digging around i found the one from 2016: https://www.slideshare.net/treygrainger/the-semantic-knowledge-graph which seems very close to the presentation this past october. thanks again! -David On Mon, Oct 9, 2017 at 10:34 AM, Atita Arora wrote: > Hi, > > Is thi

Re: Querying fields that don't exist in every collection

2017-10-18 Thread David Hastings
I may be wrong here, but what i think is happening is the edismax parser sees a field that doesn't exist, and therefore "believes" all logic you entered into the query is a complete mistake and negates it as such. so NOT becomes the word not and * becomes whitespace. On Wed, Oct 18, 2017 at 3:15

Re: Querying fields that don't exist in every collection

2017-10-18 Thread David Hastings
be more intuitive than returning results but with > different search logic. > > Currently we add placeholder fields to other collections in an alias to > get around this if required, but it's messy. > > -Original Message- > From: David Hastings [mailto:hastings.rec

Re: Retrieve DocIdSet from Query in lucene 5.x

2017-10-24 Thread David Smiley
See SolrIndexSearcher.getDocSet. It may not be identical to what you want but following what it does on through to DocSetUtil.createDocSet may be enlightening. On Fri, Oct 20, 2017 at 5:10 PM Jamie Johnson wrote: > I am trying to migrate some old code that used to retrieve DocIdSets from > filt

In which order are commitwithin delete/add executed?

2017-10-30 Thread David Svånå
Hi, If I send multiple instructions /update with a bunch of deletes and adds, all having commitWithin specified, how can I make sure that the instructions are executed in the same order as I send them in? For example, if both a delete and an add is sent for the same ID, I want to be able to contr

Re: In which order are commitwithin delete/add executed?

2017-10-30 Thread David Svånå
th commitWithin set to 5 seconds, add for doc1 > T+1 delete for doc1 with commitWithin set for 5 seconds > T+5 both the add and delete are written > > Best, > Erick > > On Mon, Oct 30, 2017 at 4:35 AM, David Svånå > wrote: > > Hi, > > > > If I send mul

App Studio

2017-11-01 Thread David Hastings
Hey all, at the conference it was mentioned that lucidworks would release app studio as its own and free project. is that still the case?

Re: Sum area polygon solr

2017-11-01 Thread David Smiley
ation to score/sort on! Instead, perhaps you can use BBoxField's overlapRatio to compare bounding boxes which is relatively fast. ~ David On Tue, Oct 31, 2017 at 8:45 AM Samur Araujo wrote: > Hi all, is it possible to sum the area of a polygon in solr? > > Suppose I do an poly

Semantic Knowledge Graph

2017-11-10 Thread David Hastings
Im looking through the slides from 2016 as well as the presentation again from 2017 and in them there is a user interface for this project, that i dont see as being available so im assuming it was created as a different project, would be nice to have access to that. also, all of the examples in t

highlight separator

2017-11-22 Thread David Hastings
Im on solr 5.x at the moment, and am trying to get the highlighter to display complete sentences containing the match. setting: 'hl.method' => 'fastVector', 'hl.bs.type' =>'SENTENCE', hasnt been proving to work. is there a way for me to do it in the query itself? thanks -Dave

Re: highlight separator

2017-11-22 Thread David Hastings
Thanks, I kind of figured that was the case. On Wed, Nov 22, 2017 at 12:24 PM, Erick Erickson wrote: > I think that's only for the Unified Highlighter, which was introduced > to Lucene in 6.3 and Solr in 6.4. See: SOLR-9708 > > Best, > Erick > > On Wed, Nov 22, 2017

Combining complex joins with other criteria

2017-11-23 Thread David Frese
!join from=pid to=id}(city:"London" AND id:"a1")) (name:"Mike") AND ({!join from=pid to=id}(city:"London" AND id:"a1")) (name:"Mike" AND {!join from=pid to=id}(city:"London" AND id:"a1")) Some other variants do parse, but are somehow misunderstood and do not yield any results, like: name:"Mike" AND ({!join from=pid to=id}city:"London" AND id:"a1") Thanks for any help! -- David Frese

Re: Combining complex joins with other criteria

2017-11-23 Thread David Frese
Am 23.11.17 um 20:13 schrieb Mikhail Khludnev: Hello, David. It should be like q=name:"Mike" AND {!join from=pid to=id v=$qq}&qq=city:"London" AND id:"a1" Thanks a lot! But this looks like working around a bug, given that >> {!join from=pid to=id}(ci

Having trouble indexing nested docs using "split" feature.

2017-12-02 Thread David Lee
Hi all, I've been trying for some time now to find a suitable way to deal with json documents that have nested data. By suitable, I mean being able to index them and retrieve them so that they are in the same structure as when indexed. I'm using version 7.1 under linux Mint 18.3 with Oracle

Re: Having trouble indexing nested docs using "split" feature.

2017-12-02 Thread David Lee
uot;Adam Smith",     "reviewer_background": { "highest_rank": "Good", "latest_review": "10/10/2017 16:18:00.000 CST", } } ], "checkouts": [ { "member_id&

Re: Any Insights SOLR Rank tuning tool

2017-12-13 Thread David Hastings
lucidworks fusion is not open source David J. Hastings | Lead Developer dhasti...@wshein.com | 716.882.2600 x 176 William S. Hein & Co., Inc. 2350 North Forest Road | Getzville, NY 14068 www.wshein.com/contact-us From: Doug Turnbull Sent: Wedne

legacy replication

2017-12-15 Thread David Hastings
resources with very expensive servers to handle solr in standalone mode. thanks. -David

Re: legacy replication

2017-12-15 Thread David Hastings
s been used for "full sync" in > > SolrCloud when peer sync can't be done. > > > > 2> The new TLOG and PULL replica types are a marriage of old-style > > master/slave and SolrCloud. In particular a PULL replica is > > essentially an old-style slave. A TL

Re: OOM spreads to other replica's/HA when OOM

2017-12-19 Thread David Hastings
We put nginx servers in front of our three solr stand alone servers and three node gallera cluster, it works very well and the amount of control it gives you is really helpful. On Tue, Dec 19, 2017 at 10:58 AM, Walter Underwood wrote: > > On Dec 19, 2017, at 7:38 AM, Toke Eskildsen wrote: > > >

Integrating Opencart 3.0.2.0 with SOLR 7.1

2018-01-02 Thread David Taylor
very much appreciated. -- David Taylor davidtayl...@gmail.com Home + 44(0)1325 350020 Mobile +44(0)7592 369714 <http://uk.linkedin.com/pub/david-taylor/53/91/147/>

Re: Deliver static html content via solr

2018-01-04 Thread David Hastings
Its really easy if find for people to start going down this road. Have to always remind myself of the hammer and nail analogy. Use each tool for its purpose. On Thu, Jan 4, 2018 at 11:27 AM, Walter Underwood wrote: > Why would you even consider putting static HTML in a search engine? You > don

Re: Search opening hours

2016-11-24 Thread David Smiley
I just saw this conversation now. I didn't read every word but I have to ask immediately: does DateRangeField address your needs? https://cwiki.apache.org/confluence/display/solr/Working+with+Dates It was introduced in 5.0. On Wed, Nov 16, 2016 at 4:59 AM O. Klein wrote: > Above implementation

Re: Search opening hours

2016-11-28 Thread David Smiley
7;m not sure if LongRangeField would be faster than DateRangeField as the approaches are internally quite different. It probably would be. The other factor is index size, and I think those new range fields would generally be leaner. ~ David On Fri, Nov 25, 2016 at 4:18 PM O. Klein wrote: >

Re: How to identify documents failed in a batch request?

2016-12-17 Thread David Smiley
If you enable the "TolerantUpdateProcessor" Solr-side, you can add documents in bulk allowing some to fail and know which did: http://www.solr-start.com/javadoc/solr-lucene/org/apache/solr/update/processor/TolerantUpdateProcessorFactory.html On Sat, Dec 17, 2016 at 5:05 PM S G wrote: > Hi, > >

Solr 6.1: Specifying exponent optional parameter for BlendedInfixLookupFactory

2017-01-16 Thread David Bell
I know the default is 2.0, but I've tried a large variety of numbers and none of them have changed the results. Any insight would be appreciated. Thank you, David

retrieve ids of all indexed docs efficiently

2017-01-18 Thread Slomin, David
Hi -- I'd like to retrieve the ids of all the docs in my Solr 5.3.1 index. In my query, I've set rows=1000, fl=id, and am using the cursorMark mechanism to split the overall traversal into multiple requests. Not because I care about the order, but because the documentation implies that it's n

Re: retrieve ids of all indexed docs efficiently

2017-01-18 Thread Slomin, David
-- Jan Høydahl > Den 18. jan. 2017 kl. 21.44 skrev Slomin, David : > > Hi -- > > I'd like to retrieve the ids of all the docs in my Solr 5.3.1 index. In my query, I've set rows=1000, fl=id, and am using the cursorMark mechanism to split the o

Solr querying nested documents with ChildDocTransformerFactory, get “Parent query yields document which is not matched by parents filter”

2017-02-01 Thread David Kramer
Some background: · The data involved is catalog data, with three nested objects: Products, Items, and Skus, in that order. We have a docType field on each record as a differentiator. · The "id" field in our data is unique within datatype, but not across datatypes. We added a "u

Re: Solr querying nested documents with ChildDocTransformerFactory, get “Parent query yields document which is not matched by parents filter”

2017-02-02 Thread David Kramer
research that, but I mention that here in case it’s relevant. Thanks. On 2/2/17, 6:10 AM, "Mikhail Khludnev" wrote: David, Can you make sure your index doesn't have deleted docs? This can be seen in SolrAdmiun. And can you merge index to avoid having th

Re: Solr querying nested documents with ChildDocTransformerFactory, get “Parent query yields document which is not matched by parents filter”

2017-02-02 Thread David Kramer
. Thanks for your efforts so far. On 2/2/17, 3:13 PM, "Mikhail Khludnev" wrote: David, I hardly get the way which IDs are assigned, but beware that repeating uniqueKey value causes deleting former occurrence. In case of block join index it corrupts block structu

Re: Solr 6.4 new SynonymGraphFilter help for multi-word synonyms

2017-02-03 Thread David Smiley
Solr _does_ have a query parser that doesn't suffer from this problem -- SimpleQParser chosen as the string "simple". https://cwiki.apache.org/confluence/display/solr/Other+Parsers#OtherParsers-SimpleQueryParser In this case, see the "WHITESPACE" operator feature which can be toggled. Configure to

Re: Issues with uniqueKey != id?

2017-02-06 Thread David Kramer
I’m just setting that up now. I’m far from a Solr expert so I won’t swear we’re doing it right though Our issue is that we have documents, nested 3 deep. Products, Items, and SKUs. Each has an ID field that’s unique within the document type, but unfortunately we have products with the same ID

Re: Solr querying nested documents with ChildDocTransformerFactory, get “Parent query yields document which is not matched by parents filter”

2017-02-06 Thread David Kramer
worked! Thanks for your time and help. On 2/2/17, 4:35 PM, "David Kramer" wrote: Yes, think of the starving orphan records… Ours is an eCommerce system, selling mostly shoes. We have three levels of nested objects representing what we sell: - Product: Mostly

commongrams

2017-02-10 Thread David Hastings
Hey All, I followed an old blog post about implementing the common grams, and used the 400 most popular words file on a subset of my data. original index size was 33gb with 2.2 million documents, using the 400, it grep to 96gb. I scaled it down to the 100 most common words and got to about 76gb,

Re: Getting "Error getting file length for [segments_5]" warnings in Solr 6.4.0

2017-02-14 Thread David Hastings
well, if you look at the error: NoSuchFileException its looking for the segment file for generation 5, are you sure its present? On Tue, Feb 14, 2017 at 11:57 AM, Peter Matthew Eichman wrote: > Hello all, > > I am running Solr 6.4.0, and while I am attempting to index my Fedora 4 > data, I keep

Re: Question about best way to architect a Solr application with many data sources

2017-02-21 Thread David Hastings
And not to sound redundant but if you ever need help, database programmers are a dime a dozen, good luck finding solr developers that are available freelance for a price you're willing to pay. If you can do the solr anyone else that does web dev can do the sql > On Feb 21, 2017, at 8:17 PM, Dav

Re: Get docs with same value in one other field ?

2017-02-22 Thread David Hastings
for a reference to some examples: https://wiki.apache.org/solr/Join sor youd want something like: q={!join+from=fid=fid}i d:ZZZ i dont have much experience with this function however On Wed, Feb 22, 2017 at 4:40 PM, Alexan

Re: Get docs with same value in one other field ?

2017-02-22 Thread David Hastings
sorry embedded link: q={!join+from=fid=fid}id:ZZZ On Wed, Feb 22, 2017 at 4:58 PM, David Hastings < hastings.recurs...@gmail.com> wrote: > for a reference to some examples: > > https://wiki.apache.org/solr/Join > > sor youd want something like: > > q={!join+from=fi

Re: Viewing more than 10 results in Solr Admin

2017-02-28 Thread David Hastings
you want: "q=*:*&start=0&rows=20", or "q=*%3A*&start=0&rows=20", David J. Hastings | Lead Developer dhasti...@wshein.com | 716.882.2600 x 176 William S. Hein & Co., Inc. 2350 North Forest Road | Getzv

Re: What is the bottleneck for an optimise operation?

2017-03-02 Thread David Hastings
Agreed, and since it takes three times the space is part of the reason it takes so long, so that 190gb index ends up writing another 380 gb until it compresses down and deletes the two left over files. its a pretty hefty operation On Thu, Mar 2, 2017 at 10:13 AM, Alexandre Rafalovitch wrote: >

Re: Boolean expression for spatial query

2017-03-02 Thread David Smiley
I recommend the MULTIPOINT approach. BTW if you go the route of multiple OR'ed sub-clauses, I recommend avoiding the _query_ syntax which predates Solr 4.x's (4.2?) ability to embed fully the sub-clauses more naturally; though you need to beware of the gotcha of needing to add a leading space. If

Re: Facet? Search problem

2017-03-14 Thread David Hastings
glad it worked for you. im planning on some experimentation using that feature, could contribute to an interface nicely if thought through well. On Tue, Mar 14, 2017 at 2:25 PM, Scott Smith wrote: > Grouping appears to be exactly what I'm looking for. I added > "group=true&group.field=category

Re: Index corruption with replication

2017-03-15 Thread David Hastings
are you certain the schema is the same on both master and slave? I find that the schema file doesnt always go with the replication and if a field is different on the slave it will cause problems On Wed, Mar 15, 2017 at 12:08 PM, Santosh Sidnal wrote: > Hi all, > > I am facing issues of index co

Re: Get handler not working

2017-03-15 Thread David Hastings
from your previous email: "There is no "id" field defined in the schema." you need an id field to use the get handler On Wed, Mar 15, 2017 at 1:45 PM, Chris Ulicny wrote: > I thought that "id" and "ids" were fixed parameters for the get handler, > but I never remember, so I've already tried bot

Re: Get handler not working

2017-03-15 Thread David Hastings
if im not mistaken, the real time get handler uses the "id" field exclusively. I have never seen examples that use a different field then that one. the idea behind it is its a solr given unique value, yonik kind of sheds light on it here: http://yonik.com/solr/realtime-get/ so why not use the

Re: Get handler not working

2017-03-16 Thread David Hastings
4.9.0 standalone core with no explicit "id" field > >> defined by passing in the value for the uniqueKey field to the get > > handler. > >> We tend to have a bunch of id fields floating around from different > >> sources, so we avoid keeping any of them n

ChildDocTransformerFactory and returning only parents with children

2017-03-20 Thread David Kramer
Hi. We’re just ramping up a product search engine for our eCommerce site, so this is all new development and we are slowly building up our Solr knowledgebase, so thanks in advance for any guidance. Our catalog (mostly shoes and apparel) has three objects nested: Products (title, description, e

Re: ChildDocTransformerFactory and returning only parents with children

2017-03-20 Thread David Kramer
(if you need them). Regards, Alex. http://www.solr-start.com/ - Resources for Solr users, new and experienced On 20 March 2017 at 11:58, David Kramer wrote: > Hi. We’re just ramping up a product search engine for our eCommerce site, so this is all n

Re: Error creating core [da]: Error opening new searcher

2017-03-21 Thread David Hastings
AccessDeniedException im going to guess permissions, open them up when youre developing, well, i do, to 777 On Tue, Mar 21, 2017 at 11:37 AM, HrDahl wrote: > I am trying to create a solr core on a google cloud linux server using > binami > launchpad. But when im trying to create a new core it

Re: Error creating core [da]: Error opening new searcher

2017-03-21 Thread David Hastings
Here: /opt/bitnami/apache-solr/server/solr/da/data/index/write.lock so just set the permissions on /opt/bitnami/ to 777 it will save you headaches later. you can use the ap but not make any indexes. also delete that file if it exists On Tue, Mar 21, 2017 at 1:16 PM, HrDahl wrote: > The questi

Re: Error creating core [da]: Error opening new searcher

2017-03-21 Thread David Hastings
This is true, I was speaking more from a development standpoint as if im the only one with access to the machine. On Tue, Mar 21, 2017 at 2:47 PM, Erick Erickson wrote: > "Should you be aware of anything". Yes. Your security guys will go > nuts if you recursively gave 777 permissions. By changin

Re: Error with polygon search

2017-03-21 Thread David Smiley
quot; with "com.spatial4j.core". The only JTS jar file you need is "jts-1.14.jar". ~ David > On Mar 21, 2017, at 4:31 PM, hank wrote: > > Hello, > > > I'm having problems with a polygon search on location data. I've tried to > enable the JTS and Polygons fro

Re: Architecture suggestions

2017-03-23 Thread David Hastings
Yeah coming up with a "perfect" machine for your use is completely trial and error. for me personally i found that on one machine with 24 cores, 148gb ram, handles one solr instance with 4 cores, a 16mil records sitting at 400gb, a 53mil records sitting at 160gb, and a 108mil records sitting at 3

Re: Exception in export handler when using fq collapse that only returns one result

2017-03-28 Thread David Svånå
Expression. > > Joel Bernstein > http://joelsolr.blogspot.com/ > > On Fri, Mar 24, 2017 at 7:46 AM, David Svånå > wrote: > > > Hello, > > > > Summary: when using export handler with a collapse query, and only one > > result is returned because of the co

Phrase Fields performance

2017-03-31 Thread David Hastings
Hey all. I ran into an issue recently. I have a rather large index and in my application I had defined values for the "pf" parameter, but I had commented it out years ago not really knowing why I did it. Obviously the point of the pf helps rank fields higher if they are in close proximity, and th

Re: Phrase Fields performance

2017-04-04 Thread David Hastings
04 11:30:02 | 642.1838 | 136 | On Sat, Apr 1, 2017 at 11:13 AM, Dave wrote: > Maybe commongrams could help this but it boils down to > speed/quality/cheap. Choose two. Thanks > > > On Apr 1, 2017, at 10:28 AM, Shawn Heisey wrote: > > > >> On 3/31/2017 1:55 PM, D

Filtering results by minimum relevancy score

2017-04-10 Thread David Kramer
I’ve done quite a bit of searching on this. Pretty much every page I find says it’s a bad idea and won’t work well, but I’ve been asked to at least try it to reduce the number of completely unrelated results returned. We are not trying to normalize the number, or display it as a percentage, an

CommonGrams

2017-04-11 Thread David Hastings
Hi, was wondering if there are any known drawbacks to using the CommonGram factory, in regards to such features as the "more like this"

Re: Filtering results by minimum relevancy score

2017-04-12 Thread David Kramer
The idea is to not return poorly matching results, not to limit the number of results returned. One query may have hundreds of excellent matches and another query may have 7. So cutting off by the number of results is trivial but not useful. Again, we are not doing this for performance reasons

Re: Filtering results by minimum relevancy score

2017-04-12 Thread David Kramer
Thank you! That worked. From: Ahmet Arslan Date: Wednesday, April 12, 2017 at 3:15 PM To: "solr-user@lucene.apache.org" , David Kramer Subject: Re: Filtering results by minimum relevancy score Hi, I cannot find it. However it should be something like q=hello&fq={!frange

Re: keywords not found - google like feature

2017-04-13 Thread David Hastings
Another ugly solution would be to use the debugQuery=true option, then analyze the reults in explain, if the word isnt in the explain, then you strike it out. On Thu, Apr 13, 2017 at 4:01 PM, Markus Jelsma wrote: > Hi - There is no such feature out-of-the-box in Solr. But you probably > could mo

Re: SOLR Indexed object delete automatically.

2017-04-24 Thread David Hastings
you dont have to log in to the server to send the delete command. is the computers ip address public? On Mon, Apr 24, 2017 at 3:13 PM, Saurav Maulick wrote: > thanks Erick for quick replay. > > I the log file we have found that deleteByQuery entry. but i have checked > with windows team they h

Re: Poll: Master-Slave or SolrCloud?

2017-04-25 Thread David Hastings
I can definitely attest to this. The really nice thing about the standard Solr/Jetty configuration is that its all there, Lucene+Solr+Jetty and you just turn it on and run, and after only minor tweaks to JVM and memory settings, its effectively production ready with a reliable master- slave config

Re: DateRangeField and Faceting

2017-04-26 Thread David Smiley
you see there are some gaps. ~ David On Fri, Apr 21, 2017 at 2:47 PM Stephen Weiss wrote: > One small detail - I just realized I've been doing JSON faceting and the > wiki refers to old-school faceting. Old-school faceting indeed does work > but the problem is the facet is ultim

Re: Poll: Master-Slave or SolrCloud?

2017-04-27 Thread David Lee
the JSON issue, but it would be nice to have some documentation that goes more in-depth on how to set up additional nodes. Also, even though I use ZK for other parts of my application, I have no problem with a version running specifically for Solr if it makes this process more straight-forward

Re: Spatial Search: can not use FieldCache on a field which is neither indexed nor has doc values: latitudeLongitude_0_coordinate

2017-04-30 Thread David Smiley
s for sure assuming you are using the latest Solr release (6.5.x). You said "Solr version 6.1.0" which doesn't have this field type though. ~ David On Thu, Apr 27, 2017 at 8:26 AM freddy79 wrote: > Hi, > > when doing a query with spatial search i get the error: can not

Re: Reload an unloaded core

2017-05-02 Thread David Lee
uite as straight-forward in Solr so I'm looking for other options. Thanks, David On 5/2/2017 5:04 PM, Shashank Pedamallu wrote: Thank you Simon, Erick and Shawn for your replies. Unfortunately, restarting Solr is not a option for me. So, I’ll try to follow the steps given by Shawn to

<    1   2   3   4   5   6   7   8   9   10   >