Re: Issues with Authentication / Role based authorization

Ok, I'm really struggling to figure out the right approach here. I wanted to make it simple and started fresh. Removed the existing node (node1 and node2), started the server in Cloud mode and uploaded the following security.json. { "authentication": { "blockUnknown": true, "class": "sol

How to search string

I want to search a product and product name is "Garmin Class A" so I expect result is product name matching string "Garmin Class A" but it searches separately i dont know why and how it happen.Please guide me how to search a string in only one field only not in other fields. "debug": { "rawquer

Re: [scottchu] What kind of configuration to use for this size of news data?

A further question: Can master-slave and SolrCloud exist simultaneously in one Solr server? If yes, how can I do it? scott.chu，scott@udngroup.com 2016/5/11 (週三) - Original Message - From: scott(自己) To: solr-user CC: Date: 2016/5/11 (週三) 11:11 Subject: [scottchu] What kind of conf

Search score showing in exponential format

Hi, I found that in my result search, there are some results which has got a score which looks like the following: "score":6.705859E-6}] This is probably a figure with a very small value, and it may occur in queries which has a large number of records found. Is there a way to standardise the fi

Sorting for MLT results

Hi, Would like to check, is there a function to do the sorting for MLT results in Solr? I understand that there is a sort function, but that only works for the main query results. It does not do any sorting for the MLT results I'm using Solr 5.4.0. Regards, Edwin

[scottchu] What kind of configuration to use for this size of news data?

Fix some typos, add some words and resend same question => I want to build a Solr engine for over 60-year news articles. My requests are (I use Solr 5.4.1): 1> Currently over 10M no. of docs. 2> Currently over 60GB total data size. 3> The no. of docs and data size will keep growing at the rate

[scottchu] What kind of configuration to use for this size of news data?

I want to build a Solr engine for over 60-year news articles. My requests are (I use Solr 5.4.1): 1> Currently over 10M no. of docs. 2> Currently over 60GB total data size. 3> The no. of docs and data size will keep growing at the rate of 1000 no. of docs(or 8MB size) per day. 4> There are tota

Re: what scene using carrot2 cluster

I'm using carrot2 clustering with Solr. I'm using the Lingo3GClusteringAlgorithm, but that requires a licence. Othwrwise, you can use the default LingoClusteringAlgorithm. Regards, Edwin On 10 May 2016 at 22:43, xiangliumi <852262...@qq.com> wrote: > hi，all > > does someone have used carrot2 wit

Re:Re: solrcloud performance problem

Hi Shawn, Thanks for your help. the args used to start solr are as following, and upload my screen shot to http://www.yupoo.com/photos/qzone3927066199/96064170/, please help to take a look, thanks. -DSTOP.PORT=7989 -DSTOP.KEY= -DzkHost=node1:2181,node2:2181,node3:2181/solr -Dsolr.solr.hom

Re: How to search in solr for words like %rek Dr%

Thank you, Yes i am aware that surround with quotes will result in match for space but i am trying to match word based on input which cant be controlled. I need to search solr for %rek Dr% and return all result which has "rek Dr" without qoutes. -- View this message in context: http://lucen

Re: Transforming SolrDocument to SolrInputDocument in Solr 6.0

Not sure if that's useful, but the samples that ship with Solr show how to transform Solr XML output into Solr Update XML format using XSLT post-processing. Regards, Alex. Newsletter and resources for Solr beginners and intermediates: http://www.solr-start.com/ On 11 May 2016 at 01:36, S

How do we generate SHA256 password for Authentication

Hi, I'm trying to setup Authentication and Role-based authorization in Solr 5.5. Beside "Solr" user from example, I've created another user "dev". I've used the following website to generate sha256 encoded password. http://www.lorem-ipsum.co.uk/hasher.php I've used password as "password" . He

Re: How to search in solr for words like %rek Dr%

That is going to be a very slow search in Solr. But if you want to match space separated words, that is very easy and fast in Solr. Surround the phrase in quotes: “N Derek”. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On May 10, 2016, at 3:53 PM,

Re: How to search in solr for words like %rek Dr%

Thanks Nick, will look into it. My main moto is to able to search like %xxx xxx% similar to database search of contians with. -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-search-in-solr-for-words-like-rek-Dr-tp4275854p4275970.html Sent from the Solr - User maili

Re: Simulate doc linking via post filter cache check

Mikhail, that's an interesting idea. If a terms list could stand in for a cache that may be helpful. What I don't fully see is how the search would work. Building an explicit negative terms query with returned IDs doesn't seem possible as that list would be in the millions. To drastically speed my

Re: Simulate doc linking via post filter cache check

The problem description is really long, you know. I'd attack the statement: > Since it's not possible to do a RDBMS like search joining the 2 > doc types, I need to run the saved search: find docs where name=Johnson, > then drop the docs that are not in a doclist. > And also, if you remove all ma

Re: Facet ignoring repeated word

G, Rajesh wrote: > Thanks Toke. The issue I have is I cannot look for a specific word e.g. ddr > in termfreq(%27name%27,%20%27ddr%27). I have to find count of all words > and their sum Is that really the case? As your field is a comment field, your word cloud could easily contain tens or hundred

Re: Re: Transforming SolrDocument to SolrInputDocument in Solr 6.0

NP, Having to dive into the patch is kind of arcane... On Tue, May 10, 2016 at 8:54 AM, Stephan Schubert wrote: > Ouch... thanks a lot ;) > > > Mit freundlichen Grüßen / Best regards > > Stephan Schubert > Senior Web Application Engineer | IT Engineering Information Oriented > Applications >

Re: How to search in solr for words like %rek Dr%

Don't really get what "Q= {!dismax qf=address} "rek Dr*" - It is not allowed since perfix in Quotes is not allowed" means, why cant you use exact phrase matching? Do you have some limitation of quoting as you are specifically looking for an exact phrase I dont see why you wouldn't want exact matchi

RE: Solr 5.4.1 Mergeindexes duplicate rows

As per Shawn's advice I deleted the index data using http://localhost:8983/solr/Sitecore_SharePoint/update?stream.body=%3Cdelete%3E%3Cquery%3E*:*%3C/query%3E%3C/delete%3E&commit=true and then stopped and started Solr and the duplicates were gone. Will keep a watch! Thanks much! -- View this

Re: Re-indexing in SolRCloud while keeping the collection online -- Best practice?

Hi Erick, Most of the time we have to do a full re-index: I do love your second idea, I will take a look at the details of that. Thank you! :) Cheers, Peter 2016-05-10 17:10 GMT+02:00 Erick Erickson : > Peter: > > Yeah, that would work, but there are a couple of alternatives: > 1> If there's an

Re: How to search in solr for words like %rek Dr%

I have tried with and search using the Extended Dismax Q= {!dismax qf=address} rek Dr* - It did not work as expected since i am getting all the records which has rek, Dr . Q= {!dismax qf=address} "rek Dr*" - It is not allowed since perfix in Quotes is not allowed. Q= {!complexphrase inOrder=tr

Re: auto purge for embedded zookeeper

That makes perfect sense Shawn. I will clean up the old log data the old fashioned way. thanks, Ted -- View this message in context: http://lucene.472066.n3.nabble.com/auto-purge-for-embedded-zookeeper-tp4275561p4275857.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: Solr 5.4.1 Mergeindexes duplicate rows

Thanks for your reply! Some questions: Is Solr in cloud mode or running standalone? Standalone If you look at the core overview in the admin UI for these three cores, can you tell me what Num Docs, Max Doc, and the index size is for all three indexes? SharePoint_All Num Docs: 6211 Max Doc= 621

Re: How to search in solr for words like %rek Dr%

You can use a combination of ngram or edgengram fields and possibly the shingle factory if you want to combine words. Also might want to have it as exact text with no query sloop if the two words, even the partial text, need to be right next to each other. Edge is great for left to right ngram is g

How to search in solr for words like %rek Dr%

I am trying to search a field named Address which has a space in it. Example : Address has the below values in it. 1. 2000 North Derek Dr Fullerton 2. 2011 N Derek Drive Fullerton 3. 2108 N Derek Drive Fullerton 4. 2100 N Derek Drive Fullerton 5. 2001 N Drive Derek Fullerton Search Query:- Derek

Antwort: Re: Transforming SolrDocument to SolrInputDocument in Solr 6.0

Ouch... thanks a lot ;) Mit freundlichen Grüßen / Best regards Stephan Schubert Senior Web Application Engineer | IT Engineering Information Oriented Applications SICK AG | Erwin-Sick-Str. 1 | 79183 Waldkirch | Germany Phone +49 7681 202-3751 | Fax | mailto:stephan.schub...@sick.de | http://w

Re: Transforming SolrDocument to SolrInputDocument in Solr 6.0

Hmm, looking at the patch I see: DocumentObjectBinder binder = new DocumentObjectBinder(); . . . SolrInputDocument solrInputDoc = binder.toSolrInputDocument(in); But I confess I didn't actually try it. On Tue, May 10, 2016 at 8:41 AM, Stephan Schubert wrote: > In Solr 6.0 the method ClientUtil

RE: Solr edismax field boosting

Hi Nick We found the issue. We had set the type of some of the fields as "string". After changing the fields to "text_general" boosting started working. You were right , Solr was not finding the search term in those fields as String only supports exact match and doesn’t tokenise content. T

Simulate doc linking via post filter cache check

I'm pulling my hair out on this one - and there's not much of that to begin with. The problem I have is that updating 10M denormalized docs in a collection takes about 5 hours. Soon there will be collections with 100M docs and a 50 hour update cycle will not be acceptable. The process involves clea

Re: Solr 5.x bug with Service installation script?

Hi Shawn - You brought up a good point. This might be a possible reason. I'll test it out. Thanks! My index (4.5g) usually takes about 15-20 secs to load. One other observation - even though it says write.lock file in a specific data directory path, when I look up the directory, I don't see any w

Transforming SolrDocument to SolrInputDocument in Solr 6.0

In Solr 6.0 the method ClientUtils.toSolrInputDocument() was removed (deprecated since 5.5.1, see https://issues.apache.org/jira/browse/SOLR-8339). What is the best way now to transform a SolrDocument into a SolrInputDocument? Mit freundlichen Grüßen / Best regards Stephan Schubert Senior Web A

Re: Solr 5.x bug with Service installation script?

Hi Erick - I used "sudo service solr stop" to shut it down. On Tue, May 10, 2016 at 12:26 AM, Erick Erickson wrote: > How do you shut down your Solrs? Any kind of un-graceful > stopping (kill -9 is a favorite) may leave the lock file around. > > It can't be coming from nowhere, so my guess is th

Transforming SolrDocument to SolrInputDocument in Solr 6.0

In Solr 6.0 the method ClientUtils.toSolrInputDocument() was removed (deprecated since 5.5.1, see https://issues.apache.org/jira/browse/SOLR-8339). What is the best way now to transform a SolrDocument into a SolrInputDocument? Mit freundlichen Grüßen / Best regards Stephan Schubert Senior Web A

Re: Unable to achieve boosting into solr 5.5

Please review: http://wiki.apache.org/solr/UsingMailingLists You haven't shown us what you _do_ get, what you expect, why you think there's an error. Adding &debug=query will show you the parsed query and may give you a clue. Best, Erick On Mon, May 9, 2016 at 11:02 PM, Upendra Kumar Baliyan wr

Re: Solr edismax field boosting

Megha, What are the field types for the fields you are trying to search through? Grab a copy of the schema.xml and paste the relevant fields. My guess is you have _text_ as some copy field for everything else and have it stored=false correct? I am no seeing that field in the output above. Also in

Re: Filter queries & caching

No. Please re-read and use the admin plugins/stats page to examine for yourself. 1) fq=filter(fromfield:[* TO NOW/DAY+1DAY]&& tofield:[NOW/DAY-7DAY TO *]) && fq=type:abc && is totally unnecessary when using fq clauses, there is already an implicit AND. I'm not even sure what the above does, I do

Re: solrcloud performance problem

On 5/9/2016 11:42 PM, lltvw wrote: > By using jps command double check the parms used to start solr, i found that > the max heap size already set to 10G. So I made a big mistake yesterday. > > But by using solr admin UI, I select the collection with performance problem, > in the overview page I

Re: query action with wrong result size zero

Usually such issues are troubleshooted with: Solr admin: schema browser and analysis. Also, you might need to check debugQuery=true output and perhaps use explainOther param. 05 мая 2016 г. 18:58 пользователь "mixiangliu" <852262...@qq.com> написал: i found a strange thing with solr query，when i

Re: Re-indexing in SolRCloud while keeping the collection online -- Best practice?

Peter: Yeah, that would work, but there are a couple of alternatives: 1> If there's any way to know what the subset of docs that's changed, just re-index _them_. The problem here is picking up deletes. In the RDBMS case this is often done by creating a trigger for deletes and then t

How to restrict outside IP access in Solr with internal jetty server

I am using solr 5.3 version with inbuilt jetty server. I am looking for a proxy kind of thing which i could prevent outside User access for all of the link, I would give only access select and select core url accessibility other than this should be not open. Please give me some suggestion. Than

Re: Replicate Between sites

bq: Why not use classic replication between one node in the cluster and another node in the other cluster. First of all in SolrCloud I'm pretty sure you can't do that, where "that" is have classic replication operate where the source was one SolrCloud and the destination is another SolrCloud clust

Using Ping Request Handler in SolrCloud within a load balancer

A couple of questions ... We've upconfig'd the ping request handler to ZooKeeper within the solrconfig.xml.  SolrCloud and ZooKeeper are working fine. I understand that the /solr/admin/ping command is for a ping on its local server only (not from a remote machine).  This is working.I also underst

Re-indexing in SolRCloud while keeping the collection online -- Best practice?

Hi Everyone, I am wondering if there is any best practice regarding re-indexing documents in SolrCloud 6.0.0 without making the data (or the underlying collection) temporarily unavailable. Wiping all documents in a collection and performing a full re-indexing is not a viable alternative for us. S

Re: auto purge for embedded zookeeper

On 5/9/2016 1:11 PM, tedsolr wrote: > I have a development environment that is using an embedded zookeeper, and the > zoo_data folder continues to grow. It's filled with snapshot files that are > not getting purged. zoo.cfg has properties > autopurge.snapRetainCount=10 > autopurge.purgeInterval=1 >

what scene using carrot2 cluster

hi，all does someone have used carrot2 with solr，please give me a scene description when using carrot2，and best give me some links about deploying solr5.x and carrot2. thanks for your help! thanks Max Mi Sent using CloudMagic Email [https://cloudmagic.com/k/d/mailapp?ct=pa&cv=8.4.52&pv=4.4.2&

Re: query action with wrong result size zero

Hi,Erick thank you very much, i will do more try following your words. thanks Max Mi Sent using CloudMagic Email [https://cloudmagic.com/k/d/mailapp?ct=pa&cv=8.4.52&pv=4.4.2&source=email_footer_2] On Fri, May 06, 2016 at 11:39 PM, Erick < erickerick...@gmail.com [erickerick...@gmail.com] > w

Re: Solr 5.4.1 Mergeindexes duplicate rows

On 5/9/2016 7:55 AM, Kalpana wrote: > Can anyone help me with a merge. Currently I have the two cores already > pulling data from SQL Table based on the query I set up. > > Solr is running > > I also have a third core set up with schema similar to the first two. and > then I wrote this in the url a

Re: Solr 5.x bug with Service installation script?

On 5/9/2016 11:30 AM, A Laxmi wrote: > yes, I always shutdown both source and destination Solr before copying the > index over from one to another. Somehow the write.lock only happens when > Solr restarts from service script. If loads just fine when started manually. One possible problem: The bin

Re: Streaming expressions join operations

The block of code the NPE is coming from is where the collection nodes are being gathered for the query. So this points to some issue with the cloud setup or the query. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, May 10, 2016 at 9:52 AM, Joel Bernstein wrote: > Can you post the entire

Re: Streaming expressions join operations

Can you post the entire stack trace? I'd like to see what line the NPE is coming from. The line you pasted in is coming from the wrapper exception I believe. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, May 10, 2016 at 12:30 AM, Ryan Cutter wrote: > Yes, the people collection has the pe

Re: Replicate Between sites

Erick, That's not what I was going for. No code porting. I was thinking this: Why not use classic replication between one node in the cluster and another node in the other cluster? something along this line. Thanks, --Abdel. On Tue, May 10, 2016 at 12:21 AM, Erick Erickson wrote: > bq: How sim

Re:Re: Re:Re: solrcloud performance problem

Hi Toke, The version i am using is 4.10, i do not know why by setting log to all, and then recycle solr, i still could not get detailed log info. What is wrong. Does debug info from solr admin UI make sense? -- 发自我的网易邮箱手机智能版 在 2016-05-10 16:25:34，"Toke Eskildsen" 写道： >On Tue, 2016-05-10 at

Re: Nodes appear twice in state.json

i am able to delete the down/unused cores which does not actually a core but it have an entry in state.json using the DELETEREPLICA API. /admin/collections?action=DELETEREPLICA&collection=collection name&shard=shardname&replica=(dead/unused core name listed in state.json) eg: /admin/collections

Re: Nodes appear twice in state.json

Hi Shalin, How do we edit state.json? Do we have any utility to edit state.json as we have for clusterstate.json? Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/Nodes-appear-twice-in-state-json-tp4274504p4275791.html Sent from the Solr - User mailing list archive

RE: Facet ignoring repeated word

Thanks Toke. The issue I have is I cannot look for a specific word e.g. ddr in termfreq(%27name%27,%20%27ddr%27). I have to find count of all words and their sum. I might have 1000+ comments and each might have different words CEB India Private Limited. Registration No: U741040HR2004PTC035324.

RE: Facet ignoring repeated word

Thanks Toke. The issue I have is I cannot look for a specific word e.g. ddr in termfreq(%27name%27,%20%27ddr%27). I have to find count of all words and their sum CEB India Private Limited. Registration No: U741040HR2004PTC035324. Registered office: 6th Floor, Tower B, DLF Building No.10 DLF C

Re: Facet ignoring repeated word

+1 to Toke's facet and stats combo! On Tuesday, May 10, 2016 11:21 AM, Toke Eskildsen wrote: On Fri, 2016-04-29 at 08:55 +, G, Rajesh wrote: > I am trying to implement word > cloud

Re: how to find out how many times a word appears in a collection of documents?

Hi, fl parameters accepts multivalued parameters, please try fl=title,link ahmet On Tuesday, May 10, 2016 2:26 PM, "liviuchrist...@yahoo.com.INVALID" wrote: Hi Ahmet, Thank you very muchThere would be another question: I can't make it provide results from more than one field:http://localho

Re: how to find out how many times a word appears in a collection of documents?

Hi Ahmet, Thank you very muchThere would be another question: I can't make it provide results from more than one field:http://localhost:8983/solr/cuvinte/admin/luke?fl=_text_&?fl=title&?fl=link&numTerms=100 is my querry sintax wrong?I need to get results from more than one field... for example

Re: how to find out how many times a word appears in a collection of documents?

Hi Christian, Collection wide term statistics can be accessed via TermsComponent or LukeRequestHandler. Ahmet On Tuesday, May 10, 2016 1:26 PM, "liviuchrist...@yahoo.com.INVALID" wrote: Hi everyone, I need to "read" the solr/lucene index and see how many times does words appear in all docu

how to find out how many times a word appears in a collection of documents?

Hi everyone, I need to "read" the solr/lucene index and see how many times does words appear in all documents. For example: I have a collection of 1 mil documents and I want to see a list like this:the - 10 timesbread - 1000 timesspoon - 10 timesfork - 5 times etc. How do I do that??? Kind r

AW: How to find out if index contains orphaned child documents

Sorry for the double post. Formatting got lost too :( Whenever I mention the field "type" I actually mean "type_s". -Ursprüngliche Nachricht- Von: Sebastian Riemer [mailto:s.rie...@littera.eu] Gesendet: Dienstag, 10. Mai 2016 11:47 An: solr-user@lucene.apache.org Betreff: How to find ou

How to find out if index contains orphaned child documents

Hi all, I have the suspicion that my index might contain orphaned child documents because a query restricting to a field on a child document field returns two parent documents where I only expect one document to match the query. As I cannot figure out any obvious reason why the second documen

How to find out if index contains orphaned child documents

Hi all, I have the suspicion that my index might contain orphaned child documents because a query restricting to a field on a child document field returns two parent documents where I only expect one document to match the query. As I cannot figure out any obvious reason why the second documen

Re: Re:Re: solrcloud performance problem

On Tue, 2016-05-10 at 15:33 +0800, lltvw wrote: > What log you mentioned, console log or something else. the version I am using > is 4.10. There should be a solr.log somewhere. If you have not changed the default log levels, it should log all queries. - Toke Eskildsen, State and University Libr

Re: Facet ignoring repeated word

On Fri, 2016-04-29 at 08:55 +, G, Rajesh wrote: > I am trying to implement word > cloud

Re:Re: solrcloud performance problem

Hi Toke, What log you mentioned, console log or something else. the version I am using is 4.10. -- 发自我的网易邮箱手机智能版 在 2016-05-10 14:42:34，"Toke Eskildsen" 写道： >On Tue, 2016-05-10 at 00:41 +0800, lltvw wrote: >> Recently we setup a 4.10 solrcloud env with about 9000 doc indexed >> in it，t

RE: Solr edismax field boosting

Thanks Nick, got the response formatted. We are using Solr 5.5. Not able to understand why it is ignoring the boosts completely. What configuration is being missed? As you correctly pointed out it is only calculating based on the _text_ field. Query: http://10.203.101.42:8983/solr/uhc/select?de