Re: How do create dynamic core using SOLRJ

2012-04-27 Thread Jamel ESSOUSSI
Hi, You can use a simple httpurlrequest to create a new core for each customer as following : http://localhost:8983/solr/admin/cores?action=CREATE&name=coreX&instanceDir=path_to_instance_directory&config=config_file_name.xml&schema=schem_file_name.xml&dataDir=data Regards Jamel ESSOUSSI -- Vie

Master config

2012-04-27 Thread Jamel ESSOUSSI
Hi, I use two Solr slaves and one Solr master, it's a good idea to disable all the the caches in the master ? Best Regards -- Jamel ESSOUSSI -- View this message in context: http://lucene.472066.n3.nabble.com/Master-config-tp3943648p3943648.html Sent from the Solr - User mailing list archive a

Weird query results with edismax and boolean operator +

2012-04-27 Thread Vadim Kisselmann
Hi folks, i use solr 4.0 from trunk, and edismax as standard query handler. In my schema i defined this: I have this simple problem: nascar +author:serg* (3500 matches) +nascar +author:serg* (1 match) nascar author:serg* (5200 matches) nascar AND author:serg* (1 match) I think i under

Re: Master config

2012-04-27 Thread Vadim Kisselmann
hi, when only the slaves are used for search, why not, more RAM for OS. I keep my default settings on my master, because of when my slaves are busy with client-queries, i can test a few things on my master. best regards vadim 2012/4/27 Jamel ESSOUSSI : > Hi, > > I use two Solr slaves and one So

Re: Question on Facet counts by grouped results

2012-04-27 Thread Sohail Aboobaker
Thanks Erick, It works perfectly now. My purpose was to just test the group facet count feature and that works as expected. Can't wait for this release to be out :) Sohail

how to custom the groupValue for the solr group function

2012-04-27 Thread andy
I want to specify the group field to "title" which has some index examples like this 吸尘器(Panasonic) MC-CA391G 吸尘器(Panasonic) MC-CA491R 吸尘器(Panasonic) MC-CA402G and so on, I search like this q=title:吸尘器&group=true&group.field=title I analyze the searching result that I got a group value is "ca" t

Re: How do create dynamic core using SOLRJ

2012-04-27 Thread ayyappan
Thanks for response .i tried above ur l but i was getting error SEVERE: org.apache.solr.common.SolrException: Error executing default implementa tion of CREATE at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(Cor eAdminHandler.java:250) at org.apache.solr.handl

Re: How do create dynamic core using SOLRJ

2012-04-27 Thread Jamel ESSOUSSI
try with: CoreAdminRequest.Create e = new CoreAdminRequest().createCore(name, instanceDir, server); Regards --Jamel -- View this message in context: http://lucene.472066.n3.nabble.com/How-do-create-dynamic-core-using-SOLRJ-tp3943530p3944163.html Sent from the Solr - User mailing list archive at

Re: How do create dynamic core using SOLRJ

2012-04-27 Thread Jamel ESSOUSSI
You can also use CoreAdminRequest.Create e = new CoreAdminRequest().createCore(name, instanceDir, server, configFile, schemaFile); -- View this message in context: http://lucene.472066.n3.nabble.com/How-do-create-dynamic-core-using-SOLRJ-tp3943530p3944166.html Sent from the Solr - User mailing

Re: Benchmark Solr vs Elastic Search vs Sensei

2012-04-27 Thread Erick Erickson
Some observations: 1> I suspect some of your queries aren't doing what you expect, but I'm not sure if that matters. e.g. !tags:chick magnet will be parsed as -tags:chick defaultField:magnet. 2> Typical Solr setups in production are usually master/slave setups. Your indexing process

get value from DB (using like i.e %value%)

2012-04-27 Thread snbn
Dear all greetings, i am newbie in solr. i have an one issue while fetching records from DataBase and my scenario is as follows, For example , in our r table we have some values as like , id name 1 home loan 2 vehicle loan 3 personal loan assume that in this case while i am type a name

Re: How do create dynamic core using SOLRJ

2012-04-27 Thread Jamel ESSOUSSI
you should replace the CoreAdminRequest by CoreAdminResponse --> CoreAdminResponse e = new CoreAdminRequest().createCore("name", "instanceDir", newSolrServer); -- View this message in context: http://lucene.472066.n3.nabble.com/How-do-create-dynamic-core-using-SOLRJ-tp3943530p3944180.html Sent f

Re: get value from DB (using like i.e %value%)

2012-04-27 Thread Sohail Aboobaker
I am new to Solr as well but based on what I have read so far, once you have created index in Solr, you should look at ajax-solr. It provides a good example to type ahead widget (show list as you type). Sohail

Re: Master config

2012-04-27 Thread Erick Erickson
If you don't query the master, minimal memory is used for the cache. There's no harm in disabling the caches, but I doubt you'll notice any difference unless you have a very unusual setup. Best Erick On Fri, Apr 27, 2012 at 5:37 AM, Vadim Kisselmann wrote: > hi, > when only the slaves are used

commit stops

2012-04-27 Thread mav.p...@holidaylettings.co.uk
Hi We have an index of about 3.5gb which seems to work fine until it suddenly stops accepting new commits. Users can still search on the front end but nothing new can be committed and it always times out on commit. Any ideas? Thanks in advance 2012-04-27 14:14:20.537:WARN::Committed befor

Re: SolrCloud: Programmatically create multiple collections?

2012-04-27 Thread ravi
Hey Mark, Thanks again for your reply. /*"The way we know that its no longer connected to zookeeper is looking at live_nodes - which are ephemeral and will go away if a node goes away"*/ i am not too sure if this is really the case. As far as i remember, even after a node was dead, live_nodes s

Re: get value from DB (using like i.e %value%)

2012-04-27 Thread Erick Erickson
If you're talking about queries rather than autosuggest, you really need to look over, say, Solr In Action. SQL stores the entire data string, thus there's no way to search for individual words unless you do the %word% thing. Solr indexes _tokens_ individually, so (assuming you've used a tokenizin

Re: how to custom the groupValue for the solr group function

2012-04-27 Thread Martijn van Groningen
Hi Andy, Why do you want to group by title? It seems to contain the brand and product number, right? Also from what I understand from your email the field title is analysed. Grouping on fields that are analysed give unexpected results. Grouping is usually performed on fields that are of type stri

Does Solr fit my needs?

2012-04-27 Thread G.Long
Hi there :) I'm looking for a way to save xml files into some sort of database and i'm wondering if Solr would fit my needs. The xml files I want to save have a lot of child nodes which also contain child nodes with multiple values. The depth level can be more than 10. After having indexed t

RE: Does Solr fit my needs?

2012-04-27 Thread Bob Sandiford
Without speaking directly to the indexing and searching of the specific fields, it is certainly possible to retrieve the xml file. While Solr isn't a DB, it does allow a binary field to be associated with an index document. We store a GZipped XML file in a binary field and retrieve that under

Re: HTTP Auth and Distributed Search?

2012-04-27 Thread Mark Miller
On Apr 26, 2012, at 6:01 PM, Michael Della Bitta wrote: > Really? Is that in a .properties file somewhere, or would I have to do > it in code? I'm not really sure - someone (perhaps Lance?) told me this was possible - I've never discovered the incantation myself. > > I was sort of hoping I'd

Re: SolrCloud: Programmatically create multiple collections?

2012-04-27 Thread Mark Miller
On Apr 27, 2012, at 9:54 AM, ravi wrote: > Hey Mark, Thanks again for your reply. > > /*"The way we know that its no longer connected to zookeeper is looking at > live_nodes - which are ephemeral and will go away if a node goes away"*/ > > i am not too sure if this is really the case. As far a

Re: Does Solr fit my needs?

2012-04-27 Thread Shashi Kant
We have used both Solr and graph databases for our XML file indexing. Both are equivalent in terms of performance, but a graph db (such as Neo4j) offers a lot more flexibility in joining across the nodes and traversing. If your data is strictly hierarchical Solr might do it, alternately suggest loo

Re: Does Solr fit my needs?

2012-04-27 Thread Walter Underwood
Solr will not keep the structure of your XML data. Solr and Lucene have a flat data model. You can map hierarchy into that, but it can be a lot of work. I recommend starting with a dedicated XML database. MarkLogic is commercial, but they have added a free developer license that can be used for

Re: Recovery - too many updates received since start

2012-04-27 Thread Yonik Seeley
On Tue, Apr 24, 2012 at 9:31 AM, "Trym R. Møller" wrote: > Hi > > I experience that a Solr looses its connection with Zookeeper and > re-establish it. After Solr is reconnection to Zookeeper it begins to > recover. > It has been missing the connection approximately 10 seconds and meanwhile > the l

Unsubscribe does not appear to be working

2012-04-27 Thread Kevin Bootz
I have tried the unsubscribe process but believe it to be broken as I've gone as far as deleting my solr forum account and yet continue to receive emails. Is there a moderator that can remove my email from the list please? Thanks

Re: Unsubscribe does not appear to be working

2012-04-27 Thread Benson Margulies
There is no such thing as a 'solr forum' or a 'solr forum account.' If you are subscribed to this list, an email to the unsubscribe address will unsubscribe you. If some intermediary or third party is forwarding email from this list to you, no one here can help you. On Fri, Apr 27, 2012 at 12:09

Re: HTTP Auth and Distributed Search?

2012-04-27 Thread Michael Della Bitta
> Sure, open a JIRA issue and lets get it done. Done: https://issues.apache.org/jira/browse/SOLR-3421 Thanks, Michael

Re: Unsubscribe does not appear to be working

2012-04-27 Thread Chris Hostetter
: There is no such thing as a 'solr forum' or a 'solr forum account.' : : If you are subscribed to this list, an email to the unsubscribe : address will unsubscribe you. If some intermediary or third party is : forwarding email from this list to you, no one here can help you. And more specifical

CJKBigram filter questons: single character queries, bigrams created across sript/character types

2012-04-27 Thread Burton-West, Tom
I have a few questions about the CJKBigram filter. About 10% of our queries that contain Han characters are single character queries. It looks like the CJKBigram filter only outputs single characters when there are no adjacent bigrammable characters in the input. This means we would have to

Re: Question on Facet counts by grouped results

2012-04-27 Thread Chris Hostetter
: the schema.xml. It worked fine but in 4.0, I did the same thing (make : a copy of example) but when I change the schema, I get following: : : Apr 26, 2012 5:04:12 PM org.apache.solr.common.SolrException log : SEVERE: null:java.lang.RuntimeException: Can't find resource : 'stopwords_en.txt' in c

Re: CJKBigram filter questons: single character queries, bigrams created across sript/character types

2012-04-27 Thread Walter Underwood
Bigrams across character types seems like a useful thing, especially for indexing adjective and verb endings. An n-gram approach is always going to generate a lot of junk along with the gold. Tighten the rules and good stuff is missed, guaranteed. The only way to sort it out is to use a tokeniz

RE: Benchmark Solr vs Elastic Search vs Sensei

2012-04-27 Thread Jeremy Taylor
DataStax offers a Solr integration that isn't master/slave and is NearRealTimes. Essentially, the software offers the great features of Solr without the major shortcomings. Jeremy -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Friday, April 27, 2012 5:26 A

Re:

2012-04-27 Thread Gora Mohanty
On 27 April 2012 23:52, sol myr wrote: > > . http://partyfuncreation.com/haveagooday765.html?xlinkFriend=1obiy Would someone who has the privileges please ban this idiot from the mailing list already? Regards, Gora

Re: Benchmark Solr vs Elastic Search vs Sensei

2012-04-27 Thread Volodymyr Zhabiuk
Hi Eric Thanks for extensive answers. I will try to tune up my Solr installation according to your advises and the wiki page you've mentioned Best regards, Volodymyr 2012/4/27 Jeremy Taylor : > DataStax offers a Solr integration that isn't master/slave and is > NearRealTimes.  Essentially, the s

Disabling, escaping, or re-assigning '*' wildcard character (edismax)

2012-04-27 Thread Jeff Schmidt
Hello: In my application domain, there is something known as a microRNA star strand, which contains '*' as a character. For example: hsa-let-7a-2*, which is distinct from hsa-let-7a-2. I'm using edismax to handle queries. I need to treat '*' just like any other punctuation character. Is that

Re: Benchmark Solr vs Elastic Search vs Sensei

2012-04-27 Thread Radim Kolar
Dne 27.4.2012 19:59, Jeremy Taylor napsal(a): DataStax offers a Solr integration that isn't master/slave and is NearRealTimes. its rebranded solandra?

Re: Benchmark Solr vs Elastic Search vs Sensei

2012-04-27 Thread Walter Underwood
On Apr 27, 2012, at 12:39 PM, Radim Kolar wrote: > Dne 27.4.2012 19:59, Jeremy Taylor napsal(a): >> DataStax offers a Solr integration that isn't master/slave and is >> NearRealTimes. > its rebranded solandra? No, it is a rewrite. http://www.datastax.com/dev/blog/cassandra-with-solr-integration-

Re: Benchmark Solr vs Elastic Search vs Sensei

2012-04-27 Thread Jeff Schmidt
This is a pretty awesome combination, actually. I'm getting started using it myself, and I'd be very interested in what kind of benchmark results you get vs. Solr and your other candidates. DataStax Enterprise 2.0 was released in March and is based on Solr 4.0 and Cassandra 1.0.7 or 1.0.8, I'm

Re: Benchmark Solr vs Elastic Search vs Sensei

2012-04-27 Thread Jason Rutherglen
I think Datatax Enterprise is faster than Solr Cloud with transaction logging turned on. Cassandra has it's own fast(er) transaction logging mechanism. Of course it's best to use two HDs when testing, eg, one for the data, the other for the transaction log. On Fri, Apr 27, 2012 at 12:58 PM, Jeff

Re: Disabling, escaping, or re-assigning '*' wildcard character (edismax)

2012-04-27 Thread Martijn van Groningen
Hi Jeff, Another option is to use the Lucene escape character: '\' Escaping is described here: http://lucene.apache.org/core/old_versioned_docs/versions/3_5_0/queryparsersyntax.html#Escaping Special Characters If you're using SolrJ you can use the ClientUtils#escapeQueryChars(), this would escape

Re: Benchmark Solr vs Elastic Search vs Sensei

2012-04-27 Thread Andy
So the Cassandra integration brings distributed index and replication to Solr? Is that different from what Solr Cloud does? From: Jeff Schmidt To: solr-user@lucene.apache.org Sent: Friday, April 27, 2012 3:58 PM Subject: Re: Benchmark Solr vs Elastic Search vs

Re: Benchmark Solr vs Elastic Search vs Sensei

2012-04-27 Thread Andy
What is the performance of Elasticsearch and SenseiDB in your benchmark? From: Volodymyr Zhabiuk To: solr-user@lucene.apache.org Sent: Thursday, April 26, 2012 9:50 PM Subject: Benchmark Solr vs Elastic Search vs Sensei Hi Solr users I've implemented the pro

Re: Disabling, escaping, or re-assigning '*' wildcard character (edismax)

2012-04-27 Thread Jeff Schmidt
Martijn: What you describe sounds like a great approach to solving my problem. If I cannot get edismax to ignore it, then escape it to accomplish the same thing. I'll give that a try. Thanks! Jeff On Apr 27, 2012, at 2:43 PM, Martijn van Groningen wrote: > Hi Jeff, > > Another option is to

Re: Benchmark Solr vs Elastic Search vs Sensei

2012-04-27 Thread Jake Luciani
Yes the replication, failover and distribution is managed by Cassandra it makes solr more dynamo like. For example scaling involves adding another node to the cassandra cluster. Finally since the field data is in Cassandra you can access it from Cassandra, Hadoop or Solr. Jake On Apr 27,

Re: Boosting fields in SOLR using Solrj

2012-04-27 Thread Joe
Thanks Kuli. I tried this, but then it only returns hits for the query in the title field. I managed to get this work, by making edismax the default query type in the request handler in solrconfig.xml. This is still a bit of a hack, since I can't select different query types from solrj. If I add a

Re: Boosting fields in SOLR using Solrj

2012-04-27 Thread Joe
Thanks Ryan. I created a second requestHandler, which works fine in the browser. In solrj, how do I tell the SolrQuery which request handler to use? It always seems to default to another requestHandler. -- View this message in context: http://lucene.472066.n3.nabble.com/Boosting-fields-in-SOLR-u

Re: FastVectorHighlighter -> no highlights

2012-04-27 Thread Schmidt Jeff
Okay, my fault. I had a misunderstanding as to under what conditions DataStax Enterprise 2 re-indexes the content, and thus while I had the field definitions set properly to support FVH, I believe no actual position and offset data was generated and that might indicate why I had empty highlights

Re: Is there such as thing as FQ on a subquery?

2012-04-27 Thread Chris Hostetter
: And then I started looking at query trees in the debugger, and found : myself thinking that there's no possible representation for this -- a : subquery with a filter, since the filters are part of the : RequestBuilder, not part of the query. correct -- filter queries in the "fq" sense are a "to

should slave replication be turned off / on during master clean and re-index?

2012-04-27 Thread geeky2
hello all, i am just getting replication going on our master and two (2) slaves. from time to time, i may need to do a complete re-index and clean on the master. should replication on the slave - remain On or Off during a full clean and re-index on the Master? thank you, -- View this message i

Re: should slave replication be turned off / on during master clean and re-index?

2012-04-27 Thread Jeff Schmidt
Does a "clean" mean issuing a deletion query (e.g. *:*) prior to re-indexing all of your content? I don't think the slaves will download any changes until you've committed at some point on the master. If you delete everything and then commit, and proceed to re-index, then the slaves will pick

Re: commit stops

2012-04-27 Thread mav.p...@holidaylettings.co.uk
One more thing I noticed is the the schema browser in the admin interface also eventually times out… Any ideas from anyone ? From: Mav Peri To: "solr-user@lucene.apache.org" mailto:solr-user@lucene.apache.org>> Subject: commit stops Hi We have an index of a

Re: Boosting fields in SOLR using Solrj

2012-04-27 Thread Joe
I finally figured this out. The answer is here (see my comment to the answer): http://stackoverflow.com/questions/10324969/boosting-fields-in-solr-using-solrj -- View this message in context: http://lucene.472066.n3.nabble.com/Boosting-fields-in-SOLR-using-Solrj-tp3939789p3945626.html Sent from t

Re: commit stops

2012-04-27 Thread Yonik Seeley
On Fri, Apr 27, 2012 at 9:18 AM, mav.p...@holidaylettings.co.uk wrote: > We have an index of about 3.5gb which seems to work fine until it suddenly > stops accepting new commits. > > Users can still search on the front end but nothing new can be committed and > it always times out on commit. > >

Re: commit stops

2012-04-27 Thread mav.p...@holidaylettings.co.uk
Thanks for the reply The client expects a response within 2 minutes and after that will report an error. When we build fresh it seems to work and the operation takes a second or two to complete. Once it gets to a stage it hangs it simply won't accept any further commits. I did an index check and a

Re: Benchmark Solr vs Elastic Search vs Sensei

2012-04-27 Thread Volodymyr Zhabiuk
Hi Andy I don't want to publish results, since still there are some mistakes in the benchmark. Also this would be controversial, because there are too many parameters to tune and to take into consideration. Nevertheless you can go to the Sensei google group to see the preliminary result for Sensei

commit fail

2012-04-27 Thread mav.p...@holidaylettings.co.uk
Hi again, This is the only log entry I can find, regarding the failed commits… Still timing out as far as the client is concerned and there is actually nothing happening on the server in terms of load (staging environment). 1 CPU core seems busy constantly with solr but unsure what is happening

change index/store at indexing time

2012-04-27 Thread Vazquez, Maria (STM)
Hi, I'm migrating a project from Lucene 2.9 to Solr 3.4. There is a special case in the code that indexes the same field in two different ways, which is completely legal in Lucene directly but I don't know how to duplicate this same behavior in Solr: if (isFirstGeo) { document.add(new Fiel

Re: auto warm up cache and new data

2012-04-27 Thread Chris Hostetter
: The warmup process reloads the data from the new index. More specificly: autowarming looks at the *keys* from the old cache, and uses those keys along with the newSearcher to populate the new cache. The old *values* are not re-used. -Hoss

Re: commit fail

2012-04-27 Thread Yonik Seeley
On Fri, Apr 27, 2012 at 8:23 PM, mav.p...@holidaylettings.co.uk wrote: > Hi again, > > This is the only log entry I can find, regarding the failed commits… > > Still timing out as far as the client is concerned and there is actually > nothing happening on the server in terms of load (staging envi

Re: change index/store at indexing time

2012-04-27 Thread Bill Bell
Yes you can. Just use a script that is called for each row. Bill Bell Sent from mobile On Apr 27, 2012, at 6:38 PM, "Vazquez, Maria (STM)" wrote: > Hi, > I'm migrating a project from Lucene 2.9 to Solr 3.4. > There is a special case in the code that indexes the same field in two > different

Ampersand issue

2012-04-27 Thread Bill Bell
We are indexing a simple XML field from SQL Server into Solr as a stored field. We have noticed that the & is outputed as & when using wt=XML. When using wt=JSON we get the normal &. If there a way to indicate that we don't want to encode the field since it is already XML when using wt=XML ?

Re: commit stops

2012-04-27 Thread Bill Bell
We also see extreme slowness using Solr 3.6 when trying to commit a delete. We also get hangs. We do 1 commit at most a week. Rebuilding from scratching using DIH works fine and has never hung. Bill Bell Sent from mobile On Apr 27, 2012, at 5:59 PM, "mav.p...@holidaylettings.co.uk" wrote: >

Re: Does Solr fit my needs?

2012-04-27 Thread Bill Bell
You could use SQL Server and External Fields in Solr to get what you need from the database on result of the query. Bill Bell Sent from mobile On Apr 27, 2012, at 8:31 AM, "G.Long" wrote: > Hi there :) > > I'm looking for a way to save xml files into some sort of database and i'm > wonderin

Re: how to custom the groupValue for the solr group function

2012-04-27 Thread andy
Hi Martijn, Thank you for your reply. Yes, I have analyzed the title field, so I got the unexpected result ,maybe I have not understand the group function very well, thank you very much Martijn, I will try that according your opinion. Thanks, Andy -- View this message in context: http://luce

Re: should slave replication be turned off / on during master clean and re-index?

2012-04-27 Thread geeky2
hello, thank you for the reply, >> Does a "clean" mean issuing a deletion query (e.g. *:*) prior to re-indexing all of your content? I don't think the slaves will download any changes until you've committed at some point on the master. << well, in this case when i say, "clean" (on the Master

Re: should slave replication be turned off / on during master clean and re-index?

2012-04-27 Thread Jeevanandam Madanagopal
I guess you're looking for 'disabling replication poll on slave' go to 'Replication dashboard[1]', there you have options like Enable/Disable Poll, Force replication, Abort replication dashboard url: http://slave_host:port/solr/corename/admin/replication/index.jsp Poll Disabled => slave will not

Re: change index/store at indexing time

2012-04-27 Thread Jeevanandam Madanagopal
As Bill mentioned, you can use Script. Please have a look: http://wiki.apache.org/solr/DataImportHandler#ScriptTransformer - Jeevanandam On Apr 28, 2012, at 7:07 AM, Bill Bell wrote: > Yes you can. Just use a script that is called for each row. > > Bill Bell > Sent from mobile > > > On Apr