Re: web gui specify shard and collection when adding a new core

2012-03-26 Thread Stefan Matheis
Jamie: SOLR-3238 is the current admin-ticket. create a new one for the cloud-related options and describe what (and where) you'd like to have :) On Sunday, March 25, 2012 at 4:25 AM, Jamie Johnson wrote: > Is there a plan to add the ability to specify the shard and > collection when adding a c

RE: Simple Slave Replication Question

2012-03-26 Thread Ben McCarthy
Hello, Had to leave the office so didn't get a chance to reply. Nothing in the logs. Just ran one through from the ingest tool. Same results full copy of the index. Is it something to do with: server.commit(); server.optimize(); I call this at the end of the ingestion. Would optimize then

Indexing Source Code

2012-03-26 Thread Bastian H
Hi, I like to index my Source Code - the most is Cobol, Asembler and Java - with Solr. I don't know where to start... I think I need to parse it to get XML for Solr. Do I need Tinka? Is there any Parser I could use? I want to index functions, variables and function calls as well as commentaries.

Re: Practical Optimization

2012-03-26 Thread Erick Erickson
Thanks, this is very helpful! On Sat, Mar 24, 2012 at 4:50 AM, Martin Koch wrote: > Thanks for writing this up. These are good tips. > > /Martin > > On Fri, Mar 23, 2012 at 9:57 PM, dw5ight wrote: > >> Hey All- >> >> we run a  http://carsabi.com car search engine  with Solr and did some >> bench

Re: Indexing Source Code

2012-03-26 Thread Marcelo Carvalho Fernandes
Hi Bastian, Can you please tell us what kind of search you imagine doing with some (use case) examples? Marcelo On Monday, March 26, 2012, Bastian H wrote: > Hi, > > I like to index my Source Code - the most is Cobol, Asembler and Java - > with Solr. > > I don't know where to start... I think I

Re: Old Google Guava library needs updating (r05)

2012-03-26 Thread Erick Erickson
Hmmm, near as I can tell, guava is only used in the Carrot2 contrib, so maybe ask over at: http://project.carrot2.org/? Best Erick On Sat, Mar 24, 2012 at 3:31 PM, Nicholas Ball wrote: > > Hey all, > > Working on a plugin, which uses the Curator library (ZooKeeper client). > Curator depends on t

Querying field with parenthesis

2012-03-26 Thread Tim Terlegård
I have created my own field type. I have indexed "Stephen King" and get no hit when searching author:(stephen king) I get a hit when searching like this author:(stephen* AND *king) I also get a hit when searching like this author:"stephen king" So it seems like when querying with (...) it actual

Re: Trouble Setting Up Development Environment

2012-03-26 Thread Erick Erickson
Depending upon what you actually need to do, you could consider just attaching to the running Solr instance remotely. I know it's easy in IntelliJ, and believe Eclipse makes this easy as well but I haven't used Eclipse in a while Best Erick On Sat, Mar 24, 2012 at 11:11 PM, Li Li wrote: > I

Re: Solr cores issue

2012-03-26 Thread Erick Erickson
Index corruption is very rare, can you provide more details how you got into that state? Best Erick On Sun, Mar 25, 2012 at 1:22 PM, Sujatha Arun wrote: > Hello, > > Suppose  I have several cores in a single webapp ,I have issue with Index > beong corrupted in one core  ,or schema /solrconfig of

Re: Simple Slave Replication Question

2012-03-26 Thread Erick Erickson
It's the optimize step. Optimize essentially forces all the segments to be copied into a single new segment, which means that your entire index will be replicated to the slaves. In recent Solrs, there's usually no need to optimize, so unless and until you can demonstrate a noticeable change, I'd j

Re: Querying field with parenthesis

2012-03-26 Thread Erick Erickson
Your problem is the KeywordTokenizerFactory and the query parser. This often trips people up. When you use author:(stephen king), the query parser breaks this up before it gets to the analysis chain into two separate tokens. But by virtue of the fact that you're using KeywordTokenizer, the actual f

Re: Solr cores issue

2012-03-26 Thread Sujatha Arun
I was migrating to cores from webapp ,and I was copying a bunch of indexes from webapps to respective cores ,when I restarted ,I had this issue where the whole webapp with the cores would not startup and was getting index corrupted message.. In this scenario or in a scenario where there is an issu

RE: "ant test" and contribs

2012-03-26 Thread Steven A Rowe
Check out solr/contrib/analysis-extras/build.xml -Original Message- From: Lance Norskog [mailto:goks...@gmail.com] Sent: Monday, March 26, 2012 2:14 AM To: solr-user@lucene.apache.org Subject: Re: "ant test" and contribs Ah! It is more complex. There is code and a library jar in lucene/

RE: Simple Slave Replication Question

2012-03-26 Thread Ben McCarthy
That's great information. Thanks for all the help and guidance, its been invaluable. Thanks Ben -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: 26 March 2012 12:21 To: solr-user@lucene.apache.org Subject: Re: Simple Slave Replication Question It's the opti

Using DateMath in Facet Label

2012-03-26 Thread Charlie Maroto
Hi, We have a requirement to facet on a field with a date value so that the following buckets are shown: a) Last Week b) Last Month c) Last Year d) 2012 e) 2011 or earlier Of course, as 2013 rolls in, then the labels for the last two buckets should change to “

Re: web gui specify shard and collection when adding a new core

2012-03-26 Thread Jamie Johnson
https://issues.apache.org/jira/browse/SOLR-3275 is the ticket I created. If it's not clear enough please let me know I can try to elaborate. On Mon, Mar 26, 2012 at 3:46 AM, Stefan Matheis wrote: > Jamie: SOLR-3238 is the current admin-ticket. create a new one for the > cloud-related options an

First steps with Solr

2012-03-26 Thread henri.gour...@laposte.net
Hi, I have been exploring Solr through the example provided. I have created my own set of documents, and can start to index and query using the Solritas GUI. Two questions: 1/ I would like to have the "name" field to contain a URL to another server on my machine. When I put " text " inside t

Client-side failover with SolrJ

2012-03-26 Thread spring
Hi, has SolrJ any possiblities to do a failover from a master to a slave for searching? Thank you

QueryHandler

2012-03-26 Thread Peyman Faratin
Hi A noobie question. I am uncertain what is the best way to design for my requirement which the following. I want to allow another client in solrj to query solr with a query that is handled with a custom handler localhost:9090/solr/tokenSearch?tokens{!dismax qf=content}pear,apples,oyster,kin

Re: First steps with Solr

2012-03-26 Thread henri.gour...@laposte.net
Partially solved problem! I am playing with the doc.vm file in the velocity folder. I have replaced *#field('name')* by * http://127.0.0.1:2317/Chausey?#field('access') #field('name') * where access is the value or the URL I want. problem is that someone seems to insert spaces (%20) between *

Re: First steps with Solr

2012-03-26 Thread henri.gour...@laposte.net
Partially solved problem! I am playing with the doc.vm file in the velocity folder. I have replaced where access is the value or the URL I want. problem is that someone seems to insert spaces (%20) between * Chausey? and #field('access') resulting into an invalid query. Everthing else seems O

Re: Client-side failover with SolrJ

2012-03-26 Thread Jamie Johnson
Did you try http://lucene.apache.org/solr/api/org/apache/solr/client/solrj/impl/LBHttpSolrServer.html? This might be what you're looking for. On Mon, Mar 26, 2012 at 11:23 AM, wrote: > Hi, > > has SolrJ any possiblities to do a failover from a master to a slave for > searching? > > Thank you >

Re: First steps with Solr

2012-03-26 Thread henri.gour...@laposte.net
trying to play with javascript to clean-up my URL!! Context is velocity Suggestions? Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/First-steps-with-Solr-tp3858406p3858959.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr cores issue

2012-03-26 Thread Erick Erickson
Shouldn't be. What do your log files say? You have to treat each core as a separate index. In other words, you need to have a core#/conf with the schema matching your core#/data/index directory etc. I suspect you've simply mis-copied something. Best Erick On Mon, Mar 26, 2012 at 8:27 AM, Sujatha

document inside document?

2012-03-26 Thread sam ”
Hey, I am making an image search engine where people can tag images with various items that are themselves tagged. For example, http://example.com/abc.jpg is tagged with the following three items: - item1 that is tagged with: tall blond woman - item2 that is tagged with: yellow purse - item3 that

Re: Index a set of file as one document in SOLR

2012-03-26 Thread Erick Erickson
Consider writing a SolrJ program that extracts the data from the PDF file and combines it with the XML data. Here's an example to get you started, it shows how to do the PDF extraction at least. The other part of the code is a database connection, ignore that part. You'll have to read in the XML,

Re: Old Google Guava library needs updating (r05)

2012-03-26 Thread Stanislaw Osinski
Hi Nick, Which version of Solr do you have in mind? The official 3.x line or 4.0? The quick and dirty fix to try would be to just replace Guava r05 with the latest version, chances are it will work (we did that in the past though the version number difference was smaller). The proper fix would b

Re: Old Google Guava library needs updating (r05)

2012-03-26 Thread Nicholas Ball
Hey Staszek, Thanks for the reply. Yep using 4.x and that was exactly what I ended up doing, a quick replace :) Just thought I'd document it somewhere for a proper fix to be done in the 4.0 release. No issues arose for me but then again Erick mentions it's only used in Carrot2 contrib which I'm

Re: Old Google Guava library needs updating (r05)

2012-03-26 Thread Stanislaw Osinski
I've filed an issue for myself as a reminder. Guava r05 is pretty old indeed, time to upgrade. S. On Mon, Mar 26, 2012 at 23:12, Nicholas Ball wrote: > > Hey Staszek, > > Thanks for the reply. Yep using 4.x and that was exactly what I ended up > doing, a quick replace :) > Just thought I'd docum

Re: Slave index size growing fast

2012-03-26 Thread Alexandre Rocco
Erick, I haven't changed the maxCommitsToKeep yet. We stopped the slave that had issues and removed the data dir as you pointed and afer starting it, everything started working as normal. I guess that at some point someone commited on the slave or even copied the master files over and made this me

StreamingUpdateSolrServer - exceptions not propagated

2012-03-26 Thread Shawn Heisey
I've been building a new version of my app that keeps our Solr indexes up to date. I had hoped to use StreamingUpdateSolrServer instead of CommonsHttpSolrServer for performance reasons, but I have run into a showstopper problem that has made me revert to CHSS. I have been relying on exception

Re: StreamingUpdateSolrServer - exceptions not propagated

2012-03-26 Thread Mark Miller
It doesn't get thrown because that logic needs to continue - you don't necessarily want one bad document to stop all the following documents from being added. So the exception is sent to that method with the idea that you can override and do what you would like. I've written sample code around s

Re: Solr Cloud multiple shards and replicas in one instance freezes

2012-03-26 Thread Jamie Johnson
For whatever reason. I'm having difficult ulty reproducing the issue, I'll continue to try and reproduce On Sunday, March 25, 2012, Mark Miller wrote: > Yeah, sorry - that's what I meant. > > Sent from my iPad > > On Mar 24, 2012, at 2:18 PM, Jamie Johnson wrote: > >> There is no stack trace, I

Why my highlights are wrong(one character offset)?

2012-03-26 Thread neosky
all of my highlights has one character mistake in the offset,some fragments from my response. Thanks! 0 259 on sequence true 10 2.2 *,score true 0 sequence:NGNFN TSQSELSNGNFNRRPKIELSNFDGNHPKTWIRKC GENTRERNGNFNSLTRERSFAELENHPPKVRRNGSEG EGRYPCNNGNFNLTTGRCVCEKNYVHLIYEDRI YAEEN

Why my highlights are wrong(one character offset)?

2012-03-26 Thread neosky
all of my highlights has one character mistake in the offset,some fragments from my response. Thanks! 0 259 on sequence true 10 2.2 *,score true 0 sequence:NGNFN TSQSELSNGNFNRRPKIELSNFDGNHPKTWIRKC GENTRERNGNFNSLTRERSFAELENHPPKVRRNGSEG EGRYPCNNGNFNLTTGRCVCEKNYVHLIYEDRI YAEE

Re: Solr cores issue

2012-03-26 Thread Sujatha Arun
yes ,I must have mis-copied and yes, i do have the conf folder per core with schema etc ... Because of this issue ,we have decided to have multiple webapps with about 50 cores per webapp ,instead of one singe webapp with all 200 cores ,would this make better sense ? what would be your suggestion

Re: StreamingUpdateSolrServer - exceptions not propagated

2012-03-26 Thread Shawn Heisey
On 3/26/2012 6:43 PM, Mark Miller wrote: It doesn't get thrown because that logic needs to continue - you don't necessarily want one bad document to stop all the following documents from being added. So the exception is sent to that method with the idea that you can override and do what you wo

Re: Practical Optimization

2012-03-26 Thread William Bell
What type of logging were you using? Did you try log back? We get a pretty large increase when using that. On Fri, Mar 23, 2012 at 2:57 PM, dw5ight wrote: > Hey All- > > we run a  http://carsabi.com car search engine  with Solr and did some > benchmarking recently after we switched from a hosted

how to store file path in Solr when using TikaEntityProcessor

2012-03-26 Thread ZHANG Liang F
Hi, I am using DIH to index local file system. But the file path, size and lastmodified field were not stored. in the schema.xml I defined: And also defined tika-data-config.xml:

Re: Re: Indexing Source Code

2012-03-26 Thread Arbeit . bastian
I can't find better examples at the moment... I hope they are sufficient to describe what I need. ''' Code 25 01 RETURN-CODES. 26 05 RTC00 PIC X(2) VALUE '00'. 27 05 RTC01 PIC X(2) VALUE '01'. 28 05 RTC04 PIC X(2) VALUE '04'. 29 05 RTC08 PIC X(2) VALUE '08'. ''' /Code This

Re: Using the ids parameter

2012-03-26 Thread Dmitry Kan
Hi, Actually we ran into the same issue with using ids parameter, in the solr front with shards architecture (exception throws in the solr front). Were you able to solve it by using the key:value syntax or some other way? BTW, there was a related issue: https://issues.apache.org/jira/browse/SOLR-

Re: StreamingUpdateSolrServer - exceptions not propagated

2012-03-26 Thread Shawn Heisey
On 3/26/2012 10:25 PM, Shawn Heisey wrote: The problem is that I currently have no way (that I know of so far) to detect that a problem happened. As far as my code is concerned, everything worked, so it updates my position tracking and those documents will never be inserted. I have not yet de