Reg: Multicore vs singlecore.

hi, I am new to solr, so just want to clarify on few points I ran the test on the machine with following specification:-Ram : 5GBdual core : 2.66 GHzIndex Size : 10GB 1) Is the hard disk read time is a bottle neck on solr performance? I ran few tests using "jmeter" and analysis the system resourc

Re: Reg: Multicore vs singlecore.

On Mon, Oct 3, 2011 at 12:12 PM, wrote: > hi, > I am new to solr, so just want to clarify on few points > I ran the test on the machine with following specification:-Ram : 5GBdual > core : 2.66 GHzIndex Size : 10GB * How much of the RAM is given to Solr, and how much is left for the OS disk c

Re: multiple dateranges/timeslots per doc: modeling openinghours.

Interesting! Reading your previous blogposts, I gather that the to be posted 'implementation approaches' includes a way of making the SpanQueries available within SOLR? Also, would with your approach would (numeric) RangeQueries be possible as Hoss suggests? Looking forward to that 'implementation

Re: multiple dateranges/timeslots per doc: modeling openinghours.

Thanks Hoss for that in-depth walkthrough. I like your solution of using (something akin to) FieldMaskingSpanQuery. Conceptually the Join-approach looks like it would work from paper, although

Re: Suggestions on how to perform infrastructure migration from 1.4 to 3.4?

Well, other than testing he heck out of the 3.4 before putting it into production, the answer is "how long will it take you to install new software and replicate?" Note, I'm not saying that I know of any instabilities in 3.4, just that thoroughly testing a major upgrade is *always* called for. 3.4

Re: heap size problem when indexinf files with solrj

You're saying that the file you're indexing is 500M? Pretty big... First, I'd ask if you really want to index it as a single file or whether you can break it up into sub-files. It depends upon what it is I guess. Second, you can certainly index something this big, you just need enough memory. Sou

Re: Solr stopword problem in Query

Thanks Erick. On 29 September 2011 18:31, Erick Erickson wrote: > I think your problem is that you've set > > omitTermFreqAndPositions="true" > > It's not real clear from the Wiki page, but > the tricky little phrase > > "Queries that rely on position that are issued > on a field with this optio

Re: multiple dateranges/timeslots per doc: modeling openinghours.

On Mon, Oct 3, 2011 at 3:09 PM, Geert-Jan Brits wrote: > Interesting! Reading your previous blogposts, I gather that the to be > posted > 'implementation approaches' includes a way of making the SpanQueries > available within SOLR? > It's going to be posted in two days. But please don't expect m

Faceted query performance problem when group.truncate set to true

Hi, in my (test) setup I have 200K distinct documents with each document having 5 historical version of it (so in total there is 1M documents). In order to to retrieve the latest (or historical) version of the documents I'm using the grouping functionality: id:[0 TO N]&group=true&group.fi

RE: solr searching for special characters?

Yes. > -Original Message- > From: vighnesh [mailto:svighnesh...@gmail.com] > Sent: Monday, October 03, 2011 2:22 AM > To: solr-user@lucene.apache.org > Subject: solr searching for special characters? > > Hi all, > > I need to search special characters in solr . so > Is it possible to sea

UniqueKey filed length exceeds

I have defined time stamp as unique key but when i trying to search with the same it throws error any other alternate for StrField coz i can't increase the length of it or can't we apply analyzer for the same? My unique key:-MM-DD 13:54:11.414632 -- View this message in context: http://luce

Re: Automate startup/shutdown of SolrCloud Shards

Something like this would be excellent. Right now I am starting up the main server and then doing a wget to see if the server has started successfully before firing off any secondary servers. If we could do what you're saying then everything is much cleaner to do. On Mon, Oct 3, 2011 at 1:20 AM,

Re: Documents Indexed, SolrJ see nothing before long time

Or any Idea to see cache updated more quickly, I do not understand well how caches are working in Solr. -- View this message in context: http://lucene.472066.n3.nabble.com/Documents-Indexed-SolrJ-see-nothing-before-long-time-tp3389721p3389864.html Sent from the Solr - User mailing list archive at

Broken Simple html Form

Hi Solr Users, I’m new to using Solr and trying to implement it as a search engine for our company web site using the simple html form provided by donovan@gmail.com at http://code.google.com/p/solr-php-client/wiki/ExampleUsage. The example provided via this web page fails to work for me. Fr

Debugging misbehaving spellchecker search....

Hi, I'm trying to configure solr to perform a 'Did you mean this' style search using the SpellCheckerComponent and the standard search handler. Unfortunately I am having problems in getting results from my test search ... basically when I search using a misspelling of a word I know to be in the s

SolrJ Annotation for multiValued field

Hello again, Is it possible to persist simple list values in index using annotated bean ? And in my Pojo : @Field("one") String myString . @Field("mymultivaluedfield") List items; Actually, nothing happends, content of this collection "ArrayList" is not persisted into mymultivalued

RE: Weird issues when upgrading from 1.4 to 3.4

I have no idea what might be causing your memory to increase like that (we haven't run 3.4, and our index so far has been at most 28 million rows with maybe 40 fields), but just as an aside, depending upon what you meant by "we drop the whole index", I'd think it might work better to do an righ

Documents Indexed, SolrJ see nothing before long time

Hello, While documents are indexed, I mean I can retrieve it with solr administration console, it is taking too long, about 5 minutes before I can see it using SolrJ API. Do you have any Idea on how to resolve this please ? Only specific configuration I have is : 3

Re: Documents Indexed, SolrJ see nothing before long time

See: http://wiki.apache.org/solr/SolrConfigXml The example in the wiki is: 1 86000 So since you have yours set to 3, that translates to 30,000 ms, which is 5 minutes. If you want the autocommit feature to trigger more often, you could decrease the number. Droppin

Re: Lucene Grid question

Thank you very much (sorry for the delayed reply). From: Chris Hostetter To: solr-users ; sol myr Sent: Wednesday, September 21, 2011 4:15 AM Subject: Re: Lucene Grid question : E.g. say I have a chain of book-stores, in different countries, and I'm aiming f

Re: Implementing a custom ResourceLoader

: As part of writing a solr plugin I need to override the ResourceLoader. My : plugin is intended stop word analyzer filter factory and I need to change : the way stop words are being fetched. My assumption is overriding : ResourceLoader->getLines() will help me to meet my target of fetching stop

Re: Bad Request accessing solr on linux

: Below is the error: : : Bad Request we need a lot more to go on then that. what errors are you seeing in the logs? what do your configs look like? etc... https://wiki.apache.org/solr/UsingMailingLists -Hoss

Re: Documents Indexed, SolrJ see nothing before long time

3ms = 5 minutes ? Are you sure you are not mistaking... 3ms = 30s -- View this message in context: http://lucene.472066.n3.nabble.com/Documents-Indexed-SolrJ-see-nothing-before-long-time-tp3389721p3390515.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: Getting facet counts for 10,000 most relevant hits

Thanks so much for your reply Hoss, I didn't realize how much more complicated this gets with distributed search. Do you think it's worth opening a JIRA issue for this? Is there already some ongoing work on the faceting code that this might fit in with? In the meantime, I think I'll go ahead an

Re: Multithreaded JdbcDataStore and CachedSqlEntityProcessor

When I'm debugging, if it is single threaded CachedSqlEntityProcessor.getAllNonCachedRows is called only once, all the rows cached and next time it requests a row it gets it from the cached data. In the logs I see the SQL call only once. If I use multiple threads, it calls CachedSqlEntityProcessor

Re: Boost Exact matches on Specific Fields

Hi One More Question here , For ex: If so do an search for "Agriculture Foods" with out Quotes , It is trying to find the ones which have both the words not Splitting and checking for individual results . On removing the QF params it seems to work . Is it a problem with the QF params I

sorting using function query results are notin order

hi I am trying to sort results from solr using sum(count,score) function. Basically its not adding things correctly. For example here is partial sample response "Count":54, "UserQuery":"how to", "score":1.2550932, "query({!dismax qf=UserQuery v='how'})":1.2550932,

Re: SolrJ Annotation for multiValued field

I will check tomorrow, but for a test case, I have put this code to verify Field List mapping : @Field("mymultivaluedfield") List items; public List getItems() { if (items == null) { items = new ArrayList(); items.add("value1"); } return items; } Is it normal it doe

Re: Documents Indexed, SolrJ see nothing before long time

Any SolrJ cache ? I am newbie ;) -- View this message in context: http://lucene.472066.n3.nabble.com/Documents-Indexed-SolrJ-see-nothing-before-long-time-tp3389721p3390942.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Documents Indexed, SolrJ see nothing before long time

Sorry, lack of sleep made me see an extra "0" in there. I haven't had this issue -- but after every batch of items that I post into Solr with SolrJ I run the commit() routine on my instance of the CommonsHttpSolrServer, so they show up immediately. You could try altering your code to do that, or

How to obtain the Explained output programmatically ?

Hi, I need to use some detailed information of the explained result in Solr search. Here is one example: * http://localhost:8983/solr/select/?q=GB&version=2.2&start=0&rows=10&indent=on&debugQuery=true&fl=id,score * 0.18314168 = (MATCH) sum of: 0.18314168 = (MATCH) weight(text:gb in 1), p

Re: How to obtain the Explained output programmatically ?

: http://localhost:8983/solr/select/?q=GB&version=2.2&start=0&rows=10&indent=on&debugQuery=true&fl=id,score ... : the web browser. Is there a way to access the explained output : programmatically? https://wiki.apache.org/solr/CommonQueryParameters#debug.explain.structured -Hoss

schema changes changes 3.3 to 3.4?

Hi, I have the following issue on my test environment when I do a query with the full word the reply no longer contains the attr_meta ex: http://solr1:8983/solr/core_1/select/?q=stegosaurus ISO-8859-1 en but if I remove just one letter it shows the expected response ex: http://solr1:8983/sol

Re: How to obtain the Explained output programmatically ?

Thanks Hoss! debug.explain.structured is definitely helpful. It adds some structure to the plain explained output. Is there a way to access these structured outputs in Java code (e.g., via Solr plugin class)? We could wr

Re: Sort five random "Top Offers" to the top

Hi Mouli, I was looking at the code here, not sure why you even need to do the sort... After you get the DocList, couldn't you do something like this? List topofferDocIds = new ArrayList(); for (DocIterator it = ergebnis.iterator(); it.hasNext();) { topofferDocIds.add(it.next()); } Collections

Determining master/slave from ZK in SolrCloud

Is it possible to determine if a solr instance is a master or a slave in replication terms based on the information that is placed in ZK in SolrCloud?

Selective Result Grouping

I'd like to suggest the ability to collapse results in a more similar way to the old SOLR-236 patch that the current grouping functionality doesn't provide. I need the ability to collapse only certain results based on the value of a field, leaving all other results in tact. As an example, consider

Re: How to skip current document to index data from DIP

You might want to review: http://wiki.apache.org/solr/UsingMailingLists You've given us a config, but no idea what you've tried. What you observe. What error you're seeing. What do your logs show? Are you seeing any error stack traces? Have you tried backing this up and trying only one addition a

Re: Memory managment and JVM setting for solr

I think you're going at this from the wrong end. There's no magical way to give your process more memory than you have on your machine. But, there's no correlation between the size of your data, especially when it contains video files and the size of your Solr index. You're not going to index the b

Re: SOLR HttpCache Qtime

Why do you want to? QTime is the time Solr spends searching. The cached value will, indeed, be from the query that filled in the HTTP cache. But what are you doing with that information that you want to "correct" it? That said, I have no clue how you'd attempt to do this. Best Erick On Sat, Oct

Re: Enabling the right logs for DIH

Hmm, you know, I don't even know what a "row" means when importing XML. But let's talk about importing XML. As far as I know, unless you use XSLT to perform a transformation, Solr doesn't import XML except as well-formed Solr documents, some form like: value If you're importing anything els

Re: Reg: Multicore vs singlecore.

Describe your test more. If you're asking why your CPU isn't pegged, I'd have to ask "Are you firing queries at it rapidly enough?" Best Erick On Mon, Oct 3, 2011 at 2:42 AM, wrote: > hi, > I am new to solr, so just want to clarify on few points > I ran the test on the machine with following sp

Re: UniqueKey filed length exceeds

I really don't understand what you're trying to convey. Let's see your schema definition for your unique key. I really wouldn't imagine that fields of that form *could* be anything except string. It's not in the correct format for a Solr date, and it's certainly not a numeric type. If that doe

Re: Boost Exact matches on Specific Fields

I'm not sure what you're asking here. Could you show the results of appending &debugQuery=on to your query? Along with what you expect to happen and what is in the fields. But KeywordTokenizer (in your "string_lower") type is suspicious when you start using multiple words. Your "agriculture foods"

Re: How to skip current document to index data from DIP

Hi Erick Erickson Thank you for reply for me, In my config, i indexed successful data from HTTP using Tika. I combined a field and url in Tika to get file by that http. But during indexing, i have seen some URL which is not exist or notice: *Caused by: java.io.FileNotFoundException: http://media.g

RE: solr searching for special characters?

thanks for giving replay how it is possible also explain me and which tokenizer class can support for finding the special characters . -- View this message in context: http://lucene.472066.n3.nabble.com/solr-searching-for-special-characters-tp3388974p3392157.html Sent from the Solr - User maili

Re: Query failing because of omitTermFreqAndPositions

Hi Mike, Thanks for the information.But why is it that once omiited positions in the past , it will always omit positions even if omitPositions is made false. Thanks, Isan Fulia. On 29 September 2011 17:49, Michael McCandless wrote: > Once a given field has omitted positions in the past, even f

Deploy Solritas as a separate application?

Solritas is a nice search UI integrated with Solr with many features we could use. However we do not want to build our UI into our Solr instance. We will have a front-end web app interfacing with Solr. Is there an easy way to deploy Solritas as a separate application (e.g., Solritas with SolrJ to q