Re: Solr Composite Unique key from existing fields in schema

Also take a look at http://wiki.apache.org/solr/UniqueKey#Use_cases_which_require_a_unique_key_generated_from_data_in_the_document -- View this message in context: http://lucene.

Re: Solr Composite Unique key from existing fields in schema

You could use a combination of all your composite key columns and put them in a field in solr which can then be used as the unique key. As in if you have two columns c1 and c2, you could have a field in solr which have the value as c1_c2 or something on those lines. -- View this message in cont

Re: Index a new record in MySQL

The config seems ok. Have you checked the date in the properties file before a delta-import? MySql does give issues with date format. Also, check your webcontainer/solr logs; whether they give any exception when you call a delta-import. -- View this message in context: http://lucene.472066.n3.n

Re: Index a new record in MySQL

But delta indexing is supposed to do that. Please share details of your datatimport-config.xml and version of Solr for further help. -- View this message in context: http://lucene.472066.n3.nabble.com/Index-a-new-record-in-MySQL-tp4116164p4116184.html Sent from the Solr - User mailing list arch

Re: implement relevency

You may also want to look here -- View this message in context: http://lucene.472066.n3.nabble.com/implement-relevency-tp4113964p4113983.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Grouping

My question is fro group.format=simple. In normal grouping i know group.offset would work -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Grouping-tp4101313p4101316.html Sent from the Solr - User mailing list archive at Nabble.com.

Solr Grouping

Hi, In Grouping we can group docs as per a field. Can we also have something like pagination within a group. For eg. G1 has G1D1,G1D2,G1D3 G2 has G2D1, G2D2 G3 has G3D1, G3D2, G3D3, G3D4. Can I fetch the results like (if group.format=simple) Page1: G1D1 G2D1 G3D1 Page 2: G1D2 G2D2 G3D2 Page3:

Re: Clustering unstructured text data

You may want to have a look at SolrJ -- View this message in context: http://lucene.472066.n3.nabble.com/Clustering-unstructured-text-data-tp4095241p4095444.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Fetch Unique Values

/fetch first 10,000 unique records based on a field/ Do you mean fetch 10,000 records each with a unique value of the field? Is Grouping what you are looking for? -- View this message in context: http://lucene.472066.n3.nabble.com/Fetch-Unique-Va

Re: FileNotFoundException

I did see that. The file its looking for doesn't exist post slaves have been updated. I suspect there was segment info file of that name before the syncing happened and once the file was removed the searcher still looks for the file. Strange behavior, don't know why should this happen. -- View t

FileNotFoundException

Hi, We migrated to Solr 4.3 from 3.5 yesterday. We use multicore Master Slave architecture and use external scripts to sync the slaves. Every 2-3 hours cores on our slaves start going down (not all but some. We have about 17 cores). And the logs show the following exception: 1256587 [http-bio-/0.0

Re: Solr External Scripts Replication Issue

Found the solution. It was related to solrdeletionpolicy. Phew!!! -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-External-Scripts-Replication-Issue-tp4093343p4093356.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr External Scripts Replication Issue

Also once in a while it gives the following exception: org.apache.solr.common.SolrException: Error opening new searcher at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1434) at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1546) at org.apache.solr.c

Solr External Scripts Replication Issue

Hi, We use a Master-Slave architecture and use rsyncing to sync the slaves. It was working fine till 3.5 version. It is giving issues on migrating to 4.3 version. Now after I have commited incremental changes on master and optimize the index and run snappuller, snapinstaller, readercycle on slaves

Re: FAcet with " " values are displayes in output

Any analysis happening on the country field during indexing? If so then facets are on tokens. -- View this message in context: http://lucene.472066.n3.nabble.com/FAcet-with-values-are-displayes-in-output-tp4090777p4090904.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: spellcheck causing Core Reload to hang

Any specific error? Anything in the logs when it hangs? -- View this message in context: http://lucene.472066.n3.nabble.com/spellcheck-causing-Core-Reload-to-hang-tp4089866p4089931.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: "delta-import" giving Total Documents Processed = 0

Your delta query i.e. deltaQuery ="select distinct clai_idn as clai_idn from claim_history where clai_idn=29"> always gets only one row with a fixed "clai_idn". So here you fetch the same row. What you would want is to get all rows after a p

Re: solr suggestion -

Don't do any analysis on the field you are using for suggestion. What is happening here is that query time and indexing time the tokens are being broken on white space. So effectively, "at" is being taken as one token and "l" is being taken as another token for which you get two different suggestio

Re: Solr suggest - How to define solr suggest as case insensitive

This is probably because your dictionary is made up of all lower case tokens, but when you query the spell-checker similar analysis doesnt happen. Ideal case would be when you query the spellchecker you send lower case queries -- View this message in context: http://lucene.472066.n3.nabble.com/

Re: Data import

Any form of indexing would always "replace" a document and never update it. If you dont want replacements dont use a unique key in your schema and sort on time/date etc. But i still dont get one thing, if i have two indexes that i try to merge and both the indexes have some documents with same un

Re: Searching solr on school name during year

You could either add two separate fields, one for start year and another for end year. And then facilitate range queries to include all docs. eg. Name - Boris start year - 2001 end year - 2005 Or you could just have one field and put in multivalued years a student has attended the school. name

Re: Schema

Verisons mentioned in the wiki only tell you that these features are available from that version of Solr. This will not be applicable in your case as you are using the latest version. So everything you find in the wiki would be available in 4.4 Solr -- View this message in context: http://lucen

Re: Solr Filter Query

I am unsure what you mean when you say /how big a filter query can be ? /. Do you mean how long can a single filter query can be or a limit on number of filter queries that can be put? For the former you may want to visit the maxBooleanClauses in your solrconfig. Try the link: he tottp://wiki.apac

Re: Error while importing HBase data to Solr using the DataImportHandler

You would need to add the jar that is missing to the Solr web-inf\lib folder. You can do that using winzip etc into the lib folder of solr.war. Then you need to redeployed the changed solr.war and restart your webcontainer. The jar is available here: http://code.google.com/p/hbase-solr-dataimport/

Re: convert text file to solr document where delimiter fields are fields of document

Hi, Try this: http://wiki.apache.org/solr/DataImportHandler#FileDataSource and http://wiki.apache.org/solr/DataImportHandler#httpds -- View this message in context: http://l

Re: What filter to use to search with spaces omitted/included between words?

Additionally, if you dont want results like q=best and result=bestbuy; you can use to actually replace whitespaces with nothing. http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#CharFilterFactories

Re: What filter to use to search with spaces omitted/included between words?

I think you should skip spaces before indexing and querying followed by a filter of EdgeNGramFilterFactory at index time. This may requre you to work on your data before indexing & querying. Point is we do not want to make tokens by breaking them into spaces. So indexing and query time should be th

Re: Stripping Payload Fields

Why dont you copy the data you want to suggest onto another field and suggest from there. Else the trimming will have to happen at the application end if that luxury is available. -- View this message in context: http://lucene.472066.n3.nabble.com/Stripping-Payload-Fields-tp4085264p4085288.html

Re: Indexing an XML file in Apache Solr

DIH is not at all necessary and yes, SolrJ can be used to add data, the XML bit am not too sure though. Try: http://wiki.apache.org/solr/UpdateXmlMessages and http://wiki.apache.org/solr/Solrj -- View this m

Re: Solr 4.3 and above core swap

Is any other source trying to write into your index when you try to reload it? If this was so, then I guess it would have locked up the index. Check for a write.lock file in your index directory. You can remove that file manually and then retry it. -- View this message in context: http://lucene

Re: Migrating from solr 3.5 to 4.4

/ I read that we can point the new solr 4.4 to the data index from previous solr i.e. 3.5/ Yes you can do that. It would be even better if you would run an optimize post migration, it will re-write the segments. /f this is true, can we change the schema in 4.4 solr. We have many un-stored fields i

Re: Handling categories( level one and two) based navigation

This may be helpful, especially the last bit: http://blog.griddynamics.com/2011/06/solr-experience-search-parent-child.html -- View this message in context: http://lucene.472066.n3.nabble.com/Handling-categories

Re: Extending fieldtypes

You would need to provide a Solr file that would be the basic field type and do rest of analysis on it. Is this what you want? eg. fieldType name="textSpellPhrase" class="solr.TextField" positionIncrementGap="100" stored="false" multiValued="true"> -- View this message in context: http://lucen

Re: SOLR OR query, want 1 of the 2 results

Can you not get more number of results i.e. for a larger distance and sort by distance? -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-OR-query-want-1-of-the-2-results-tp4083957p4083966.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Facet field display name

Would it not be convenient to replace these alphabets with "pretty" alphabets in the application? -- View this message in context: http://lucene.472066.n3.nabble.com/Facet-field-display-name-tp4083915p4083928.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: multiValued : How do I specify name to each value returned by multiValue field.

So your doc would look something like this: Micheal Schumacher 090933434343 052323232323 073628362782 090933434343 052323232323 073628362782 -- View this message in context: http://lucene.472066.n3.nabble.com/multiValued-How-do-I-specify-name-to-each-value-returned-by-multi

Re: multiValued : How do I specify name to each value returned by multiValue field.

I think what you require here is to have different fields for mobile/landline etc. Based on where and what data you fetch these fields will be populated. You can also have a multivalued field that will contain all these fields (copyField can come in handy) for search etc. -- View this message in

Re: Spellchecker suggests Tokens

I think the issue lies in the analysis of the field you use for spellchecking. It also contains NGramFilterFactory. So wither copy your data to another field with some other fieldType which doesnot do NGramFilterFactory analysis and then try this out. -- View this message in context: http://lu

Re: commit vs soft-commit

Erik- /It does invalidate the "top level" caches, including the caches you configure in solrconfig.xml. / Could you elucidate? -- View this message in context: http://lucene.472066.n3.nabble.com/commit-vs-soft-commit-tp4083817p4083844.html Sent from the Solr - User mailing list archive at Nabb

Re: Configuring SpellCehckComponent

There are two portions here: 1. To build a dictionary. Since you are using IndexBasedSpellChecker, you would have to tell Solr, what field from your index to build up the dictionary from. 2. To actually be able to search for your corrected spellings. For this you would need a new requestHandler, to

commit vs soft-commit

Hi, Some confusion in my head. http://http://wiki.apache.org/solr/UpdateXmlMessages#A.22commit.22_and_.22optimize.22 says that /A soft commit is much faster since it only makes index changes visible and does

Re: Spelling suggestions.

I think the issue is that you are trying to use WordBreakSolrSpellChecker (which was introduced in Solr 4.x version) in your Solr App of 3.5 version. You need to correct that. -- View this message in context: http://lucene.472066.n3.nabble.com/Spelling-suggestions-tp4083519p4083816.html Sent fr

Re: Configuring SpellCehckComponent

The searchComponent would be placed in your solrconfig.xml. There is no specific place for it. This is what the comment in you solrconfig.xml says: Search Components Search components are registered to SolrCore and used by instances of SearchHandler (which can access them by name)

Re: Parent-Child relationship

Hi, As per my understanding the join is confined to a single core only and it is not possible to have joins between docs of different cores. Am I correct here? If yes, is there a possibility of having joins across cores anytime soon? -- View this message in context: http://lucene.472066.n3.nabble

Parent-Child relationship

Hi, I just wanted to get some information about whether Parent-Child relationship between documents which Lucene has been talking about has been implemented in Solr or not? I know join patch is available, would that be the only solution? And another question, as and when this will be possible (if

Re: nutch and solr

The empty path message is becayse nutch is unable to find a url in the url location that you provide. Kindly ensure there is a url there. -- View this message in context: http://lucene.472066.n3.nabble.com/nutch-and-solr-tp3765166p3773089.html Sent from the Solr - User mailing list archive at Na

Re: nutch and solr

Try this command. bin/nutch crawl urls//.txt -dir crawl/ -threads 10 -depth 2 -topN 1000 Your folder structure will look like this: -- urls -- -- .txt | | -- crawl -- The folder name will be for different domains. So for each domain

Re: Basic SOLR help needed

Hi, I guess the behavior is because of the field type of the field INST_NAME. Try changing its type to string for getting the desired results. text_en_splitting splits on whitespace. -- View this message in context: http://lucene.472066.n3.nabble.com/Basic-SOLR-help-needed-tp3759855p3759866.html

Re: Best requestHandler for "typing error".

You can enable the spellcheck component and add it to your default request handler. This might be of use: http://wiki.apache.org/solr/SpellCheckComponent http://wiki.apache.org/solr/SpellCheckComponent It could be used both during autosuggest as well as did you mean. -- View this message in con

Re: Do we need reindexing from solr 1.4.1 to 3.5.0?

There may be issues with your solrconfig. Kindly post the exception that you are recieving. -- View this message in context: http://lucene.472066.n3.nabble.com/Do-we-need-reindexing-from-solr-1-4-1-to-3-5-0-tp3739353p3750937.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: multiple values encountered for non multiValued field type:[text/html, text, html]

Hi I am not sure if what you are doing is possible i.e. having a schema other than that provided by nutch. The schema provided by nutch in its directory \conf is to be used as the solr schema. -- View this message in context: http://lucene.472066.n3.nabble.com/multiple-values-encountered-for-non-

Re: nutch in solr

alessio crisantemi-2, I think you got it.. Check the jars in nutch lib and see if the solr n solrj jars are same... That could be the issue -- View this message in context: http://lucene.472066.n3.nabble.com/nutch-in-solr-tp3716969p3717542.html Sent from the Solr - User mailing list archive at Na

Re: Which patch 236 to choose for collapse - Solr 3.5

Ummm.. I think there is some confusion here. As per my understanding, matches is the total no of docs which the original query/filter query returned. On these docs grouping is done. So matches may not be actually equal to total no. of returned in your result, post grouping. Its just a subset of th

Re: Which patch 236 to choose for collapse - Solr 3.5

No my question is post grouping. If group.limit=5 then a group may have 5 docs or less. So if i have to find out total number of docs returned post grouping i will have to see the count of docs in each group which may be any one of these - 5 or 4 or 3 or 2 or 1. So does that mean i have to iterate

Re: Which patch 236 to choose for collapse - Solr 3.5

You are right it does. Kind of missed this all together. Thanks And anyway to know the actual number of docs returned post grouping? -- View this message in context: http://lucene.472066.n3.nabble.com/Which-patch-236-to-choose-for-collapse-Solr-3-5-tp3697685p3709743.html Sent from the Solr - Use

Re: Controll of results output

Try sorting on category. That should do. http://wiki.apache.org/solr/CommonQueryParameters#sort http://wiki.apache.org/solr/CommonQueryParameters#sort -- View this message in context: http://lucene.472066.n3.nabble.com/Controll-of-results-output-tp3709288p3709691.html Sent from the Solr - User

Re: Which patch 236 to choose for collapse - Solr 3.5

I tried using grouping. Actually what works for me is group.main=true. However there is an issue. Collapsing, as in the earlier version when it returned docs, it gave a count of number of docs returned post collapsing. But I could not find a similar feature in grouping.. For eg. if before groupin

Re: Which patch 236 to choose for collapse - Solr 3.5

Our application uses collapse on a major scale. If grouping is undertaken major changes would be required on application end, which I want to avoid. Here is the exception that I get without the patch: Jan 30, 2012 10:39:52 AM org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common

Re: Which patch 236 to choose for collapse - Solr 3.5

Yes i thought so too, but when i tried setting up it gave me exception when it tried to read solr cores. The exception was there because of collapse. The wiki page talks only of grouping and unfortunately is mostly silent on collapsing -- View this message in context: http://lucene.472066.n3.nab

Which patch 236 to choose for collapse - Solr 3.5

Hi, we are migrating to Solr 3.5 from 1.3 would want to know which Solr patch in the link http:// https://issues.apache.org/jira/browse/SOLR-236 should I use for collapsing. I've tried two patches 1. SOLR-236-branch_3x.patch(18/Feb/11 16:20), it did not work at all 2. field-collapse-5.patch - i g

Re: Highlighting configuration

My default Request Handler looks like this: all highlight collapse facet And I have u

Highlighting configuration

Hi, When I try to enable my highlighting with hl=true I get the following exception. (Note: My default search field it both stored and tokenized.) message null java.lang.NullPointerException at org.apache.solr.handler.component.HighlightComponent.process(HighlightComponent.java:83) at org.apache.s

Re: A simple query?

Hi, Set your default operator to OR i.e. in schema.xml Also keep your fieldType=text i.e. As you would want whitespace tokenization and try your query with () i.e. /select/?q=myfields:(a b)&version=2.2&start=0&rows=2&indent=on This hopefully should solve your problem. -- View this message

Re: help understanding match

Hi, 1. Just curious - you have your defaultsearchfield - defaultquery as not stored, how do you know that it contains what you think it contains? 2. the fieldType of defaultquery is query_text, am not sure what all analyzers are you using on this fields type both at indexing time and querying time

Re: How to implement Spell Checker using Solr?

Firstly, just to make it clear the dictionary is made out of already indexed terms, rather it is built upon it if you are using *solr.IndexBasedSpellChecker* which you are. Next lot of changes are required for your *solrconfig.xml* 1. spell is the name of the field which will be used to create yo

Re: How to delete all of the Indexed data?

Just another point worth mentioning here.. Though its related to Nutch and not Solr.. If you want to re-crawl and try to get new data into the index, you have to remove data from the crawl folder (default for nutch) of nutch too.. Only then will you get fresh crawled data (not to be confused with

Re: Two unrelated questions

For *1* I have faced similar issues, and have realized that it has got more to do with the data I am trying to index. In some cases when I run even a full-import with DIH, unless its a flat table that I am tryin to index, there are often issues at data end when I try to get joins and then index dat

Re: Schema fieldType y-m-d ?!?!

What we did was get the date from db, and stored it in a string fieldType in the format mmdd. It works fine for us, as range query works just fine. -- View this message in context: http://lucene.472066.n3.nabble.com/Schema-fieldType-y-m-d-tp3335359p3336309.html Sent from the Solr - User maili

Re: DIH delta last_index_time

Rahul is right. You may add a script to change the date in data-import.properties to half hour before the last modi time before each delta-import. -- View this message in context: http://lucene.472066.n3.nabble.com/DIH-delta-last-index-time-tp3334992p3336203.html Sent from the Solr - User mail

Re: query - part default OR and part default AND

Keep the default Search Operator as OR And for phrase1, on splitting on whitespace just add "AND" instead of "+". Hopefully this should work. Please do confirm. -- View this message in context: http://lucene.472066.n3.nabble.com/query-part-default-OR-and-part-default-AND-tp3335851p3336194.html S

Re: Spellcheck

In the RequestHandler spellCheckCompRH you have to make changes as follows: explicit textSpell false true 5 spellcheck This hopefully should do it. Also I would suggest that for the time being (i.e. till you ge

Re: Question Query Detection Strategies?

If you have meta-data available on what all is actually searched on your site, you can use mahout to get keywords, and then define your solr accordingly. THis might help: https://cwiki.apache.org/MAHOUT/collocations.html Alternatively, you can parse your query (either at client end or server end

Re: Spellcheck

Hi if you have not figyured it out as yet, this might help:: Issues with *schema.xml* here the type should actually be textSpell (fieldType that you have defined earlier) Also I would suggest that you use a seperate RequestHandler for your queries. You alreasy have spellCheckCompRH defined

Re: Spell Check

Hey thanks. It worked. I have another query. Since I have made a dictionary on Keyword tokenization (as I need a dictionary of names), when I try to spellcheck, it works great on most cases. But in cases where say the correct word is :"Shivthar Ghal" and I try to search for a spelling correction

Re: Not getting data using concat in DIH

The XML comments were not taken. This is the data-import.xml that does not work. In bold is the line uncommented.

Not getting data using concat in DIH

Hi all, My data-import.xml looks like this: