best way to monitor the documents per second in dataimporthandler?
Hello my friend :) i want to monitor the taken time of dih with zabbix. which is the best indicator of the update-time when you using the dataimporthandler. is "time taken" correct or do you think one of request time in mbeans is better? i dont think that the value of 5minRateReqsPerSecond is a good indicator for the docs per second. thx -- View this message in context: http://lucene.472066.n3.nabble.com/best-way-to-monitor-the-documents-per-second-in-dataimporthandler-tp4135577.html Sent from the Solr - User mailing list archive at Nabble.com.
DIH - cacheImpl="SortedMapBackedCache" - empty rows from sub entity
Hello i am fighting with cacheImpl="SortedMapBackedCache". I want to refactor my ugly entities and so i try out sub-entities with caching. My Problem is that my cached subquery do not return any values from the select. but why? thats my entity this is very fast an clear and nice... but it does not work. all from table2 is not coming to my index =( BUT if i remove the line with "cacheImpl="SortedMapBackedCache" all data is present, but every row is selecte each by each. i thought that this construct, hopefully replace my ugly big join-query in a single entity!? -- View this message in context: http://lucene.472066.n3.nabble.com/DIH-cacheImpl-SortedMapBackedCache-empty-rows-from-sub-entity-tp4162316.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: DIH - cacheImpl="SortedMapBackedCache" - empty rows from sub entity
thx. this is a little bit better, but now i got only one row from entity "en2" in my index. it seems, that the lookup dont work for me =(( -- View this message in context: http://lucene.472066.n3.nabble.com/DIH-cacheImpl-SortedMapBackedCache-empty-rows-from-sub-entity-tp4162316p4162879.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: DIH - cacheImpl="SortedMapBackedCache" - empty rows from sub entity
i dont know why. but it works if i dont use cacheKey/cacheLookup. But if i use "where" it works fine. http://wiki.apache.org/solr/DataImportHandler#CachedSqlEntityProcessor - >From Example 2: where="id=en1.id" ... strange. -- View this message in context: http://lucene.472066.n3.nabble.com/DIH-cacheImpl-SortedMapBackedCache-empty-rows-from-sub-entity-tp4162316p4162882.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: Using CachedSqlEntityProcessor with delta imports in DIH
hey. are sending the cacheImpl in your request? or where are defining it? cacheImpl="${cache.impl}" if i let this string blank, import fails =( -- View this message in context: http://lucene.472066.n3.nabble.com/Using-CachedSqlEntityProcessor-with-delta-imports-in-DIH-tp4091620p4163106.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: DIH Blob data
I had a similar problem and didnt find any solution to use the fields in JSON Blob for a filter ... Not with DIH. -- View this message in context: http://lucene.472066.n3.nabble.com/DIH-Blob-data-tp4168896p4168925.html Sent from the Solr - User mailing list archive at Nabble.com.
XInclude in data-config.xml
hello. is it possible to include some entities with XInclude in my data-config.xml? i tried with this line: http://www.w3.org/2001/XInclude"; /> in my "entity.xml" is something like: some ideas, why does not work? this blog sounds good for me =( http://www.raspberry.nl/2010/10/30/solr-xml-config-includes/ -- View this message in context: http://lucene.472066.n3.nabble.com/XInclude-in-data-config-xml-tp4055487.html Sent from the Solr - User mailing list archive at Nabble.com.
Schema fieldType y-m-d ?!?!
is it possible to index a datefield in the format of "y-m-d" ? i dont need the timestamp. so i can save me some space. which ways exists to search with a complex date-filter !? - --- System One Server, 12 GB RAM, 2 Solr Instances, 7 Cores, 1 Core with 31 Million Documents other Cores < 100.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/Schema-fieldType-y-m-d-tp3335359p3335359.html Sent from the Solr - User mailing list archive at Nabble.com.
math with date and modulo
Hello. i am fighting with the FunctionQuery of Solr. I try to get a diff of today and an dateField. from this diff, i want do a modulo from another field with values of 1,3,6,12 in a function somthing like this. ( i know that some functions are not available in solr) q={!func}$v2=0&v1=(NOW - $var)&v2=modulo($v1,interval) OR (DIFF(Month of Today - Month of Search) MOD interval) = 0 can anybody give me some tipps ? - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/math-with-date-and-modulo-tp3335800p3335800.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: math with date and modulo
okay, thanks a lot. I thought, that isnt possible to get the month in my case =( i will try out another way. - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/math-with-date-and-modulo-tp3335800p3338207.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Schema fieldType y-m-d ?!?!
thx =) i think i will save this as an string if ranges really works =) - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/Schema-fieldType-y-m-d-tp3335359p3339160.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How To perform SQL Like Join
http://wiki.apache.org/solr/Join - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/How-To-perform-SQL-Like-Join-tp3351090p3352322.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How do i get results for quering with separated words?
which type in the schema.xml do you use. try out WordDelimiterFilterFactory or some other filters from this site: http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#solr.WordDelimiterFilterFactory - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/How-do-i-get-results-for-quering-with-separated-words-tp3395966p3395982.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How do i get results for quering with separated words?
index this field without whitespaces ? XD - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/How-do-i-get-results-for-quering-with-separated-words-tp3395966p3396207.html Sent from the Solr - User mailing list archive at Nabble.com.
Shard Search and pagination
Hello. i searching over 5 cores and i have a problem with the pagination. is it possible to return only the first 25 matches of a search over several cores ? the solution i have now, is that ervery core returns 25 documents, but i want only the first 25 docs of the "complete" search. my goal ist a merged resultset, but pagination is not really possible if get from every core a other count of documents. its possible to get 5 doc from core1 and 24 docs from core2 is it possible to get totalRows or something like that in Shard Search? thx - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/Shard-Search-and-pagination-tp3402343p3402343.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: some basic information on Solr
i think with "incident" he mean, failures / downtimes / problems with solr !? - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/some-basic-information-on-Solr-tp3448957p3453837.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: best way for sum of fields
sry. i need the sum of values of the found documents. e.g. the total amount of one day. each doc in index has ist own amount. i try out something with StatsComponent but with 48 Million docs in Index its to slow. - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/best-way-for-sum-of-fields-tp3477517p3486406.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: best way for sum of fields
yes, this way i am using on another part in my application. i hoped, that exists another way to avoid the way over php - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/best-way-for-sum-of-fields-tp3477517p3486593.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: best way for sum of fields
hi thanks for the big reply ;) i had the idea with the several and small 5M shards too. and i think thats the next step i have to go, because our biggest index grows each day with avg. 50K documents. but make it sense to keep searcher AND updater cores on one big server? i dont want to use replication, because with our own high avalibility solution is this not possible. my system is split into searcher and updater cores, each with his own index. some search requests are over all this 8 cores with distributed search. - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/best-way-for-sum-of-fields-tp3477517p3486652.html Sent from the Solr - User mailing list archive at Nabble.com.
new NRT in my case quite useful?
I Read this Articel from Mark Miller http://www.lucidimagination.com/blog/2011/07/11/benchmarking-the-new-solr-%E2%80%98near-realtime%E2%80%99-improvements/ Now i want to know if its useful to update on a new solr version. My version is: 4.0.0.2010.10.26.08.43.14 I need a really good NRT search for my application, and i realized it with several cores/indices and each of them is splitted into one core for search request and another core for indexing. my dih need ~15 seconds for 1500 docs to index in my "main" and biggest index. its not so bad. but make it sense to use a newer version of solr, with hard- and soft-commits? in specially i want to split my 50M index into several smaller index for a faster search, update and optimizations. - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/new-NRT-in-my-case-quite-useful-tp3572433p3572433.html Sent from the Solr - User mailing list archive at Nabble.com.
Replace Patter "," with ""
Why does this not work? OR i dont know where is my error? i only want to replace comma with a blank ... thx =))) - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/Replace-Patter-with-tp3662813p3662813.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Replace Patter "," with ""
okay, thx =) but i replace it now in my data-config ;) - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/Replace-Patter-with-tp3662813p3663027.html Sent from the Solr - User mailing list archive at Nabble.com.
underscore, comma in terms.prefix
Hello. this is my filterchain for suggestion with termsComponent: so my question/problem is. - when i index with this settings i got a underscore ("_") in my index. is comma replace with underscore ? - solr import this strin: "Eiseimer COOL mit Greifer" into this -> "cool mit mit" when i search for terms.prefix=cool why is mit twice ? sometimes ist cool twice in my suggest any idea ?? ! =) thx -- View this message in context: http://lucene.472066.n3.nabble.com/underscore-comma-in-terms-prefix-tp919565p919565.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: underscore, comma in terms.prefix
okay thx. WordDelimiterFactory with the option generateNumberParts="0" maked trouble ;-) -- View this message in context: http://lucene.472066.n3.nabble.com/underscore-comma-in-terms-prefix-tp919565p919655.html Sent from the Solr - User mailing list archive at Nabble.com.
Facet as Autosuggestion
Hello.. I have a little question about Facetting. When i use "facet.prefix=mau", i geht these result: 49 23 thats fine, but i miss the last word for the result "bluetooth laser". i want "bluetooth laser maus" the problem is, when i use this as suggestion and the user search for "bluetooth laser" he maybe does not find the "bluetooth laser maus" ... why can facet not give only 2 words back ? is there a similar option like in the TermsComponent: terms.lower.incl={true|false} ??? -- View this message in context: http://lucene.472066.n3.nabble.com/Facet-as-Autosuggestion-tp927983p927983.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: ArrayIndexOutOfBoundsException heeeeeelp !?!?!?!!?! Sorting
I get only this exception when i sort on my popularity field. WHY ??? ...&sort=score desc, popularity desc --> BAD ...&sort=score desc --> All fine. thats not good =( -- View this message in context: http://lucene.472066.n3.nabble.com/ArrayIndexOutOfBoundsException-heelp-Sorting-tp932956p932968.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: ArrayIndexOutOfBoundsException heeeeeelp !?!?!?!!?! Sorting
aha. the type is "sint" do i need to use "string" ore which field did not use any tokenizer ? ^^ i thought sint is untokenized... -- View this message in context: http://lucene.472066.n3.nabble.com/ArrayIndexOutOfBoundsException-heelp-Sorting-tp932956p933003.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: ArrayIndexOutOfBoundsException heeeeeelp !?!?!?!!?! Sorting
it makes no sense. i can on my playground-core sort for popularity, but not on my live-core. both cores, have the same configuration ... the problem occurs after use facet-search. thats maybe an reason ? or too many data ? to low server ? any idea -- View this message in context: http://lucene.472066.n3.nabble.com/ArrayIndexOutOfBoundsException-heelp-Sorting-tp932956p933099.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: ArrayIndexOutOfBoundsException heeeeeelp !?!?!?!!?! Sorting
hey. of course i mean "sint", from the default/example SchemaXML. after few days sort for popularity works well again ... ?! i found a value of -1252810 in my popularity field... i think this was the problem. but i dont know how can the field become this value. -- View this message in context: http://lucene.472066.n3.nabble.com/ArrayIndexOutOfBoundsException-heelp-Sorting-tp932956p943791.html Sent from the Solr - User mailing list archive at Nabble.com.
meaning of underscore in prefix search.
Hello. i use facet.prefix and terms.prefix for my search. what is the meaning of the underscore "_" in the results. when change solr some string into a underscore ? sometimes it make no sence to suggest the client with this ... thx ! -- View this message in context: http://lucene.472066.n3.nabble.com/meaning-of-underscore-in-prefix-search-tp944120p944120.html Sent from the Solr - User mailing list archive at Nabble.com.
Facet Search is too slow ! Optimize suggestions ?
Hello. I use facet-search for my autosuggestion. the results are okay, but sometimes its too slow. We Have 4,2 Million Documents and each day we get more and more ... I try out the Cache Settings with this parameter: For every Cache. How can i optimize the facet search ? The Server is an 8 Dual Core with .. i think 12 GB RAM ... so i thought thats enough for Solr Facet search. When a new Search search for something like: "rotw" and nothing is cached solr need sometimes much time for a response ... =( =( all over two seconds is not good fur autosuggestion ... thxxx -- View this message in context: http://lucene.472066.n3.nabble.com/Facet-Search-is-too-slow-Optimize-suggestions-tp944361p944361.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Facet Search is too slow ! Optimize suggestions ?
okay. How many unique terms? - Docs: 3911249 and Distinct: 2302852 app ? - iPhone App for product search. faceting on ? - im faceting on the product names, with Shingles (maxShingle: 5 ?? too big ?) how you faceting? - search over all .../?q=*:*&facet.prefix=string&rows=0 search with shops filter: .../?q=*:*&facet.prefix=string&rows=0&shop_id:54 i dont kow how its the best way to configure it. -- View this message in context: http://lucene.472066.n3.nabble.com/Facet-Search-is-too-slow-Optimize-suggestions-tp944361p944386.html Sent from the Solr - User mailing list archive at Nabble.com.
Solr Doc Lucene Doc !?
Hello. I write a little text about SOLR and LUCENE by using the DIH. what documents are creating and inserting DIH ? in wiki is the talk about "solr documents" but i thought that, solr uses lucene to do this and so that DIH creates Lucnee Documents, not Solr Documents !? what are doing the DIH exactly ? how can i easy find out that !? or how is intern manage the documents in solr ? is there a different about solr and lucene doc`s ? can anyone give me a little overview how DIH works ? that would be great ;-) thx stockiii -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Doc-Lucene-Doc-tp995922p995922.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr Doc Lucene Doc !?
... but in the code is the talk about of, SolrDocuments. these are higher level docs, used to construct the lucene doc to index ... !!?!?!?!? and in wiki is the talk about "Build Solr documents by aggregating data from multiple columns and tables according to configuration" http://wiki.apache.org/solr/DataImportHandler?highlight=(dih) so its a little bit confused. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Doc-Lucene-Doc-tp995922p996005.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr Doc Lucene Doc !?
i want to learn more about the technology. exists an issue to create really an solrDoc ? Or its in the code only for a better understanding of the lucene and solr border ? -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Doc-Lucene-Doc-tp995922p99.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr Doc Lucene Doc !?
ah okay thx =) the class "SolrInputDocuments" is only for indexing an document and "SolrDocuement" for the search ? when Solr index an document first step is to create an SolrInputDocument. then in class "DocumentBuilder" creates solr in function "Document toDocument (SolrInputDoc, Schema)" an Lucene Document ?! -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Doc-Lucene-Doc-tp995922p997196.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Strange search
try to delete "solr.SnowballPorterFilterFactory" from your analyzerchain. i had similar problems by using german SnowballPorterFilterFactory -- View this message in context: http://lucene.472066.n3.nabble.com/Strange-search-tp998961p1001990.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr Doc Lucene Doc !?
There is a real and actual class named "SolrDocument". it is a simpler object then Lucene's "Document" class becuase in Solr the details about the field types (stored, indexed, etc...) are handled by the schema, and are not distinct per Field instance. Chris Hostetter-3 wrote: > > okay thx, that make sense, but why is in class AddUpadeteCommand.java this: // Higher level SolrInputDocument, normally used to construct the Lucene Document // to index. public SolrInputDocument solrDoc; thx =) -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Doc-Lucene-Doc-tp995922p1030346.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr Doc Lucene Doc !?
i have a question about the solr index mechanism with DIH ... i try to understand how solr index an doc, and on wich code-elements, solr using lucene. thats my stand: DIH is using the SolrWriter to add an doc. To create an SolrInoputDocument SolrWriter uses the addUpdateCommand, This Command and Doc is put in the UpdateRequestProcessorChain. In this Chain solr creates an LuceneDoc with DocumentBuilder and put it back into the chain !?!? is this right ? Then the UpdateHandler getting the UpdateChain and managed the index changes !? So. i dont understand, how works the updatehandler. can anyone give me some tipps ? SolrIndexWriter is using from UpdateHandler and SolrindexWriter use IndexWriter from Lucene ? thx for your help =)=) -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Doc-Lucene-Doc-tp995922p1088334.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr Doc Lucene Doc !?
oh, i see that i mixed DIH classes with other Solr classes ^^ -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Doc-Lucene-Doc-tp995922p1088738.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr Doc Lucene Doc !?
no help ? =( -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Doc-Lucene-Doc-tp995922p1114172.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr Doc Lucene Doc !?
i write a little thesis about this. and i need to know how solr is using lucene -in which way. in example of using dih and searching. so for my better understanding .. ;-) -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Doc-Lucene-Doc-tp995922p1118089.html Sent from the Solr - User mailing list archive at Nabble.com.
SolrIndex / LuceneIndex
Hello. in http://lucene.apache.org/solr/api/index.html?org/apache/solr/common/SolrDocument.html Is the talk about "SolrIndex" --> "A concrete representation of a document within a Solr index" is solr create an special SolrIndex or is here mean an LuceneIndex ? thx ;) -- View this message in context: http://lucene.472066.n3.nabble.com/SolrIndex-LuceneIndex-tp1226714p1226714.html Sent from the Solr - User mailing list archive at Nabble.com.
How to Debug Sol-Code in Eclipse ?!
Hello.. Can anyone give me some tipps to debug the solr-code in Eclipse ? or do i need apache-Ant to do this ? thhx =) -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1262050.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to Debug Sol-Code in Eclipse ?!
thx for you reply. i dont want to test my own classes in unittest. i try to understand how solr works , because i write a little text about solr and lucene. so i want go through the code, step by step and find out on which places is solr using lucene. when i can debug the code its easyer ;-) -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1274285.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to Debug Sol-Code in Eclipse ?!
1. did you mean solr war ? or all libs in /trunk/solr/lib/ 2. what is the revision of the actual 1.4.1 ? 3. EmbededSolrServer ? what should do this little programm ? -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1275295.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to Debug Sol-Code in Eclipse ?!
oha, thx i will try it =) -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1278704.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to Debug Sol-Code in Eclipse ?!
wich revision is the revision of 1.4.1 ? -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1280956.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to Debug Sol-Code in Eclipse ?!
im stupid. XD how get i the revsion of the solr 1.4.1 or do i nee build an war from my snv-checkout ? -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1281253.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to Debug Sol-Code in Eclipse ?!
okay, thx. but it want work =( i checkout solr1.4.1 as dynamic web project into eclipse. startet jetty with XDebug. In eclpise i add WebLogic exactly how the tutorial shows but eclipse cannot connect =( any idea what im doing wrong ? -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1282560.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to Debug Sol-Code in Eclipse ?!
can nobody help me or want :D -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1288705.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to Debug Sol-Code in Eclipse ?!
"ant package" BUILD FAILED run program "perl" ... it`s necessary to install perl on my computer ?! -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1291992.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to Debug Sol-Code in Eclipse ?!
thx, for your help. now it works fine. its very simple when you kno how :D haha i try bernds suggest =) -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1296175.html Sent from the Solr - User mailing list archive at Nabble.com.
minMergeDocs supported ?
Heya: IS minMergeDocs SUPPORTED IN soLR ? -- View this message in context: http://lucene.472066.n3.nabble.com/minMergeDocs-supported-tp1302856p1302856.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: minMergeDocs supported ?
in lucene is this option for the index configuration available. In Solr too ? -- View this message in context: http://lucene.472066.n3.nabble.com/minMergeDocs-supported-tp1302856p1307821.html Sent from the Solr - User mailing list archive at Nabble.com.
Purpose of SolrDocument.java
I worling through the SolrCode and i want to know how the class SolrDocument used in Solr !? When i start and debug a normal search, SolrDocument never been used. (Standard SearchHandler with q-Query). i thought, this class is a representation of a Doc from the Index as a higher level doc above the lucene doc. so i thougt that solr convert a lucene doc to a SolrDoc and work with this. but solr doing an prefetch with DocSllice/DocSet/DocList ... an get the real lucene doc in the XML-Writer for the response. So for what is SolrDocument th -- View this message in context: http://lucene.472066.n3.nabble.com/Purpose-of-SolrDocument-java-tp1408443p1408443.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Purpose of SolrDocument.java
aaah okay. so its SolrDocument in "normal" search never been used ? its only for other solr-plugins ? -- View this message in context: http://lucene.472066.n3.nabble.com/Purpose-of-SolrDocument-java-tp1408443p1411276.html Sent from the Solr - User mailing list archive at Nabble.com.
which way for "export"
hello. Which is the best/fastest way to get the value of many fields from index? My problem is, that i need to calculate a sum of amounts. this amount is in my index (stored="true"). my php script get all values with paging. but if a request takes too long, jetty is killing this process of "export". is it better to get all the fields with "wt=csv/json/xml" or something other handler? -- View this message in context: http://lucene.472066.n3.nabble.com/which-way-for-export-tp4032487.html Sent from the Solr - User mailing list archive at Nabble.com.
Calculate a sum.
hello. My problem is, that i need to calculate a sum of amounts. this amount is in my index (stored="true"). my php script get all values with paging. but if a request takes too long, jetty is killing this process and i get a "broken pipe". Which is the best/fastest way to get the values of many fields from index? exists an ResponseHandler for exports? Or which is the fastest? -- View this message in context: http://lucene.472066.n3.nabble.com/Calculate-a-sum-tp4033091.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Calculate a sum.
Hey, thx for your reply. i forgot to say. StatsComponent doesnt work with our application. too slow and buggy. but i test with this component with version 1.4 ... maybe some bugfixes in 4.0 ? this is the reason for calculating the sum on client side and some pages. but sometimes its too much for server. -- View this message in context: http://lucene.472066.n3.nabble.com/Calculate-a-sum-tp4033091p4033097.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Calculate a sum.
Mikhail Khludnev wrote > You can spend some heap for uninverting the index and > utilize wiki.apache.org/solr/StatsComponent what do you mean with this? Edward Garrett wrote > how many documents are you working with? ~90 million documents ... -- View this message in context: http://lucene.472066.n3.nabble.com/Calculate-a-sum-tp4033091p4033152.html Sent from the Solr - User mailing list archive at Nabble.com.
compare two shards.
hello. i want to compare two shards each other, because these shards should have the same index. but this isnt so =( so i want to find these documents, there are missing in one shard of my both shards. my ideas - distrubuted shard request on my nodes and fire a facet search on my unique-field. but the result of facet component isnt reversable =( - grouping. but its not working correctly i think so. no groups of the same uniquekey in the resultset. does anyone some better ideas? -- View this message in context: http://lucene.472066.n3.nabble.com/compare-two-shards-tp4039887.html Sent from the Solr - User mailing list archive at Nabble.com.
Best requestHandler for "typing error".
Hello. Which RH do you use to find typing errors like "goolge" => do you mean "google" ?! I want to use my Autosuggestion "EdgeNGram" with a clever AutoCorrection! What do you use ? - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/Best-requestHandler-for-typing-error-tp3749576p3749576.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Using two repeater to rapidly switching Master and Slave (Replication)?
Did your configuration works ? i have the same issue and i dont know if it works... i have 2 servers. each with 2 solr instances (one for updates other for searching) now i need replication from solr1 to solr2. but what the hell do solr if master crashed ??? - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/Using-two-repeater-to-rapidly-switching-Master-and-Slave-Replication-tp3089653p3826234.html Sent from the Solr - User mailing list archive at Nabble.com.
Master/Slave switch on teh fly. Replication
Hello. Is it possible to switch master/slave on the fly without restarting the server? - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/Master-Slave-switch-on-teh-fly-Replication-tp3828313p3828313.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Master/Slave switch on teh fly. Replication
i have 8 cores ;-) i thought that replication is defined in solrconfig.xml and this file is only load on startup and i cannot change master to slave and slave to master without restarting the servlet-container ?!?!?! - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/Master-Slave-switch-on-the-fly-Replication-tp3828313p3831948.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: querying on shards
@Shawn Heisey-4 how look your requestHandler of your broker? i think about your idea to do the same ;) - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/querying-on-shards-tp3841446p3852001.html Sent from the Solr - User mailing list archive at Nabble.com.
Replication failed without an error =(
hello.. anyone a idea how i can figure out why my replication failed ? i got no errors =( my configuratio is. 2 server! both are master and slave at the same time. only one server makes updates and is so the master. on slave is started via cron a replication. is one server crashed, i can easy switch master to slave, this is because both are master AND slave at the same time. this works well but now no replicate is working since i deleted the pollInterval !?!? is this a reason? thx - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/Replication-failed-without-an-error-tp3934655p3934655.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Replication failed without an error =(
bevore this problem i got this problem https://issues.apache.org/jira/browse/SOLR-1781 - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/Replication-failed-without-an-error-tp3934655p3934813.html Sent from the Solr - User mailing list archive at Nabble.com.
DIH NoClassFoundError.
is it not fucking possible to import DIH !?!?!? WTF! i load the new solr 3.6. from website. but when i started solr i got evertime " no DIH found" if i put in my solrconfig AND have this structure http://lucene.472066.n3.nabble.com/file/n3938253/Bildschirmfoto.png i got this message: SEVERE: java.lang.NoClassDefFoundError: org/apache/solr/util/plugin/SolrCoreAware - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/DIH-NoClassFoundError-tp3938253p3938253.html Sent from the Solr - User mailing list archive at Nabble.com.
Replication. confFiles and permissions.
Hello. i running a solr replication. works well, but i need to replicate my dataimport-properties. if server1 replicate this file after he create everytime a new file, with *.timestamp, because the first replication run create this file with wrong permissions ... how can is say to solr replication "chmod 755 dataimport-properties ..." ? ;-) thx - --- System One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 1 Core with 45 Million Documents other Cores < 200.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/Replication-confFiles-and-permissions-tp3973825.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Replication. confFiles and permissions.
my setup includes a asynchron replication. this means, both are master AND slave at the same time. so i can easy switch master and slave on the fly without resarting any server with mass of scripts ... i trigger a replication via cronjob and look everytime, if server is master or slave. only slave is allowed to fetch index from master. but when i need to switch, i need the dataimport.properties to get correct deltas ... - --- System 2 server, each 12 GB RAM, 2 Solr instances with 12 cores, asynchronous recplication. -- View this message in context: http://lucene.472066.n3.nabble.com/Replication-confFiles-and-permissions-tp3973825p3974427.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Replication. confFiles and permissions.
my setup includes a asynchron replication. this means, both are master AND slave at the same time. so i can easy switch master and slave on the fly without resarting any server with mass of scripts ... i trigger a replication via cronjob and look everytime, if server is master or slave. only slave is allowed to fetch index from master. but when i need to switch, i need the dataimport.properties to get correct deltas ... - --- System 2 server, each 12 GB RAM, 2 Solr instances with 12 cores, asynchronous recplication. -- View this message in context: http://lucene.472066.n3.nabble.com/Replication-confFiles-and-permissions-tp3973825p3974440.html Sent from the Solr - User mailing list archive at Nabble.com.
commit=true has no effect
Hello. some of my cores absolutely dont want to commit the delta-import changes. the query are all okay but i have no idea what ist wrong Solr version: Solr Specification Version: 4.0.0.2010.10.26.08.43.14 dih found the deltas, and changed it but no commit is performed !? the config files are the same like from another core, where delta works fine. only the sql statement changed. thx for your help -- View this message in context: http://lucene.472066.n3.nabble.com/commit-true-has-no-effect-tp1952567p1952567.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: commit=true has no effect
=( anyone a idea ? -- View this message in context: http://lucene.472066.n3.nabble.com/commit-true-has-no-effect-tp1952567p1953391.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: commit=true has no effect
Here is my query: http://lucene.472066.n3.nabble.com/commit-true-has-no-effect-tp1952567p1959429.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: commit=true has no effect
DIH Response XML: 2 1 0 2010-11-24 09:56:11 2010-11-24 09:56:11 2010-11-24 09:56:11 2010-11-24 09:56:11 1 0 0:0:0.234 here i am missing the lines: Indexing completed. Added/Updated: 1 documents. Deleted 0 documents. 2010-11-24 09:57:08 2010-11-24 09:57:08 -- View this message in context: http://lucene.472066.n3.nabble.com/commit-true-has-no-effect-tp1952567p1959524.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: commit=true has no effect
its so strange ... - i copy the solrconfig.xml from this core, that works and no changes - i delete all fields in my query and change it to a simple query with two fields. no commit ... -- View this message in context: http://lucene.472066.n3.nabble.com/commit-true-has-no-effect-tp1952567p1959587.html Sent from the Solr - User mailing list archive at Nabble.com.
DIH delta, deltaQuery
Hello. i wonder why this deltaQuery takes over a minute: deltaQuery="SELECT id FROM sessions WHERE created BETWEEN DATE_ADD( NOW(), INTERVAL - 1 HOUR ) AND NOW() OR modified BETWEEN '${dataimporter.sessions .last_index_time}' AND DATE_ADD( NOW(), INTERVAL - 1 HOUR ) " the database have only 700 Entries and the compare with modified takes so long !!? when i remove the modified compare its fast. when i put this query in my mysql database the query need 0.0014 seconds ... wha is it so slow? -- View this message in context: http://lucene.472066.n3.nabble.com/DIH-delta-deltaQuery-tp1960246p1960246.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: DIH : Delta import don't process the updated documents
hey. i know this problem. DIH dont commit your documents. if there not comited, no changes in the index. in my case, i had a broken delta-query. some stupid mistakes like. id = '{$dataimporter.delta.id}' or deltaimporter.delta.id check your delta ID and dih should commit you changes. DIH says that he changed something, becaus your deltaQuery is correct. but not the deltaImportQuery. maybe thats helps. are here missing the ' ' ??? -- View this message in context: http://lucene.472066.n3.nabble.com/DIH-Delta-import-don-t-process-the-updated-documents-tp1966881p1972018.html Sent from the Solr - User mailing list archive at Nabble.com.
Large Hdd-Space using during commit/optimize
Hello. i have ~37 Million Docs that i want to index. when i starte a full-import i importing only every 2 Million Docs, because of better controll over solr and space/heap so when i import 2 million docs and solr start the commit and the optimize my used disc-space jumps into the sky. reacten: solr restart and space the used space goes down. why is using solr so many space ? can i optimize that ? -- View this message in context: http://lucene.472066.n3.nabble.com/Large-Hdd-Space-using-during-commit-optimize-tp1985807p1985807.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Large Hdd-Space using during commit/optimize
aha okay. thx i dont know that solr copys the complete index for optimize. can i solr say, that he start an optimize, but wihtout copy ? -- View this message in context: http://lucene.472066.n3.nabble.com/Large-Hdd-Space-using-during-commit-optimize-tp1985807p1987477.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Large Hdd-Space using during commit/optimize
aha aha :D hm i dont know. we import in 2MillionSteps because we think that solr locks our database and we want a better controll of the import ... -- View this message in context: http://lucene.472066.n3.nabble.com/Large-Hdd-Space-using-during-commit-optimize-tp1985807p1991392.html Sent from the Solr - User mailing list archive at Nabble.com.
Best practice for Delta every 2 Minutes.
Hello. index is about 28 Million documents large. When i starts an delta-import is look at modified. but delta import takes to long. over an hour need solr for delta. thats my query. all sessions from the last hour should updated and all changed. i think its normal that solr need long time for the querys. how can i optimize this ? deltaQuery="SELECT id FROM sessions WHERE created BETWEEN DATE_ADD( NOW(), INTERVAL - 10 HOUR ) AND NOW() OR modified BETWEEN '${dataimporter.last_index_time}' AND DATE_ADD( NOW(), INTERVAL - 1 HOUR ) " -- View this message in context: http://lucene.472066.n3.nabble.com/Best-practice-for-Delta-every-2-Minutes-tp1992714p1992714.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Best practice for Delta every 2 Minutes.
everyday ~30.000 Documents and every hour ~1200 multiple thread with DIH ? how it works ? -- View this message in context: http://lucene.472066.n3.nabble.com/Best-practice-for-Delta-every-2-Minutes-tp1992714p1992767.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Best practice for Delta every 2 Minutes.
how do you think is the deltaQuery better ? XD -- View this message in context: http://lucene.472066.n3.nabble.com/Best-practice-for-Delta-every-2-Minutes-tp1992714p1992774.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Best practice for Delta every 2 Minutes.
i copied the wrong query, because 10 hours ;) i didnt test the query with 28 million records . but wiht a few million and it works fine. ... before i used DIH, i used php and import direclty documents into solr. but i want use dih because the better performance, i think so ... grml ... -- View this message in context: http://lucene.472066.n3.nabble.com/Best-practice-for-Delta-every-2-Minutes-tp1992714p1992908.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Large Hdd-Space using during commit/optimize
okay. the query kills the database, because no index of modified is set ... -- View this message in context: http://lucene.472066.n3.nabble.com/Large-Hdd-Space-using-during-commit-optimize-tp1985807p1993750.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Best practice for Delta every 2 Minutes.
http://10.1.0.10:8983/solr/payment/dataimport?commad=delta-import&debug=on dont work. no debug is started =( thanks. i will try mergefactor=2 -- View this message in context: http://lucene.472066.n3.nabble.com/Best-practice-for-Delta-every-2-Minutes-tp1992714p1997595.html Sent from the Solr - User mailing list archive at Nabble.com.
send XML multiValued Field Solr-PHP-Client
Hello. do anyone using Solr-PHP-Client ? how are you using mutltivalued fields with the method addFields() ? solr says to me SCHWERWIEGEND: java.lang.NumberFormatException: empty String when i send a raw xml like this: 24038608 778 reason1 reason1 in schema i defined: why dont work this ? =( -- View this message in context: http://lucene.472066.n3.nabble.com/send-XML-multiValued-Field-Solr-PHP-Client-tp1998370p1998370.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Best practice for Delta every 2 Minutes.
at the time no OOM occurs. but we are not in correct live system ... i thougt maybe i get this problem ... we are running seven cores and each want be update very fast. only one core have a huge index with 28M docs. maybe it makes sense for the future to use solr with replication !? or can i runs two instances, one for search and one for updating ? or is there the danger of corrupt indizes ? -- View this message in context: http://lucene.472066.n3.nabble.com/Best-practice-for-Delta-every-2-Minutes-tp1992714p2005108.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Tuning Solr caches with high commit rates (NRT)
great thread and exactly my problems :D i set up two solr-instances, one for update the index and another for searching. When i perform an update. the search-instance dont get the new documents. when i start a commit on searcher he found it. how can i say the searcher that he alwas look not only the "old" index. automatic refresh ? XD -- View this message in context: http://lucene.472066.n3.nabble.com/Tuning-Solr-caches-with-high-commit-rates-NRT-tp1461275p2005738.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Dataimport: Could not load driver: com.mysql.jdbc.Driver
maybe encoding !? -- View this message in context: http://lucene.472066.n3.nabble.com/Dataimport-Could-not-load-driver-com-mysql-jdbc-Driver-tp2021616p2027138.html Sent from the Solr - User mailing list archive at Nabble.com.
backup of Index or Snapshoot ?
Hello. Iam working with the shell-scripts for solr for performing a snapshot of the index. to do a snapshot is really easy and works fine. but how can i install a snaposhot for multi-cores. i wrote a little script wich install each snapshot for each core: cd $HOME_DIR/solr/bin ./snapinstaller -M http://localhost:$PORT/solr/core -S $DATA_DIR/payment -d $DATA_DIR/core so. but when i start this command comes ssh cannot connect to localhost. why is it not possible to set the port in this sript !?!? --> eg: -p 8983 it works, but why ? i want no errors by using this script ... -- View this message in context: http://lucene.472066.n3.nabble.com/backup-of-Index-or-Snapshoot-tp2126417p2126417.html Sent from the Solr - User mailing list archive at Nabble.com.
hole RAM using by solr during Optimize
Hello. I have a RAM problem during a optimize. When is start an delta or full import, solr using only this ram which i allocate to him. eg.: java -jar -Xmx2g start.jar when solr is fetching the rows from database the using of ram ist okay. But when solr begin to otimize, solr want all of the available ram ?!?!?!?!?!? why is it so. the used Ram jumpes into the sky and only 40 MB Ram is free, of 8 GB !!! how can i limit this ? -- View this message in context: http://lucene.472066.n3.nabble.com/hole-RAM-using-by-solr-during-Optimize-tp2130482p2130482.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: hole RAM using by solr during Optimize
maybe i set my chache in solrconfig.xml to high ? why now i see das the cache very high in server. -- View this message in context: http://lucene.472066.n3.nabble.com/hole-RAM-using-by-solr-during-Optimize-tp2130482p2130490.html Sent from the Solr - User mailing list archive at Nabble.com.
Tuning StatsComponent
Hello. i`m using the StatsComponent to get the sum of amounts. but solr statscomponent is very slow on a huge index of 30 Million documents. how can i tune the statscomponent ? the problem is, that i have 5 currencys and i need to send for each currency a new request. thats make the solr search sometimes very slow. =( any ideas ? -- View this message in context: http://lucene.472066.n3.nabble.com/Tuning-StatsComponent-tp2225809p2225809.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Tuning StatsComponent
oh thx for your fast reply. i will try the suggestions. in meanwhile more information about my index. i have 2 solr instances with 6 cores. each core have his own index and one core`s index is about 30 million documents. each document have:(stats-relevant) amount amount_euro currency_id user_costs user_costs_euro currency_id_user_costs so i send for each currency an requeston statscompontn like this stats=true&json.nl=map&wt=javabin&rows=0&version=2&fl=uniquekey,score&start=0&stats.field=amount&q=QUERY&isShard=true&fq=product:bla+currency_id:EUR&fsv=true the stats.field is changing and filter for each of my 5 currencys. so for ONE search-request, i need to send 10 requests to get the sums. and that veeery slow =( i searching over two shards. sometimes more than two. -- View this message in context: http://lucene.472066.n3.nabble.com/Tuning-StatsComponent-tp2225809p2226258.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Tuning StatsComponent
when i start statsComponent i get this message: INFO: UnInverted multi-valued field {field=product,memSize=4336,tindexSize=46,time=0,phase1=0,nTerms=1,bigTerms=1,termInstances=0,uses=0} what means this ? -- View this message in context: http://lucene.472066.n3.nabble.com/Tuning-StatsComponent-tp2225809p2226555.html Sent from the Solr - User mailing list archive at Nabble.com.
!= unequal in fq !?
hello. i need to filter a field. i want all fields are not like the given string. eg.: ...&fq=status!=refundend how can i realize this in solr !? i dont want to use ...string+OR+string+OR+... -- View this message in context: http://lucene.472066.n3.nabble.com/unequal-in-fq-tp2233235p2233235.html Sent from the Solr - User mailing list archive at Nabble.com.