best way to monitor the documents per second in dataimporthandler?

2014-05-14 Thread stockii
Hello my friend :)

i want to monitor the taken time of dih with zabbix. which is the best
indicator of the update-time when you using the dataimporthandler. is "time
taken" correct or do you think one of request time in mbeans is better? i
dont think that the value of 5minRateReqsPerSecond is a good indicator for
the docs per second. 


thx



--
View this message in context: 
http://lucene.472066.n3.nabble.com/best-way-to-monitor-the-documents-per-second-in-dataimporthandler-tp4135577.html
Sent from the Solr - User mailing list archive at Nabble.com.


DIH - cacheImpl="SortedMapBackedCache" - empty rows from sub entity

2014-10-02 Thread stockii
Hello

i am fighting with cacheImpl="SortedMapBackedCache".

I want to refactor my ugly entities and so i try out sub-entities with
caching.
My Problem is that my cached subquery do not return any values from the
select. but why?

thats my entity 






this is very fast an clear and nice... but it does not work. all from table2
is not coming to my index =(
BUT if i remove the line with "cacheImpl="SortedMapBackedCache" all data is
present, but every row is selecte each by each.
i thought that this construct, hopefully replace my ugly big join-query in a
single entity!?



--
View this message in context: 
http://lucene.472066.n3.nabble.com/DIH-cacheImpl-SortedMapBackedCache-empty-rows-from-sub-entity-tp4162316.html
Sent from the Solr - User mailing list archive at Nabble.com.


RE: DIH - cacheImpl="SortedMapBackedCache" - empty rows from sub entity

2014-10-06 Thread stockii
thx. 
this is a little bit better, but now i got only one row from entity "en2" in
my index. 
it seems, that the lookup dont work for me =((



--
View this message in context: 
http://lucene.472066.n3.nabble.com/DIH-cacheImpl-SortedMapBackedCache-empty-rows-from-sub-entity-tp4162316p4162879.html
Sent from the Solr - User mailing list archive at Nabble.com.


RE: DIH - cacheImpl="SortedMapBackedCache" - empty rows from sub entity

2014-10-06 Thread stockii
i dont know why. but it works if i dont use cacheKey/cacheLookup. But if i
use "where" it works fine.

http://wiki.apache.org/solr/DataImportHandler#CachedSqlEntityProcessor -
>From Example 2:

where="id=en1.id" ... strange.



--
View this message in context: 
http://lucene.472066.n3.nabble.com/DIH-cacheImpl-SortedMapBackedCache-empty-rows-from-sub-entity-tp4162316p4162882.html
Sent from the Solr - User mailing list archive at Nabble.com.


RE: Using CachedSqlEntityProcessor with delta imports in DIH

2014-10-07 Thread stockii
hey.

are sending the cacheImpl in your request? or where are defining it?
cacheImpl="${cache.impl}"

if i let this string blank, import fails =(




--
View this message in context: 
http://lucene.472066.n3.nabble.com/Using-CachedSqlEntityProcessor-with-delta-imports-in-DIH-tp4091620p4163106.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: DIH Blob data

2014-11-12 Thread stockii
I had a similar problem and didnt find any solution to use the fields in JSON
Blob for a filter ... Not with DIH.



--
View this message in context: 
http://lucene.472066.n3.nabble.com/DIH-Blob-data-tp4168896p4168925.html
Sent from the Solr - User mailing list archive at Nabble.com.


XInclude in data-config.xml

2013-04-12 Thread stockii
hello.

is it possible to include some entities with XInclude in my data-config.xml?

i tried with this line:
http://www.w3.org/2001/XInclude"; />

in my "entity.xml"  is something like:


some ideas, why does not work? 
this blog sounds good for me =( 
http://www.raspberry.nl/2010/10/30/solr-xml-config-includes/



--
View this message in context: 
http://lucene.472066.n3.nabble.com/XInclude-in-data-config-xml-tp4055487.html
Sent from the Solr - User mailing list archive at Nabble.com.


Schema fieldType y-m-d ?!?!

2011-09-14 Thread stockii
is it possible to index a datefield in the format of "y-m-d" ? i dont need
the timestamp. so i can save me some space.


which ways exists to search with a complex date-filter !? 

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 7 Cores, 
1 Core with 31 Million Documents other Cores < 100.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/Schema-fieldType-y-m-d-tp3335359p3335359.html
Sent from the Solr - User mailing list archive at Nabble.com.


math with date and modulo

2011-09-14 Thread stockii
Hello.

i am fighting with the FunctionQuery of Solr. 

I try to get a diff of today and an dateField. from this diff, i want do a
modulo from another field with values of 1,3,6,12

in a function somthing like this. ( i know that some functions are not
available in solr)

q={!func}$v2=0&v1=(NOW - $var)&v2=modulo($v1,interval)

OR 

(DIFF(Month of Today - Month of Search) MOD interval) = 0

can anybody give me some tipps ? 

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/math-with-date-and-modulo-tp3335800p3335800.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: math with date and modulo

2011-09-15 Thread stockii
okay, thanks a lot.

I thought, that isnt possible to get the month in my case =(  i will try out
another way.

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/math-with-date-and-modulo-tp3335800p3338207.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Schema fieldType y-m-d ?!?!

2011-09-15 Thread stockii
thx =) 

i think i will save this as an string if ranges really works =) 

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/Schema-fieldType-y-m-d-tp3335359p3339160.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: How To perform SQL Like Join

2011-09-20 Thread stockii
http://wiki.apache.org/solr/Join

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-To-perform-SQL-Like-Join-tp3351090p3352322.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: How do i get results for quering with separated words?

2011-10-05 Thread stockii
which type in the schema.xml do you use.

try out WordDelimiterFilterFactory or some other filters from this site:

http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#solr.WordDelimiterFilterFactory

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-do-i-get-results-for-quering-with-separated-words-tp3395966p3395982.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: How do i get results for quering with separated words?

2011-10-05 Thread stockii
index this field without whitespaces ? XD

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-do-i-get-results-for-quering-with-separated-words-tp3395966p3396207.html
Sent from the Solr - User mailing list archive at Nabble.com.


Shard Search and pagination

2011-10-07 Thread stockii
Hello.

i searching over 5 cores and i have a problem with the pagination.

is it possible to return only the first 25 matches of a search over several
cores ? the solution i have now, is that ervery core returns 25 documents,
but i want only the first 25 docs of the "complete" search. 

my goal ist a merged resultset, but pagination is not really possible if get
from every core  a other count of documents. its possible to get 5 doc from
core1 and 24 docs from core2  


is it possible to get totalRows or something like that in Shard Search? 

thx


-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/Shard-Search-and-pagination-tp3402343p3402343.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: some basic information on Solr

2011-10-26 Thread stockii
i think with "incident" he mean, failures / downtimes / problems with solr !? 

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/some-basic-information-on-Solr-tp3448957p3453837.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: best way for sum of fields

2011-11-07 Thread stockii
sry. 

i need the sum of values of the found documents. e.g. the total amount of
one day. each doc in index has ist own amount.

i try out something with StatsComponent but with  48 Million docs in Index
its to slow. 

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/best-way-for-sum-of-fields-tp3477517p3486406.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: best way for sum of fields

2011-11-07 Thread stockii
yes, this way i am using on another part in my application. i hoped, that
exists another way to avoid the way over php

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/best-way-for-sum-of-fields-tp3477517p3486593.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: best way for sum of fields

2011-11-07 Thread stockii
hi thanks for the big reply ;)

i had the idea with the several and small 5M shards too. 
and i think thats the next step i have to go, because our biggest index
grows each day with avg. 50K documents.
but make it sense to keep searcher AND updater cores on one big server? i
dont want to use replication, because with our own high avalibility solution
is this not possible. 

my system is split into searcher and updater cores, each with his own index.
some search requests are over all this 8 cores with distributed search.



-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/best-way-for-sum-of-fields-tp3477517p3486652.html
Sent from the Solr - User mailing list archive at Nabble.com.


new NRT in my case quite useful?

2011-12-09 Thread stockii
I Read this Articel from Mark Miller
http://www.lucidimagination.com/blog/2011/07/11/benchmarking-the-new-solr-%E2%80%98near-realtime%E2%80%99-improvements/

Now i want to know if its useful to update on a new solr version. My version
is: 4.0.0.2010.10.26.08.43.14
I need a really good NRT search for my application, and i realized it with
several cores/indices and each of them is splitted into one core for search
request and another core for indexing.

my dih need ~15 seconds for 1500 docs to index in my "main" and biggest
index. its not so bad. but make it sense to use a newer version of solr,
with hard- and soft-commits? 
in specially i want to split my 50M index into several smaller index for a
faster search, update and optimizations. 

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/new-NRT-in-my-case-quite-useful-tp3572433p3572433.html
Sent from the Solr - User mailing list archive at Nabble.com.


Replace Patter "," with ""

2012-01-16 Thread stockii
Why does this not work?




 OR





i dont know where is my error?

i only want to replace comma with a blank ...

thx =)))

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/Replace-Patter-with-tp3662813p3662813.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Replace Patter "," with ""

2012-01-16 Thread stockii
okay, thx =) 

but i replace it now in my data-config ;)

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/Replace-Patter-with-tp3662813p3663027.html
Sent from the Solr - User mailing list archive at Nabble.com.


underscore, comma in terms.prefix

2010-06-24 Thread stockii

Hello.

this is my filterchain for suggestion with termsComponent:


  










  
  












  



so my question/problem is.

- when i index with this settings i got a underscore ("_") in my index. is
comma replace with underscore ? 
- solr import this strin: "Eiseimer COOL mit Greifer" into this -> "cool mit
mit" when i search for terms.prefix=cool
why is mit twice ? sometimes ist cool twice in my suggest 

any idea ?? ! =) thx



-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/underscore-comma-in-terms-prefix-tp919565p919565.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: underscore, comma in terms.prefix

2010-06-24 Thread stockii

okay thx. 

WordDelimiterFactory with the option generateNumberParts="0" maked trouble
;-)
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/underscore-comma-in-terms-prefix-tp919565p919655.html
Sent from the Solr - User mailing list archive at Nabble.com.


Facet as Autosuggestion

2010-06-28 Thread stockii

Hello..

I have a little question about Facetting.

When i use "facet.prefix=mau", i geht these result:
49
23

thats fine, but i miss the last word for the result "bluetooth laser". i
want "bluetooth laser maus" 
the problem is, when i use this as suggestion and the user search for
"bluetooth laser" he maybe does not find the "bluetooth laser maus" ...

why can facet not give only 2 words back ? is there a similar option like in
the TermsComponent: terms.lower.incl={true|false}  ???
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Facet-as-Autosuggestion-tp927983p927983.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: ArrayIndexOutOfBoundsException heeeeeelp !?!?!?!!?! Sorting

2010-06-30 Thread stockii

I get only this exception when i sort on my popularity field. WHY ???

...&sort=score desc, popularity desc --> BAD
...&sort=score desc --> All fine.

thats not good =(
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/ArrayIndexOutOfBoundsException-heelp-Sorting-tp932956p932968.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: ArrayIndexOutOfBoundsException heeeeeelp !?!?!?!!?! Sorting

2010-06-30 Thread stockii

aha. the type is "sint" 

do i need to use "string" ore which field did not use any tokenizer ? ^^ 
i thought sint is untokenized...
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/ArrayIndexOutOfBoundsException-heelp-Sorting-tp932956p933003.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: ArrayIndexOutOfBoundsException heeeeeelp !?!?!?!!?! Sorting

2010-06-30 Thread stockii

it makes no sense.

i can on my playground-core sort for popularity, but not on my live-core.
both cores, have the same configuration ... 

the problem occurs after use facet-search. thats maybe an reason ? 
or too many data ? 
to low server ? 

any idea 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/ArrayIndexOutOfBoundsException-heelp-Sorting-tp932956p933099.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: ArrayIndexOutOfBoundsException heeeeeelp !?!?!?!!?! Sorting

2010-07-05 Thread stockii

hey.

of course i mean "sint", from the default/example SchemaXML. 

after few days sort for popularity works well again ... ?!
i found a value of -1252810 in my popularity field... i think this was the
problem. but i dont know how can the field become this value.
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/ArrayIndexOutOfBoundsException-heelp-Sorting-tp932956p943791.html
Sent from the Solr - User mailing list archive at Nabble.com.


meaning of underscore in prefix search.

2010-07-05 Thread stockii

Hello.

i use facet.prefix and terms.prefix for my search. what is the meaning of
the underscore "_" in the results. when change solr some string into a
underscore ? sometimes it make no sence to suggest the client with this ... 







  
   

  
thx !
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/meaning-of-underscore-in-prefix-search-tp944120p944120.html
Sent from the Solr - User mailing list archive at Nabble.com.


Facet Search is too slow ! Optimize suggestions ?

2010-07-05 Thread stockii

Hello.

I use facet-search for my autosuggestion. the results are okay, but
sometimes its too slow.

We Have 4,2 Million Documents and each day we get more and more ... I try
out the Cache Settings with this parameter:

 

For every Cache. How can i optimize the facet search ? 
The Server is an 8 Dual Core with .. i think 12 GB RAM ... so i thought
thats enough for Solr Facet search. 

When a new Search search for something like: "rotw" and nothing is cached
solr need sometimes much time for a response ... =( =(  all over two seconds
is not good fur autosuggestion ...

thxxx
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Facet-Search-is-too-slow-Optimize-suggestions-tp944361p944361.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Facet Search is too slow ! Optimize suggestions ?

2010-07-05 Thread stockii

okay.

How many unique terms? 
- Docs:  3911249 and Distinct: 2302852

app ? 
- iPhone App for product search.

faceting on ?
- im faceting on the product names, with Shingles (maxShingle: 5 ?? too big
?)

how you faceting? 
- search over all
.../?q=*:*&facet.prefix=string&rows=0
search with shops filter: 
.../?q=*:*&facet.prefix=string&rows=0&shop_id:54

i dont kow how its the best way to configure it.  
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Facet-Search-is-too-slow-Optimize-suggestions-tp944361p944386.html
Sent from the Solr - User mailing list archive at Nabble.com.


Solr Doc Lucene Doc !?

2010-07-26 Thread stockii

Hello. 

I write a little text about SOLR and LUCENE by using the DIH. 

what documents are creating and inserting DIH ? in wiki is the talk about
"solr documents" but i thought that, solr uses lucene to do this and so that
DIH creates Lucnee Documents, not Solr Documents !? 

what are doing the DIH exactly ? 

how can i easy find out that !? 

or how is intern manage the documents in solr ? is there a different about
solr and lucene doc`s ? 


can anyone give me a little overview how DIH works ? that would be great ;-) 

thx stockiii
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-Doc-Lucene-Doc-tp995922p995922.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Solr Doc Lucene Doc !?

2010-07-26 Thread stockii

... but in the code is the talk about of, SolrDocuments. these are higher
level docs, used to construct the lucene doc to index ... !!?!?!?!? 

and in wiki is the talk about "Build Solr documents by aggregating data from
multiple columns and tables according to configuration"
http://wiki.apache.org/solr/DataImportHandler?highlight=(dih)

so its a little bit confused.
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-Doc-Lucene-Doc-tp995922p996005.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Solr Doc Lucene Doc !?

2010-07-26 Thread stockii

i want to learn more about the technology.

exists an issue to create really an solrDoc ? Or its in the code only for a
better understanding of the lucene and solr border ? 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-Doc-Lucene-Doc-tp995922p99.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Solr Doc Lucene Doc !?

2010-07-26 Thread stockii

ah okay thx =)

the class "SolrInputDocuments" is only for indexing an document and
"SolrDocuement" for the search ?

when Solr index an document first step is to create an SolrInputDocument.
then in class "DocumentBuilder" creates solr in function "Document
toDocument (SolrInputDoc, Schema)"
an Lucene Document ?! 

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-Doc-Lucene-Doc-tp995922p997196.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Strange search

2010-07-28 Thread stockii

try to delete "solr.SnowballPorterFilterFactory" from your analyzerchain. i
had similar problems by using german  SnowballPorterFilterFactory
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Strange-search-tp998961p1001990.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Solr Doc Lucene Doc !?

2010-08-06 Thread stockii


There is a real and actual class named "SolrDocument".  it is a simpler 
object then Lucene's "Document" class becuase in Solr the details about 
the field types (stored, indexed, etc...) are handled by the schema, and 
are not distinct per Field instance. 
Chris Hostetter-3 wrote:
> 
> 

okay thx, that make sense, but why is in class AddUpadeteCommand.java this:

   // Higher level SolrInputDocument, normally used to construct the Lucene
Document
   // to index.
   public SolrInputDocument solrDoc;

 thx =)
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-Doc-Lucene-Doc-tp995922p1030346.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Solr Doc Lucene Doc !?

2010-08-11 Thread stockii

i have a question about the solr index mechanism with DIH ...

i try to understand how solr index an doc, and on wich code-elements, solr
using lucene.

thats my stand:
DIH is using the SolrWriter to add an doc.
To create an SolrInoputDocument SolrWriter uses the addUpdateCommand, 
This Command and Doc is put in the UpdateRequestProcessorChain. In this
Chain solr creates an LuceneDoc with DocumentBuilder and put it back into
the chain !?!? is this right ? 

Then the UpdateHandler getting the UpdateChain and managed the index changes
!?

So. i dont understand, how works the updatehandler. can anyone give me some
tipps ? 

SolrIndexWriter is using from UpdateHandler and SolrindexWriter use
IndexWriter from Lucene ? 

thx for your help =)=)
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-Doc-Lucene-Doc-tp995922p1088334.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Solr Doc Lucene Doc !?

2010-08-11 Thread stockii

oh, i see that i mixed DIH classes with other Solr classes ^^
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-Doc-Lucene-Doc-tp995922p1088738.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Solr Doc Lucene Doc !?

2010-08-12 Thread stockii

no help ? =( 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-Doc-Lucene-Doc-tp995922p1114172.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Solr Doc Lucene Doc !?

2010-08-12 Thread stockii

i write a little thesis about this. and i need to know how solr is using
lucene -in which way. in example of using dih and searching. so for my
better understanding ..  ;-)


-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-Doc-Lucene-Doc-tp995922p1118089.html
Sent from the Solr - User mailing list archive at Nabble.com.


SolrIndex / LuceneIndex

2010-08-19 Thread stockii

Hello. 

in
http://lucene.apache.org/solr/api/index.html?org/apache/solr/common/SolrDocument.html
  

Is the talk about "SolrIndex" -->  "A concrete representation of a document
within a Solr index" 

is solr create an special SolrIndex or is here mean an LuceneIndex ? 

thx ;)
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/SolrIndex-LuceneIndex-tp1226714p1226714.html
Sent from the Solr - User mailing list archive at Nabble.com.


How to Debug Sol-Code in Eclipse ?!

2010-08-21 Thread stockii

Hello..

Can anyone give me some tipps to debug the solr-code in Eclipse ? or do i
need apache-Ant to do this ? 

thhx =) 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1262050.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: How to Debug Sol-Code in Eclipse ?!

2010-08-22 Thread stockii

thx for you reply.

i dont want to test my own classes in unittest. i try to understand how solr
works , because i write a little text about solr and lucene. so i want go
through the code, step by step and find out on which places is solr using
lucene. 

when i can debug the code its easyer ;-)
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1274285.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: How to Debug Sol-Code in Eclipse ?!

2010-08-22 Thread stockii

1. did you mean solr war ? or all libs in /trunk/solr/lib/
2. what is the revision of the actual 1.4.1 ?
3. EmbededSolrServer ? what should do this little programm ? 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1275295.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: How to Debug Sol-Code in Eclipse ?!

2010-08-22 Thread stockii

oha, thx i will try it =) 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1278704.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: How to Debug Sol-Code in Eclipse ?!

2010-08-22 Thread stockii

wich revision is the revision of 1.4.1 ? 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1280956.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: How to Debug Sol-Code in Eclipse ?!

2010-08-22 Thread stockii

im stupid. XD 

how get i the revsion of the solr 1.4.1 or do i nee build an war from my
snv-checkout ? 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1281253.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: How to Debug Sol-Code in Eclipse ?!

2010-08-22 Thread stockii

okay, thx. but it want work =(

i checkout solr1.4.1 as dynamic web project into eclipse. startet jetty with
XDebug. In eclpise i add WebLogic exactly how the tutorial shows but eclipse
cannot connect =(

any idea what im doing wrong ? 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1282560.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: How to Debug Sol-Code in Eclipse ?!

2010-08-23 Thread stockii

can nobody help me or want :D
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1288705.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: How to Debug Sol-Code in Eclipse ?!

2010-08-23 Thread stockii

"ant package"  

BUILD FAILED run program "perl" ...

it`s necessary to install perl on my computer ?!

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1291992.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: How to Debug Sol-Code in Eclipse ?!

2010-08-23 Thread stockii

thx, for your help. now it works fine. its very simple when you kno how :D
haha

i try bernds suggest =) 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-Debug-Sol-Code-in-Eclipse-tp1262050p1296175.html
Sent from the Solr - User mailing list archive at Nabble.com.


minMergeDocs supported ?

2010-08-23 Thread stockii

Heya:

IS minMergeDocs SUPPORTED IN soLR ?
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/minMergeDocs-supported-tp1302856p1302856.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: minMergeDocs supported ?

2010-08-24 Thread stockii

in lucene is this option for the index configuration available. In Solr too ?
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/minMergeDocs-supported-tp1302856p1307821.html
Sent from the Solr - User mailing list archive at Nabble.com.


Purpose of SolrDocument.java

2010-09-02 Thread stockii

I worling through the SolrCode and i want to know how the class SolrDocument
used in Solr !?

When i start and debug a normal search, SolrDocument never been used.
(Standard SearchHandler with q-Query). i thought, this class is a
representation of a Doc from the Index as a higher level doc above the
lucene doc. 

so i thougt that solr convert a lucene doc to a SolrDoc and work with this.
but solr doing an prefetch with DocSllice/DocSet/DocList ... an get the real
lucene doc in the XML-Writer for the response.

So for what is SolrDocument 

th
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Purpose-of-SolrDocument-java-tp1408443p1408443.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Purpose of SolrDocument.java

2010-09-03 Thread stockii

aaah okay.

so its SolrDocument in "normal" search never been used ? its only for other
solr-plugins ? 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Purpose-of-SolrDocument-java-tp1408443p1411276.html
Sent from the Solr - User mailing list archive at Nabble.com.


which way for "export"

2013-01-11 Thread stockii
hello.

Which is the best/fastest way to get the value of many fields from index?

My problem is, that i need to calculate a sum of amounts. this amount is in
my index (stored="true"). my php script get all values with paging. but if a
request takes too long, jetty is killing this process of "export".

is it better to get all the fields with "wt=csv/json/xml" or something other
handler?



--
View this message in context: 
http://lucene.472066.n3.nabble.com/which-way-for-export-tp4032487.html
Sent from the Solr - User mailing list archive at Nabble.com.


Calculate a sum.

2013-01-14 Thread stockii
hello.

My problem is, that i need to calculate a sum of amounts. this amount is in
my index (stored="true"). my php script get all values with paging. but if a
request takes too long, jetty is killing this process and i get a "broken
pipe".

Which is the best/fastest way to get the values of many fields from index?
exists an ResponseHandler for exports? Or which is the fastest?



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Calculate-a-sum-tp4033091.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Calculate a sum.

2013-01-14 Thread stockii
Hey, thx for your reply. 

i forgot to say. StatsComponent doesnt work with our application.
too slow and buggy. but i test with this component with version 1.4 ...
maybe some bugfixes in 4.0 ?

this is the reason for calculating the sum on client side and some pages.
but sometimes its too much for server.




--
View this message in context: 
http://lucene.472066.n3.nabble.com/Calculate-a-sum-tp4033091p4033097.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Calculate a sum.

2013-01-14 Thread stockii
Mikhail Khludnev wrote
> You can spend some heap for uninverting the index and 
> utilize wiki.apache.org/solr/StatsComponent

what do you mean with this?


Edward Garrett wrote
> how many documents are you working with? 

~90 million documents ...



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Calculate-a-sum-tp4033091p4033152.html
Sent from the Solr - User mailing list archive at Nabble.com.


compare two shards.

2013-02-12 Thread stockii
hello.

i want to compare two shards each other, because these shards should have
the same index. but this isnt so =(
so i want to find these documents, there are missing in one shard of my both
shards.

my ideas
- distrubuted shard request on my nodes and fire a facet search on my
unique-field. but the result of facet component isnt reversable =( 

- grouping. but its not working correctly i think so. no groups of the same
uniquekey in the resultset.


does anyone some better ideas?



--
View this message in context: 
http://lucene.472066.n3.nabble.com/compare-two-shards-tp4039887.html
Sent from the Solr - User mailing list archive at Nabble.com.


Best requestHandler for "typing error".

2012-02-16 Thread stockii
Hello.

Which RH do you use to find typing errors like "goolge" => do you mean
"google" ?!

I want to use my Autosuggestion "EdgeNGram" with a clever AutoCorrection!



What do you use ?

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/Best-requestHandler-for-typing-error-tp3749576p3749576.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Using two repeater to rapidly switching Master and Slave (Replication)?

2012-03-14 Thread stockii
Did your configuration works ?

i have the same issue and i dont know if it works...

i have 2 servers. each with 2 solr instances (one for updates other for
searching) now i need replication from solr1 to solr2. but what the hell do
solr if master crashed ???



-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/Using-two-repeater-to-rapidly-switching-Master-and-Slave-Replication-tp3089653p3826234.html
Sent from the Solr - User mailing list archive at Nabble.com.


Master/Slave switch on teh fly. Replication

2012-03-15 Thread stockii
Hello.

Is it possible to switch master/slave on the fly without restarting the
server?

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/Master-Slave-switch-on-teh-fly-Replication-tp3828313p3828313.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Master/Slave switch on teh fly. Replication

2012-03-16 Thread stockii
i have 8 cores ;-)

i thought that replication is defined in solrconfig.xml and this file is
only load on startup and i cannot change master to slave and slave to master
without restarting the servlet-container ?!?!?!

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/Master-Slave-switch-on-the-fly-Replication-tp3828313p3831948.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: querying on shards

2012-03-23 Thread stockii
@Shawn Heisey-4

how look your requestHandler of your broker? i think about your idea to do
the same ;)

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/querying-on-shards-tp3841446p3852001.html
Sent from the Solr - User mailing list archive at Nabble.com.


Replication failed without an error =(

2012-04-24 Thread stockii
hello..

anyone a idea how i can figure out why my replication failed ? i got no
errors  =(

my configuratio is.

2 server! both are master and slave at the same time. only one server makes
updates and is so the master. on slave is started via cron a replication. is
one server crashed, i can easy switch master to slave, this is because both
are master AND slave at the same time.

this works well but now no replicate is working since i deleted the
pollInterval !?!? is this a reason?

thx

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/Replication-failed-without-an-error-tp3934655p3934655.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Replication failed without an error =(

2012-04-24 Thread stockii
bevore this problem i got this problem
https://issues.apache.org/jira/browse/SOLR-1781

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/Replication-failed-without-an-error-tp3934655p3934813.html
Sent from the Solr - User mailing list archive at Nabble.com.


DIH NoClassFoundError.

2012-04-25 Thread stockii
is it not fucking possible to import DIH !?!?!? WTF!

i load the new solr 3.6. from website. but when i started solr i got
evertime " no DIH found"

if i put in my solrconfig 

AND have this structure
http://lucene.472066.n3.nabble.com/file/n3938253/Bildschirmfoto.png 

i got this message: SEVERE: java.lang.NoClassDefFoundError:
org/apache/solr/util/plugin/SolrCoreAware



-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/DIH-NoClassFoundError-tp3938253p3938253.html
Sent from the Solr - User mailing list archive at Nabble.com.


Replication. confFiles and permissions.

2012-05-09 Thread stockii
Hello.


i running a solr replication. works well, but i need to replicate my
dataimport-properties. 

if server1 replicate this file after he create everytime a new file, with
*.timestamp, because the first replication run create this file with wrong
permissions ...

how can is say to solr replication "chmod 755  dataimport-properties ..."  ?
;-)

thx

-
--- System 

One Server, 12 GB RAM, 2 Solr Instances, 8 Cores, 
1 Core with 45 Million Documents other Cores < 200.000

- Solr1 for Search-Requests - commit every Minute  - 5GB Xmx
- Solr2 for Update-Request  - delta every Minute - 4GB Xmx
--
View this message in context: 
http://lucene.472066.n3.nabble.com/Replication-confFiles-and-permissions-tp3973825.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Replication. confFiles and permissions.

2012-05-09 Thread stockii
my setup includes a asynchron replication.

this means, both are master AND slave at the same time. so i can easy switch
master and slave on the fly without resarting any server with mass of
scripts ... i trigger a replication via cronjob and look everytime, if
server is master or slave. only slave is allowed to fetch index from master. 
but when i need to switch, i need the dataimport.properties to get correct
deltas ... 



-
--- System 
2 server,  each 12 GB RAM, 2 Solr instances with 12 cores, asynchronous 
recplication.

--
View this message in context: 
http://lucene.472066.n3.nabble.com/Replication-confFiles-and-permissions-tp3973825p3974427.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Replication. confFiles and permissions.

2012-05-09 Thread stockii
my setup includes a asynchron replication.

this means, both are master AND slave at the same time. so i can easy switch
master and slave on the fly without resarting any server with mass of
scripts ... i trigger a replication via cronjob and look everytime, if
server is master or slave. only slave is allowed to fetch index from master. 
but when i need to switch, i need the dataimport.properties to get correct
deltas ... 



-
--- System 
2 server,  each 12 GB RAM, 2 Solr instances with 12 cores, asynchronous 
recplication.

--
View this message in context: 
http://lucene.472066.n3.nabble.com/Replication-confFiles-and-permissions-tp3973825p3974440.html
Sent from the Solr - User mailing list archive at Nabble.com.


commit=true has no effect

2010-11-23 Thread stockii

Hello.

some of my cores absolutely dont want to commit the delta-import changes.
the query are all okay but i have no idea what ist wrong

Solr version: Solr Specification Version: 4.0.0.2010.10.26.08.43.14

dih found the deltas, and changed it but no commit is performed !? the
config files are the same like from another core, where delta works fine.
only the sql statement changed.

thx for your help
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/commit-true-has-no-effect-tp1952567p1952567.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: commit=true has no effect

2010-11-23 Thread stockii

=(  anyone a  idea ? 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/commit-true-has-no-effect-tp1952567p1953391.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: commit=true has no effect

2010-11-24 Thread stockii

Here is my query:

http://lucene.472066.n3.nabble.com/commit-true-has-no-effect-tp1952567p1959429.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: commit=true has no effect

2010-11-24 Thread stockii

DIH Response XML:

2
1
0
2010-11-24 09:56:11
2010-11-24 09:56:11
2010-11-24 09:56:11
2010-11-24 09:56:11
1
0
0:0:0.234

here i am missing the lines:

Indexing completed. Added/Updated: 1 documents. Deleted 0
documents.
2010-11-24 09:57:08
2010-11-24 09:57:08

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/commit-true-has-no-effect-tp1952567p1959524.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: commit=true has no effect

2010-11-24 Thread stockii

its so strange ...

- i copy the solrconfig.xml from this core, that works and no changes
- i delete all fields in my query and change it to a simple query with two
fields. no commit ...


-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/commit-true-has-no-effect-tp1952567p1959587.html
Sent from the Solr - User mailing list archive at Nabble.com.


DIH delta, deltaQuery

2010-11-24 Thread stockii

Hello.

i wonder why this deltaQuery takes over a minute: 

deltaQuery="SELECT id FROM sessions 
WHERE created BETWEEN DATE_ADD( NOW(), INTERVAL - 1 HOUR ) AND 
NOW() 
OR modified BETWEEN '${dataimporter.sessions .last_index_time}' 
AND
DATE_ADD( NOW(), INTERVAL - 1 HOUR  ) "

the database have only 700 Entries and the compare with modified takes so
long !!? when i remove the modified compare its fast.

when i put this query in my mysql database the query need 0.0014 seconds 
... wha is it so slow? 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/DIH-delta-deltaQuery-tp1960246p1960246.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: DIH : Delta import don't process the updated documents

2010-11-26 Thread stockii

hey.

i know this problem. 

DIH dont commit your documents. if there not comited, no changes in the
index.

in my case, i had a broken delta-query. some stupid mistakes like. 

id = '{$dataimporter.delta.id}' or deltaimporter.delta.id

check your delta ID and dih should commit you changes. DIH says that he
changed something, becaus your deltaQuery is correct. but not the
deltaImportQuery. maybe thats helps. 

   
  are here missing the ' ' ???
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/DIH-Delta-import-don-t-process-the-updated-documents-tp1966881p1972018.html
Sent from the Solr - User mailing list archive at Nabble.com.


Large Hdd-Space using during commit/optimize

2010-11-29 Thread stockii

Hello.

i have ~37 Million Docs that i want to index. 

when i starte a full-import i importing only every 2 Million Docs, because
of better controll over solr and space/heap 

so when i import 2 million docs and solr start the commit and the optimize
my used disc-space jumps into the sky. reacten: solr restart and space the
used space goes down.

why is using solr so many space ?  

can i optimize that  ? 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Large-Hdd-Space-using-during-commit-optimize-tp1985807p1985807.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Large Hdd-Space using during commit/optimize

2010-11-29 Thread stockii

aha okay. thx

i dont know that solr copys the complete index for optimize. can i solr say,
that he start an optimize, but wihtout copy ? 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Large-Hdd-Space-using-during-commit-optimize-tp1985807p1987477.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Large Hdd-Space using during commit/optimize

2010-11-30 Thread stockii

aha aha :D

hm i dont know. we import in 2MillionSteps because we think that solr locks
our database and we want a better controll of the import ... 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Large-Hdd-Space-using-during-commit-optimize-tp1985807p1991392.html
Sent from the Solr - User mailing list archive at Nabble.com.


Best practice for Delta every 2 Minutes.

2010-11-30 Thread stockii

Hello.

index is about 28 Million documents large. When i starts an delta-import is
look at modified. but delta import takes to long. over an hour need solr for
delta.

thats my query. all sessions from the last hour should updated and all
changed. i think its normal that solr need long time for the querys. how can
i optimize this ? 

deltaQuery="SELECT id FROM sessions 
WHERE created BETWEEN DATE_ADD( NOW(), INTERVAL - 10 HOUR ) AND NOW() 
OR modified BETWEEN '${dataimporter.last_index_time}' AND DATE_ADD( NOW(),
INTERVAL - 1 HOUR  ) "  
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Best-practice-for-Delta-every-2-Minutes-tp1992714p1992714.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Best practice for Delta every 2 Minutes.

2010-11-30 Thread stockii

everyday ~30.000 Documents and every hour ~1200

multiple thread with DIH ? how it works ? 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Best-practice-for-Delta-every-2-Minutes-tp1992714p1992767.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Best practice for Delta every 2 Minutes.

2010-11-30 Thread stockii

how do you think is the deltaQuery better ? XD
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Best-practice-for-Delta-every-2-Minutes-tp1992714p1992774.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Best practice for Delta every 2 Minutes.

2010-11-30 Thread stockii

i copied the wrong query, because 10 hours ;)

i didnt test the query with 28 million records . but wiht a few million and
it works fine. ...

before i used DIH, i used php and import direclty documents into solr. but i
want use dih because the better performance, i think so ... grml ...


-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Best-practice-for-Delta-every-2-Minutes-tp1992714p1992908.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Large Hdd-Space using during commit/optimize

2010-11-30 Thread stockii

okay. 

the query kills the database, because no index of modified is set ... 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Large-Hdd-Space-using-during-commit-optimize-tp1985807p1993750.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Best practice for Delta every 2 Minutes.

2010-12-01 Thread stockii

http://10.1.0.10:8983/solr/payment/dataimport?commad=delta-import&debug=on
dont work. no debug is started =(

thanks. i will try mergefactor=2
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Best-practice-for-Delta-every-2-Minutes-tp1992714p1997595.html
Sent from the Solr - User mailing list archive at Nabble.com.


send XML multiValued Field Solr-PHP-Client

2010-12-01 Thread stockii

Hello.

do anyone using Solr-PHP-Client ? 

how are you using mutltivalued fields with the method addFields() ?

solr says to me SCHWERWIEGEND: java.lang.NumberFormatException: empty String

when i send a raw xml like this:

24038608
778
reason1
reason1


in schema i defined: 



why dont work this ? =(
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/send-XML-multiValued-Field-Solr-PHP-Client-tp1998370p1998370.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Best practice for Delta every 2 Minutes.

2010-12-02 Thread stockii

at the time no OOM occurs. but we are not in correct live system ... 

i thougt maybe i get this problem ... 

we are running seven cores and each want be update very fast. only one core
have a huge index with 28M docs. maybe it makes sense for the future to use
solr with replication !? or can i runs two instances, one for search and one
for updating ? or is there the danger of corrupt indizes ? 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Best-practice-for-Delta-every-2-Minutes-tp1992714p2005108.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Tuning Solr caches with high commit rates (NRT)

2010-12-02 Thread stockii

great thread and exactly my problems :D

i set up two solr-instances, one for update the index and another for
searching. 

When i perform an update. the search-instance dont get the new documents.
when i start a commit on searcher he found it. how can i say the searcher
that he alwas look not only the "old" index. automatic refresh ? XD
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Tuning-Solr-caches-with-high-commit-rates-NRT-tp1461275p2005738.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Dataimport: Could not load driver: com.mysql.jdbc.Driver

2010-12-06 Thread stockii

maybe encoding !? 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Dataimport-Could-not-load-driver-com-mysql-jdbc-Driver-tp2021616p2027138.html
Sent from the Solr - User mailing list archive at Nabble.com.


backup of Index or Snapshoot ?

2010-12-21 Thread stockii

Hello.

Iam working with the shell-scripts for solr for performing a snapshot of the
index.

to do a snapshot is really easy and works fine. but how can i install a
snaposhot for multi-cores.

i wrote a little script wich install each snapshot for each core:
cd $HOME_DIR/solr/bin
./snapinstaller -M http://localhost:$PORT/solr/core -S $DATA_DIR/payment -d
$DATA_DIR/core

so. but when i start this command comes ssh cannot connect to localhost. why
is it not possible to set the port in this sript !?!?  --> eg: -p 8983 

it works, but why ? i want no errors by using this script ... 

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/backup-of-Index-or-Snapshoot-tp2126417p2126417.html
Sent from the Solr - User mailing list archive at Nabble.com.


hole RAM using by solr during Optimize

2010-12-22 Thread stockii

Hello.

I have a RAM problem during a optimize.

When is start an delta or full import, solr using only this ram which i
allocate to him.
eg.: java -jar -Xmx2g start.jar

when solr is fetching the rows from database the using of ram ist okay. But
when solr begin to otimize,  solr want all of the available ram 
?!?!?!?!?!? 

why is it so. the used Ram jumpes into the sky and only 40 MB Ram is free,
of 8 GB !!! how can i limit this ? 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/hole-RAM-using-by-solr-during-Optimize-tp2130482p2130482.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: hole RAM using by solr during Optimize

2010-12-22 Thread stockii

maybe i set my chache in solrconfig.xml to high ? why now i see das the cache
very high in server.
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/hole-RAM-using-by-solr-during-Optimize-tp2130482p2130490.html
Sent from the Solr - User mailing list archive at Nabble.com.


Tuning StatsComponent

2011-01-10 Thread stockii

Hello.

i`m using the StatsComponent to get the sum of amounts. but solr
statscomponent is very slow on a huge index of 30 Million documents. how can
i tune the statscomponent ? 

the problem is, that i have 5 currencys and i need to send for each currency
a new request. thats make the solr search sometimes very slow. =( 

any ideas ? 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Tuning-StatsComponent-tp2225809p2225809.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Tuning StatsComponent

2011-01-10 Thread stockii

oh thx for your fast reply. 

i will try the suggestions.

in meanwhile more information about my index.

i have 2 solr instances with 6 cores. each core have his own index and one
core`s index is about 30 million documents.

each document have:(stats-relevant)
amount
amount_euro
currency_id

user_costs
user_costs_euro
currency_id_user_costs

so i send for each currency an requeston statscompontn like this

stats=true&json.nl=map&wt=javabin&rows=0&version=2&fl=uniquekey,score&start=0&stats.field=amount&q=QUERY&isShard=true&fq=product:bla+currency_id:EUR&fsv=true

the stats.field is changing and filter for each of my 5 currencys. so for
ONE search-request, i need to send 10 requests to get the sums. and that
veeery slow =(

i searching over two shards. sometimes more than two.

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Tuning-StatsComponent-tp2225809p2226258.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Tuning StatsComponent

2011-01-10 Thread stockii

when i start statsComponent i get this message:
INFO: UnInverted multi-valued field
{field=product,memSize=4336,tindexSize=46,time=0,phase1=0,nTerms=1,bigTerms=1,termInstances=0,uses=0}

what means this ? 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Tuning-StatsComponent-tp2225809p2226555.html
Sent from the Solr - User mailing list archive at Nabble.com.


!= unequal in fq !?

2011-01-11 Thread stockii

hello.

i need to filter a field. i want all fields are not like the given string.

eg.: ...&fq=status!=refundend

how can i realize this in solr !? i dont want to use
...string+OR+string+OR+...
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/unequal-in-fq-tp2233235p2233235.html
Sent from the Solr - User mailing list archive at Nabble.com.


  1   2   3   >