Re: SolrJ Indexing

2016-03-28 Thread Mugeesh Husain
Hi, You should use/implement producer consumer program in java using multithreading. USE executor framework in java Like this link http://www.journaldev.com/1069/java-thread-pool-example-using-executors-and-threadpoolexecutor Thanks Mugeesh -- View this message in context: http://lucene.

Re: SolrJ Indexing

2016-03-25 Thread Shawn Heisey
On 3/25/2016 2:04 AM, fabigol wrote: > what i want to do and to create the differents links between the entities > which i'm going to index. Therefore, i have a root entity and girls entities > like showing xml File. > > But, my main problem is the number of documents. In facr, when i want to > ind

Re: SolrJ Indexing

2016-03-25 Thread fabigol
Hi, what i want to do and to create the differents links between the entities which i'm going to index. Therefore, i have a root entity and girls entities like showing xml File. But, my main problem is the number of documents. In facr, when i want to index 3 months of data i have no problem(5 mill

Re: SolrJ Indexing

2016-03-24 Thread Shawn Heisey
On 3/24/2016 4:06 AM, fabigol wrote: > I know doint that for DIH but with solrJ i don't know. Must i use the > annotations as @Field...? > > Moreover, i create a new project solr with the same XML Files - copy conf > directory - and oddly the Indexing is much faster and not a little 100 time > more

Re: SolrJ Indexing

2016-03-24 Thread fabigol
Hi Shawn thank for your response. Like i can see in my XML file i have many enties which are linked between it. I know doint that for DIH but with solrJ i don't know. Must i use the annotations as @Field...? Moreover, i create a new project solr with the same XML Files - copy conf directory - and

Re: SolrJ Indexing

2016-03-23 Thread Shawn Heisey
On 3/23/2016 2:36 AM, fabigol wrote: > i want to do indexing with api SolrJ. So, i believe the indexing will be > multhreaded. > But i have 5 root entites. The config you included is from the dataimport handler. This is *NOT* indexing with SolrJ. You can SolrJ to *start* the indexing, and with e

Re: [SolrJ] Indexing Java Map into Solr

2015-10-09 Thread Erick Erickson
Hmmm, what does the code look like for Java? One of the cardinal sins of indexing with SolrJ is sending docs one at a time rather than as batches of at least 100 (I usually use 1,000). See: https://lucidworks.com/blog/2015/10/05/really-batch-updates-solr-2/ One technique I often use to chase this

Re: solrj indexing using embedded solr is slow

2013-06-28 Thread Erick Erickson
First, how much slower? 2x? 10x? 1.1x? When using embedded, you're doing all the work you were doing on two machines on a single machine, so my first question would be how is your CPU performaing? Is it maxed? Best Erick On Thu, Jun 27, 2013 at 1:59 PM, Learner wrote: > Shawn, > > Thanks a lo

Re: solrj indexing using embedded solr is slow

2013-06-27 Thread Learner
Shawn, Thanks a lot for your reply. I have pasted my entire code below, it would be great if you can let me know if I am doing anything wrong in terms of running the code in multithreaded environment. http://pastebin.com/WRLn3yWn -- View this message in context: http://lucene.472066.n3.nabbl

Re: solrj indexing using embedded solr is slow

2013-06-27 Thread Shawn Heisey
On 6/27/2013 9:19 AM, Learner wrote: I was using ConcurrentUpdateSOLR for indexing documents to Solr. Later I had a need to do portable indexing hence started using Embedded solr server. I created a multithreaded program to create /submit the documents in batch of 100 to Embedded SOLR server (ru

Re: SolrJ indexing pdf documents

2012-06-16 Thread Sami Siren
On Sat, Jun 16, 2012 at 5:59 PM, 12rad wrote: > Hi, > > I'm new to SolrJ. Hi and welcome! > Here I are the steps I followed to write an application to index pdf > documents to fresh solr3.6 > > 1 -In Schema.xml: > I added the fields I wanted indexed and changed stored = true. > > 2 - Started Sol