Re: Indexing a token to a different field in a custom filter

2013-11-12 Thread Dileepa Jayakody
Thanks all for your valuable inputs. I looked at suggested solutions and I too feel, a* custom update processor*during indexing will be the best solution to handle the content field by changing the value and storing it in another value. Do I only need to change the below request handler to interc

Re: Indexing a token to a different field in a custom filter

2013-11-12 Thread Jack Krupansky
Any kind of cross-field processing is best done in an update processor. There are a lot of built-in update processors as well as a JavaScript script update processor. -- Jack Krupansky -Original Message- From: Dileepa Jayakody Sent: Tuesday, November 12, 2013 1:31 AM To: solr-user@lu

Re: Indexing a token to a different field in a custom filter

2013-11-12 Thread Erick Erickson
Whether what Alvaro outlined works for you or not, do NOT commit after every document if you use SolrJ. The commit will hurt performance much more than the HTTP overhead. And you can always batch up, say, 1,000 documents and use the server.add(doclist) method. Overall, worrying about HTTP overhea

Re: Indexing a token to a different field in a custom filter

2013-11-12 Thread Alvaro Cabrerizo
Hi, Maybe the synonym filteris the mirror you can look in. You can start creating a new field type in your schema that is stanbol enhanced. Let's follow with the parallelism, in the case of synonym we could have

Re: Indexing a token to a different field in a custom filter

2013-11-12 Thread Dileepa Jayakody
I need to index the processed token to a different feild (eg: stanbolResponse), in the same document that's being indexed. I am looking for a way to retrieve the document.id from the TokenStream so that I can update the same document with new field values. (In my sample code above I'm adding a new