Re: extract and add fields on the fly

2015-01-28 Thread Mark
Thanks Alexandre, I figured it out with this example, https://wiki.apache.org/solr/ExtractingRequestHandler whereby you can add additional fields at upload/extract time curl " http://localhost:8983/solr/update/extract?literal.id=doc4&captureAttr=true&defaultField=text&capture=div&fmap.div=foo_t

Re: extract and add fields on the fly

2015-01-28 Thread Alexandre Rafalovitch
Well, the schema does need to know what type your field is. If you can't add it to schema, use dynamicFields with prefixe/suffixes or dynamic schema (less recommended). Regards, Alex. Sign up for my Solr resources newsletter at http://www.solr-start.com/ On 28 January 2015 at 13:32, Mark

Re: extract and add fields on the fly

2015-01-28 Thread Mark
That approach works although as suspected the schma has to recognise the additinal facet (stuff in this case): "responseHeader":{"status":400,"QTime":1},"error":{"msg":"ERROR: [doc=6252671B765A1748992DF1A6403BDF81A4A15E00] unknown field 'stuff'","code":400}} ..getting closer.. On 28 Janu

Re: extract and add fields on the fly

2015-01-28 Thread Mark
Use case is use curl to upload/extract/index document passing in additional facets not present in the document e.g. literal.source="old system" In this way some fields come from the uploaded extracted content and some fields as specified in the curl URL Hope that's clearer? Regards Mark On 2

Re: extract and add fields on the fly

2015-01-28 Thread Alexandre Rafalovitch
Sounds like 'literal.X' syntax from https://cwiki.apache.org/confluence/display/solr/Uploading+Data+with+Solr+Cell+using+Apache+Tika Can you explain your use case as different from what's already documented? May be easier to understand. Regards, Alex. Sign up for my Solr resources newslet

Re: extract and add fields on the fly

2015-01-28 Thread Mark
I'm looking to 1) upload a binary document using curl 2) add some additional facets Specifically my question is can this be achieved in 1 curl operation or does it need 2? On 28 January 2015 at 17:43, Mark wrote: > > Second thoughts SID is purely i/p as its name suggests :) > > I think a bette

Re: extract and add fields on the fly

2015-01-28 Thread Mark
Second thoughts SID is purely i/p as its name suggests :) I think a better approach would be 1) curl to upload/extract passing docID 2) curl to update additional fields for that docID On 28 January 2015 at 17:30, Mark wrote: > > "Create the SID from the existing doc" implies that a document

Re: extract and add fields on the fly

2015-01-28 Thread Andrew Pawloski
Sorry, I may have misunderstood: Are you talking about adding additional fields at indexing time? (Here I would add the fields first *then* send to solr.) Are you talking about updating a field withing an existing document in a solr index? (In that case I would direct you here [1].) Am I still m

Re: extract and add fields on the fly

2015-01-28 Thread Mark
"Create the SID from the existing doc" implies that a document already exists that you wish to add fields to. However if the document is a binary are you suggesting 1) curl to upload/extract passing docID 2) obtain a SID based off docID 3) add addtinal fields to SID & commit I know I'm possibly

Re: extract and add fields on the fly

2015-01-28 Thread Andrew Pawloski
I would switch the order of those. Add the new fields and *then* index to solr. We do something similar when we create SolrInputDocuments that are pushed to solr. Create the SID from the existing doc, add any additional fields, then add to solr. On Wed, Jan 28, 2015 at 11:56 AM, Mark wrote: > I