Re: Please help - Solr Cell using 'stream.url'

2011-10-12 Thread Jan Høydahl
Latest version is 3.4, and it is fairly compatible with 1.4.1, but you have to reindex. First step migration can be to continue using your 1.4 schema on new solr.war (and SolrJ), but I suggest you take a few hours upgrading your schema and config as well. -- Jan Høydahl, search solution archite

Re: Please help - Solr Cell using 'stream.url'

2011-10-12 Thread Tod
On 10/10/2011 3:39 PM, � wrote: Hi, If you have 4Gb on your server total, try giving about 1Gb to Solr, leaving 3Gb for OS, OS caching and mem-allocation outside the JVM. Also, add 'ulimit -v unlimited' and 'ulimit -s 10240' to /etc/profile to increase virtual memory and stack limit. I will

Re: Please help - Solr Cell using 'stream.url'

2011-10-10 Thread Jan Høydahl
Hi, If you have 4Gb on your server total, try giving about 1Gb to Solr, leaving 3Gb for OS, OS caching and mem-allocation outside the JVM. Also, add 'ulimit -v unlimited' and 'ulimit -s 10240' to /etc/profile to increase virtual memory and stack limit. And you should also consider upgrading to

Re: Please help - Solr Cell using 'stream.url'

2011-10-10 Thread Tod
On 10/07/2011 6:21 PM, � wrote: Hi, What Solr version? Solr Implementation Version: 1.4.1 955763M - mark - 2010-06-17 18:06:42. Its running on a Suse Linux VM. How often do you do commits, or do you use autocommit? I had been doing commits every 100 documents (the entire set is about 3

Re: Please help - Solr Cell using 'stream.url'

2011-10-07 Thread Jan Høydahl
solution architect Cominvent AS - www.cominvent.com Solr Training - www.solrtraining.com On 7. okt. 2011, at 20:19, Tod wrote: > I'm batching documents into solr using solr cell with the 'stream.url' > parameter. Everything is working fine until I get to about 5k docume

Please help - Solr Cell using 'stream.url'

2011-10-07 Thread Tod
I'm batching documents into solr using solr cell with the 'stream.url' parameter. Everything is working fine until I get to about 5k documents in and then it starts issuing 'read timeout 500' errors on every document. The sysadmin says there's plenty of CP

Re: stream.url

2010-09-08 Thread satya swaroop
Hi Hoss, Thanks for reply and it got working The reason was as you said i was not double escaping i used %2520 for whitespace and it is working now Thanks, satya

Re: stream.url

2010-09-07 Thread Chris Hostetter
pass as a value for the stream.url value, it's impossible for us to guess wehter your URL escaping is working properly. bear in mind that you need to escape url metacharacters *twice* for this type of thing -- once to encode the URL in a way that the final server will recognize it, and on

Re: stream.url

2010-09-03 Thread satya swaroop
Hi all, I am unable to index the files of remote system that contains escaped characters in their file names i think there is a problem in solr for indexing the files of escaped characters in remote system... Has anybody tried to index the files in remote system that contain the escaped

Re: stream.url

2010-09-02 Thread satya swaroop
Hi, I made the curl from the shell(command prompt or terminal) with the escaping characters but the error is same when i saw in the remote system the request is not getting there Is there anything to be changed in config file inorder to enable the escaping characters for stream.url

Re: stream.url

2010-09-02 Thread Stefan Moises
the curl i sent is:: curl " http://localhost:8080/solr/update/extract?stream.url=http://remotehost:port/file_download.yaws%3Ffile=solr<http://localhost:8080/solr/update/extract?stream.url=http://remotehost:port/file_download.yaws?file=solr> %20%26%20apache.pdf&

Re: stream.url

2010-09-02 Thread satya swaroop
Hi stefan, I used escape charaters and made it... It is not problem for a single file of 'solr &apache' but it shows the same problem for the files like Wireless lan.ppt, Tom info.pdf. the curl i sent is:: curl " http://localhost:8080/solr/update/extr

Re: stream.url

2010-09-02 Thread Stefan Moises
eers, Stefan Am 02.09.2010 09:35, schrieb satya swaroop: Hi all, I am using stream.url to index the files in the remote system. when i use the url as 1) curl " http://localhost:8080/solr/update/extract?stream.url=http://remotehost:port/file_download.yaws?file=yaws_presentation.pdf&

stream.url

2010-09-02 Thread satya swaroop
Hi all, I am using stream.url to index the files in the remote system. when i use the url as 1) curl " http://localhost:8080/solr/update/extract?stream.url=http://remotehost:port/file_download.yaws?file=yaws_presentation.pdf&literal.id=schb4 " it works and i get the response a

Re: stream.url problem

2010-08-24 Thread satya swaroop
> > Hi all, > I got the solution for my problem. I changed my port number and i > kept the old one in the stream.url... so problem was that... > thanks all > > Now i got another problem, it is when i send any requests to remote > system for the files tha

Re: stream.url problem

2010-08-17 Thread Travis Low
swaroop wrote: > hi all, > i am indexing the documents to solr that are in my system. now i need > to index the files that are in remote system, i enabled the remote > streaming > to true in solrconfig.xml and when i use the stream.url it shows the error > as ""

Re: stream.url problem

2010-08-17 Thread rajini maski
Maski 2010/8/17 Tim Terlegård > > hi all, > > i am indexing the documents to solr that are in my system. now i > need > > to index the files that are in remote system, i enabled the remote > streaming > > to true in solrconfig.xml and when i use the stream.u

Re: stream.url problem

2010-08-17 Thread Tim Terlegård
> hi all, >       i am indexing the documents to solr that are in my system. now i need > to index the files that are in remote system, i enabled the remote streaming > to true in solrconfig.xml and when i use the stream.url it shows the error > as ""connection refuse

stream.url problem

2010-08-17 Thread satya swaroop
hi all, i am indexing the documents to solr that are in my system. now i need to index the files that are in remote system, i enabled the remote streaming to true in solrconfig.xml and when i use the stream.url it shows the error as ""connection refused"" and the de

stream.url Contention

2010-03-18 Thread Giovanni Fernandez-Kincade
I recently switched from posting a file (PDFs in this case) to the Extract handler, to using the Stream.URL parameter. I've noticed a huge amount of contention around opening URL connections: http-8080-Processor36 [BLOCKED] CPU time: 0:47 sun.net.www.protocol.file.Handler.openConnectio