Re: Storing solr results in excel

If we specify wt=csv then results appear like csv format but i need to store them in seperate excel file. -- View this message in context: http://lucene.472066.n3.nabble.com/Storing-solr-results-in-excel-tp4103237p4103247.html Sent from the Solr - User mailing list archive at Nabble.com.

How to use batchSize in DataImportHandler to throttle updates in a batch-mode

Hi All, I have a requirement to import a large amount of data from a mysql database and index documents (about 1000 documents). During indexing process I need to do a special processing of a field by sending a enhancement requests to an external Apache Stanbol server. I have configured my dataimpo

CoreAdminRequest User Credentials 'Unauthorized'

Hello, I have protected my Solr-Admin URL with a required User Role (Security Constraint). Now, I am not able to reload my Core anymore, using CoreAdminRequest: CoreAdminRequest requestReload = new CoreAdminRequest(); requestReload.setAction(CoreAdminParams.CoreAdminAction.RELOAD

RE: Need help on Joining and sorting syntax and limitations between multiple documents in solr-4.4.0

Hi Team, Attaching the updated files as per the comments in the ticket. You can now try the VJOIN operation on the updated files. It would be also helpful for us if you send the correct VJOIN syntax with the inputs from the updated files. Thanks, Sukanta From: Sukanta Dey Sent: Friday, Novembe

Re: In a functon query, I can't get the ValueSource when extend ValueSourceParser

As your DateSourceParser is put in standardValueSourceParsers map with key "dateDeboost" (right?), I think you need specify name of your source like "dateDeboost(title)". 26.11.2013, 06:46, "sling" : > Thanks a lot for your reply, Chris. > > I was trying to sort the query result by the Datefunc

Is there any limit how many documents can be indexed by apache solr

Dear All I am using Apache solr 3.6.2 with Drupal 7. Users keeps adding their profiles (resumes) and with cron task from Drupal, documents get indexed. Recently I observed, after indexing around 11,000 documents, further documents are not getting indexed. Is there any configuration for max docume

Re: Is there any limit how many documents can be indexed by apache solr

Hi, In lucene you are supossed to be able to index up to 274 billion documents ( http://lucene.apache.org/core/3_0_3/fileformats.html#Limitations ), so in Solr should be something like that. Anyway the maximum number is quite bigger than those 11.000 ;) Could it be that you are reusing IDs so the

Newline delimiter is not working in Solr with Velocity

Hi All, I am new to Solr. I am building small search application using solr. I am using velocity template to display the results. After index the data into solr, the data (search result) is not displaying newline delimiter (\n). when I check the indexed data using luke, found that '\n' available b

Re: Is there any limit how many documents can be indexed by apache solr

Hello! Checkout also your application server logs. Maybe you're trying to index Documents with any syntax error and they are skipped. Regards, - Luis Cappa 2013/11/26 Alejandro Marqués Rodríguez > Hi, > > In lucene you are supossed to be able to index up to 274 billion documents > ( http://l

Re: How to retain the original format of input document in search results in SOLR - Tomcat

Thanks Erick for your reply.. I am using velocity template for display the result. #field('SDtext') ==> here SDtext is my field. here is my field definition in schema.xml

Re: Storing solr results in excel

My Response is coming in the follwing way "response": { "numFound": 21, "start": 0, "maxScore": 1, "docs": [ { "pageType": "LP", "category": "some category name", "url": "some url", "score": 1 } ] }

Re: Is there any limit how many documents can be indexed by apache solr

Thanks Alejandro and Luis. If I need to see logs, how can I see it. Is it stored in any default log files. I am using below command to start apache solr. java -Xms64m -Xmx6g -jar start.jar & I am using it along with Drupal 7.1.5 , I am trying to find out if it is a Drupal issue or Apache solr i

Re: Storing solr results in excel

Excel can read/import CSV files, so simply write out the Solr results in a CSV text file. If you need/wish to write out a native Excel XLSM file, that is beyond the scope of Solr and SolrJ and this mailing list. Try a Google search on that topic. I mean, usually Solr results are directly consume

Re: Is there any limit how many documents can be indexed by apache solr

Hi All I tried to get the log from terminal. The complete log I have put at the end of this email. One place in log I see, it is logged as Nov 26, 2013 5:46:24 AM org.apache.solr.core.SolrCore execute INFO: [] webapp=/solr path=/update params={wt=json} status=0 QTime=1 Nov 26, 2013 5:46:25 AM org.

Re: Trouble with manually routed collection after upgrade to 4.6

That's not good. I'll investigate. On Mon, Nov 25, 2013 at 10:29 PM, Brett Hoerner wrote: > Think I got it. For some reason this was in my clusterstate.json after the > upgrade (note that I was using 4.5.X just fine previously...): > > "router": { >"name": "compositeId" > }, > >

Re: HttpSolrServer - Http Client Connection pooling issue

On 11/25/2013 11:04 PM, imgaur...@yahoo.in wrote: > We are using Solr 4.3.1 and we are using HttpSolrServer for querying Solr. > > We are trying to do a load and stress test using Jmeter and we can see that > after certain requests Solr responds in very unusual way. It gets stuck and > responds

SOLR-4237 -- internal SolrJ client?

I am looking at SOLR-4237: https://issues.apache.org/jira/browse/SOLR-4327

Re: SOLR-4237 -- internal SolrJ client?

On 11/26/2013 7:52 AM, Shawn Heisey wrote: > I am looking at SOLR-4237: > > > https://issues.apache.org/jira/browse/SOLR-4327 My email client got over-excited and sent that before I was ready. What I want to know is whether this bug affects the internal SolrJ client used for distributed search.

Request to join the ContributorsGroup

To whom it may concern, I am currently working on Solr and I would like to contribute a bit on the wiki pages. So, I would like to get access to the Solr Wiki pages. Thanks, Anastasios -- Anastasios Zouzias IBM Research Division - Zurich Research Laboratory Saumerstrasse 4 8803 Ruschlikon - Swi

How to request not directly my SOLR server ?

Dear All, I show my SOLR server to a friend and its first question was: "You can request directly your solr database from your internet explorer?! is it not a security problem? each person which has your request link can use your database directly?" So I ask the question here. I protect my admi

Re: Request to join the ContributorsGroup

Sure, and thanks! First, create a login on the Wiki. Then let us know what that name is and we'll add you to the ACL. Unfortunately we had a problem a while ago with spam bots creating bogus pages and had to lock it down so this step became necessary. Best, Erick On Tue, Nov 26, 2013 at 10:15 A

Re: a function query of time, frequency and score.

You can combine a whole series of mathematical functions that take into account the values of fields and use that for scoring. Functions can take other functions as one of their operands, so you could make something arbitrarily complex that takes into account several of your fields. If this still

Re: Setting solr.data.dir for SolrCloud instance

The data _is_ separated from the code. It's all relative to solr_home which need not have any relation to where the code is executing from. For instance, I can start Solr like java -Dsolr.solr.home=/Users/Erick/testdir/solr -jar start.jar and have my war in a completely different place. Best, Er

Re: Request to join the ContributorsGroup

Hi Erick, Thanks for the prompt reply. My username on the wiki is "zouzias". Best, Anastasios On Tue, Nov 26, 2013 at 4:58 PM, Erick Erickson wrote: > Sure, and thanks! > > First, create a login on the Wiki. Then let us know what that name is and > we'll add you to the ACL. Unfortunately we ha

Re: Revolution writeup

Hi Mike, Thanks a lot for sharing. I posted my impressions on the conference as well, right after it has finished. So I'll share them here, if you don't mind: Day 1: http://dmitrykan.blogspot.fi/2013/11/lucene-revolution-eu-2013-in-dublin-day.html Day 2: http://dmitrykan.blogspot.fi/2013/11/lucen

Re: Setting solr.data.dir for SolrCloud instance

The problem we had was that we tried to run: java -Dsolr.data.dir=/opt/solr/data -Dsolr.solr.home=/opt/solr/home -jar start.jar and got different behavior for how solr handles these 2 params. we created 2 collections, which created 2 cores. then we got 2 home dirs for the cores, as expected: /op

Re: Setting solr.data.dir for SolrCloud instance

On Nov 25, 2013, at 8:12 AM, adfel70 wrote: > I was expecting that the path I sent would serve as the BASE path for all > cores the the node hosts When running Solr on HDFS, there is a similar prop you can use -Dsolr.hdfs.home. If you set that, all data dirs are created nicely under it. We ta

Multivalued true Error?

Hi; I've ported this example from Scala into Java: http://sujitpal.blogspot.com/2013/07/porting-payloads-to-solr4.html#! However does field should be multivalued true at that example? PS: I use Solr 4.5.1 Thanks; Furkan KAMACI

Re: Revolution writeup

On 26/11/2013 16:19, Dmitry Kan wrote: Hi Mike, Thanks a lot for sharing. I posted my impressions on the conference as well, right after it has finished. So I'll share them here, if you don't mind: Day 1: http://dmitrykan.blogspot.fi/2013/11/lucene-revolution-eu-2013-in-dublin-day.html Day 2: h

Solr 3.6.1 stalling with high CPU and blocking on field cache

I've been tracking a problem in our Solr environment for awhile with periodic stalls of Solr 3.6.1. I'm running up to a wall on ideas to try and thought I might get some insight from some others on this list. The load on the server is normally anywhere between 1-3. It's an 8-core machine with 40GB

Re: How to request not directly my SOLR server ?

On 11/26/2013 8:37 AM, Bruno Mannina wrote: I show my SOLR server to a friend and its first question was: "You can request directly your solr database from your internet explorer?! is it not a security problem? each person which has your request link can use your database directly?" So I ask

Re: Setting solr.data.dir for SolrCloud instance

On 11/26/2013 9:19 AM, adfel70 wrote: The problem we had was that we tried to run: java -Dsolr.data.dir=/opt/solr/data -Dsolr.solr.home=/opt/solr/home -jar start.jar and got different behavior for how solr handles these 2 params. we created 2 collections, which created 2 cores. then we got 2 hom

Client-side proxy for Solr 4.5.0

Are there any GOOD client-side solutions to proxy a Solr 4.5.0 instance so that the end-user can see their queries w/o being able to directly access :8983? Applications/frameworks used: - Solr 4.5.0 - AJAX Solr (javascript library) Thank you, Mark IMPORTANT NOTICE: This e-mail message is inten

Re: Multivalued true Error?

Hi Furkan, In the stock definition of the payload field: http://svn.apache.org/viewvc/lucene/dev/trunk/solr/example/solr/collection1/conf/schema.xml?view=markup the analyzer for payloads field type is a WhitespaceTokenizerFactory followed by a DelimitedPayloadTokenFilterFactory. So if you send it

RE: Solr 3.6.1 stalling with high CPU and blocking on field cache

I am not completely sure about that, but if I remember correctly (it has been more than one year since I've did that and I was lazy enogh not to take notes :( ), it helped that I've reduced the percentage of size of permanent generation (somehow, more GC on less permanent gen, but this one is no

SOLR Master-Slave Repeater with Load balancer

We are trying to setup solr Master Slave repeater model, where we will have two solr servers say S1 and S2 and a Load balancer LB to route all the requests to either S1 or S2. S1 and S2 acts as both Master and Slave(Repeater). In both the solr server configurations, in the solrconfig.xml file for m

RE: Client-side proxy for Solr 4.5.0

I don't think you mean client-side proxy. You need a server side layer such as a normal web application or good proxy. We use Nginx, it is very fast and very feature rich. Its config scripting is usually enough to restrict access and limit input parameters. We also use Nginx's embedded Perl and

TermVectorComponent NullPointerException

Hi, I am working on using term vector component with solr 4.2.1. If I use solr in a multicore environment, then I am getting a Null Pointer exception. However, if I use single core as is mentioned at :- http://wiki.apache.org/solr/TermVectorComponent then I do not get any exception. However, t

RE: Solr 3.6.1 stalling with high CPU and blocking on field cache

I am not completely sure about that, but if I remember correctly (it has been more than one year since I've did that and I was hmm.. whatever you want to write here, enogh not to take notes :( ), it helped that I've reduced the percentage of size of permanent generation (somehow, more GC on les

RE: Solr 3.6.1 stalling with high CPU and blocking on field cache

My gut instinct is that your heap size is way too high. Try decreasing it to like 5-10G. I know you say it uses more than that, but that just seems bizarre unless you're doing something like faceting and/or sorting on every field. -Michael -Original Message- From: Patrick O'Lone [mailto

Re: Client-side proxy for Solr 4.5.0

Perhaps what you want is a transparent proxy? You could use nginx, squid, varnish, etc. W've been evaluating varnish as a posibility to run in front of our solr server and take advantage of the HTTP caching that varnish does so well. Greetings! - Mensaje original - De: "Markus Jelsma"

Re: Solr 3.6.1 stalling with high CPU and blocking on field cache

We do perform a lot of sorting - on multiple fields in fact. We have different kinds of Solr configurations - our news searches do little with regards to faceting, but heavily sort. We provide classified ad searches and that heavily uses faceting. I might try reducing the JVM memory some and amount

Re: How to request not directly my SOLR server ?

Le 26/11/2013 18:52, Shawn Heisey a écrit : On 11/26/2013 8:37 AM, Bruno Mannina wrote: I show my SOLR server to a friend and its first question was: "You can request directly your solr database from your internet explorer?! is it not a security problem? each person which has your request lin

Re: Major GC does not reduce the old gen size

psoting on behalf of neoman, alt_schema.xml details about index Number of documents: 350 million number of shards: 4 number of nodes:8 replicatorFactor: 1(default/no additional replication). Total RAM on each server node: 16 GB

Is it possible to have only fq in my solr query?

Hi, I am preparing a solr query. in that i am only giving fq parameter .. I dont give any q parameter.. If i exeucte such query, where only it is having fq, it is not returning any docs. in the sense it is returning 0 docs. So, is it always mandatory to have q parameter in solr query? if so, then i

Re: Adding new field after data is already indexed

Check Solr: Add new fields with Default Value for Existing Documents If we only need search and display the new fields, we can do the following steps. 1. add the new field definition in schema.xml:

Re: In a functon query, I can't get the ValueSource when extend ValueSourceParser

Thank you, kydryavtsev andrey! You give me the right solution. -- View this message in context: http://lucene.472066.n3.nabble.com/In-a-functon-query-I-can-t-get-the-ValueSource-when-extend-ValueSourceParser-tp4103026p4103449.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Storing solr results in excel

Thank you for suggestion Finally i got the solution Converted the document into json format and store them in a string String url = JSONUtil.toJSON(document.get("url")); then i placed string values in excel file -- View this message in context: http://lucene.472066.n3.nabble.com/Storing-s

Solr Autowarmed queries on jvm crash

Hi, What happens to the autowarmed queries if the servers is shutdown / jvm crashes. Is there any possibility to recover that from the physical storage ( trasaction log?) Thanks, Sinduja

Re: Solr Autowarmed queries on jvm crash

On 11/26/2013 11:15 PM, Prasi S wrote: > What happens to the autowarmed queries if the servers is shutdown / jvm > crashes. > > Is there any possibility to recover that from the physical storage ( > trasaction log?) The transaction log only contains data that is sent to Solr for indexing. Cached

Re: Solr Autowarmed queries on jvm crash

Thanks Shawn for the reply. In that case, when the system is restarted, a new searcher would be opened? It cannot populate from its previous searchers? I may be wrong here, but i wanted to confirm. Thanks, Prasi On Wed, Nov 27, 2013 at 12:04 PM, Shawn Heisey wrote: > On 11/26/2013 11:15 PM,

Re: syncronization between replicas

anyone? -- View this message in context: http://lucene.472066.n3.nabble.com/syncronization-between-replicas-tp4103046p4103455.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Autowarmed queries on jvm crash

On 11/26/2013 11:49 PM, Prasi S wrote: > Thanks Shawn for the reply. > > In that case, when the system is restarted, a new searcher would be opened? > It cannot populate from its previous searchers? > > I may be wrong here, but i wanted to confirm. There are no previous searchers when Solr first

Re: Solr Autowarmed queries on jvm crash

Ok. i have started solr for the first time and have autowarmed few queries. Now my jvm crashes due to some other reason . Then i restart solr. What would happen to the autowarmed queries , cache , old searcher now. Thanks, Prasi On Wed, Nov 27, 2013 at 12:32 PM, Shawn Heisey wrote: > On 11/26/