Run solrj in parallel how it works

I am little bit confused about the parallel running option for solrj. How to configure the core and what it means exactly. Right now, i create a new core with Solr admin console. the main requirement is to have a conf folder with defined solrconfig.xml and data-config.xml. Now, i run my program as

Re: Full import alternatives

Dear Furkan, I did. What i am not able to understand correctly at the moment, how to run SOLR in parallel. So, i figured out that we can run indexing with SolrJ with XML file. http://lucene.472066.n3.nabble.com/Index-database-with-SolrJ-using-xml-file-directly-throws-an-error-td4426491.html N

RE: Index database with SolrJ using xml file directly throws an error

Thanks James, it works! -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

RE: Index database with SolrJ using xml file directly throws an error

Hi James, Thanks for your reply. I am not absolotuely sure I understood everything correctly here. I would like to index my database to start with fresh index. I have already done it with DIH execute function. It works absolutely fine

Index database with SolrJ using xml file directly throws an error

I would like to index my database using SolrJ Java API. I have already tried to use DIH directly from the Solr server. It works and indexes well. But when I would like to use the same XML config file with SolrJ it throws an error. **Solr version 7.6.0 SolrJ 7.6.0** Here is the full code I am usi

Re: Full import alternatives

Hi Shawan, can you please suggest a small program or atleast a backbone of a program which can give me hints how exactly to achieve, I quote: "I send a full-import DIH command to all of the shards, and each one makes an SQL query to MySQL, all of them running in parallel. " -- Sent from: http://

Re: Match a phrase like "Apple iPhone 6 32GB white" with "iphone 6"

I think this filter will output the desired result: indexing: "iPhone 6" will be indexed as "iphone 6" (always a single token) querying: so this will analyze "Apple iPhone 6 32GB white" to "apple", "apple iphone", "iphone", "iphone 6" and so on... then here a match wi

Match a phrase like "Apple iPhone 6 32GB white" with "iphone 6"

I have a set of products' docs with field name_en for example name_en:"Apple iPhone 6 32GB white" when a user chooses this product to view, I use the product name as a search phrase and retrieve all the product accessories docs that have "iphone 6" (not "iphone 7") in the field of compatible_with

Re: Atomic updates using solr-php-client

Thank you for replying, Yes that is the one. Unfortunately there is no documentation for this library. I tried to implement other libraries but I couldn't get them running. This is the easiest library to implement but lacks support and documentation. Thank you and best regards, Sami --

Atomic updates using solr-php-client

I am using solr-php-client to interact with solr. I came this example that shows how to add docs: http://www.ayalon.ch/en/code-samples/solr-php-client-example I checked "service.php" file, more specifically the function "_documentToXml

Re: No match when querying but in admin/analysis it works!! (schema, indexed data and screen shots are provided)

s and make it easy to participate and help. It is also out of respect to others' time. I learned this from stackoverflow. Thank you and best regards Sami -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

No match when querying but in admin/analysis it works!! (schema, indexed data and screen shots are provided)

data_to_be_indexed.xml schema.xml *above I uploaded a copy of my schema and data* *I have this in my schema.xml*

Re: Limit edismax search to a certain field value and find out matched fields on the results

thank you for your reply Erick. That solved the problem. q=iphone +category:phones -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Limit edismax search to a certain field value and find out matched fields on the results

Hello, I have these query parameters: 'q' => "iphone", 'echoParams' => "explicit", 'defType' =>'edismax', 'fl' => 'name,category,score', 'qf' =>'name_suggest_edge^50 name_suggest_exact^50 name_suggest_ngram', 'pf' =>'name_suggest_edge^100 ' 1) How can I limit the search to the docs

Re: SolrCloud: Very strange behavior when doing atomic updates or documents reindexation.

With replicas it could appear even more strange: the leader might have the doc right and the replica not. I only briefly looked at the bits that deal with this so perhaps there's something more involved. On Thu, Nov 22, 2012 at 8:29 PM, Luis Cappa Banda wrote: > Hi, Sami! > > But isn´

Re: SolrCloud: Very strange behavior when doing atomic updates or documents reindexation.

I think the problem is that even though you were able to work around the bug in the client solr still uses the xml format internally so the atomic update (with multivalued field) fails later down the stack. The bug you filed needs to be fixed to get the problem solved. On Thu, Nov 22, 2012 at 8:1

Re: How to get a list of servers per collection in sorlcloud using java api?

g like: > > // returns a list of solr servers in the zookeeper ensemble that store the > given collection > List getServers(String zkhost, String collectionName) > You can use ZKStateReader (#getClusterState) to get this info. -- Sami Siren

Re: CloudSolrServer and LBHttpSolrServer: setting BinaryResponseParser and BinaryRequestWriter.

hi, did you try setting your values in a List, for example ArrayList it should work when you use that even without specifying reguest-/response writer. -- Sami Siren On Thu, Nov 15, 2012 at 4:56 PM, Luis Cappa Banda wrote: > Hello, > > I´ve found what It seems to be a bug > J

Re: SolrJ: atomic updates.

, Luis Cappa Banda wrote: > Hi, Sami. > > Doing some tests I´ve used the same code as you and did a quick execution: > > > *HttpSolrServer server = new HttpSolrServer(" > http://localhost:8080/solrserver/core1< > http://localhost:10080/newscover_es/items_es> > &qu

Re: SolrJ: atomic updates.

yway. The Affects version should be 4.0. On Thu, Nov 15, 2012 at 1:42 PM, Luis Cappa Banda wrote: > Hello, Sami. > > It will be the first issue that I open so, should I create it under Solr > 4.0 version or in Solr 4.1.0 one? > > Thanks, > > - Luis Cappa. > > 2012/11/15 S

Re: SolrJ: atomic updates.

t;)); prints "tag1" ArrayList as a value works the same way as String[]. When using xml (RequestWriter) I can see the problem that you are describing, can you add a jira for that? -- Sami SIren > > Regards, > > > - Luis Cappa. > > 2012/11/15 Luis Cappa Banda

Re: SolrJ 4.0 Beta maxConnectionsPerHost

t uses solrj to demonstrate the problem. Based on the available information it is really difficult try to guess what's happening. -- Sami Siren

Re: SolrJ 4.0 Beta maxConnectionsPerHost

On Wed, Oct 10, 2012 at 12:02 AM, Briggs Thompson wrote: > *Sami* > The client IS > instantiated only once and not for every request. I was curious if this was > part of the problem. Do I need to re-instantiate the object for each > request made? No, it is expensive if you instant

Re: SolrJ 4.0 Beta maxConnectionsPerHost

re not > actually getting set. Anyone seen this problem or have an idea how to > resolve? I did some experiments with the solrj and from what it looked like it seems to respect the values that you set. -- Sami Siren

Re: Change config to use port 8080 instead of port 8983

i just tried this with tomcat and the props work for me. Did you wipe out your zoo_data before starting with the additional system properties? here's how i ran it: JAVA_OPTS="-DzkRun -DnumShards=1 -Djetty.port=8080 -Dbootstrap_conf=true -Dhost=127.0.0.1" bin/catalina.sh run -- S

Re: Change config to use port 8080 instead of port 8983

are using a name "dm-search-sr-01" > instead of the ip address associated to the server. Is there a way to set > this to the ipaddress instead? If you use the example configuration then take a look at solr.xml. In it's current state it accepts port in system property called "jetty.port" and the hostname or in your case the ip in "host". So adding -Djetty.port=xxx -Dhost=yyy to you JAVA_OPTS allow you to set them when using the default solr.xml. -- Sami Siren

Re: Solrcloud not reachable and after restart just a "no servers hosting shard"

hi, Can you share a little bit more about your configuration: how many shards, # of replicas, how does your clusterstate.json look like, anything suspicious in the logs? -- Sami Siren On Mon, Sep 24, 2012 at 11:13 AM, Daniel Brügge wrote: > Hi, > > I am running Solrcloud 4.0-BETA a

Re: Nodes cannot recover and become unavailable

also, did you re create the cluster after upgrading to a newer version? I believe there were some changes made to the clusterstate.json recently that are not backwards compatible. -- Sami Siren On Wed, Sep 19, 2012 at 6:21 PM, Sami Siren wrote: > Hi, > > I am having troubles unde

Re: Nodes cannot recover and become unavailable

Hi, I am having troubles understanding the reason for that NPE. First you could try removing the line #102 in HttpClientUtility so that logging does not prevent creation of the http client in SyncStrategy. -- Sami Siren On Wed, Sep 19, 2012 at 5:29 PM, Markus Jelsma wrote: > Hi, > &

Re: Solr 4.0 BETA Replication problems on Tomcat

I opened SOLR-3789. As a workaround you can remove internal from the config and it should work. -- Sami Siren On Wed, Sep 5, 2012 at 5:58 AM, Ravi Solr wrote: > Hello, > I have a very simple setup one master and one slave configured > as below, but replication keeps fai

Re: JIRA Issue : SOLR-3771

Based on the stack trace it seems that DIH uses URLConnection. You might want to try setting the proxy related system properties for the jvm that runs Solr: http://docs.oracle.com/javase/6/docs/technotes/guides/net/proxies.html -- Sami Siren On Fri, Aug 31, 2012 at 9:58 AM, Molala, Nagaraj

Re: Updating document with the Solr Java API

ique"); doc.addField("_version_", version); // this is needed only if optimistic locking is to be used HashMap value = new HashMap(); value.put("set",100); doc.addField("price_f", value); -- Sami Siren

Re: Problem with Solr 4.0-ALPHA and JSON response

amters, is this normal? yes, to control the format used by the client there's a method HttpSolrServer#setParser that set's the client parser (that also overrides the wt param when the request is made) -- Sami Siren

Re: LeaderElection bugfix

ok, I see what you mean. Looks to me that you're right. I am not too familiar with the LeaderElector so I'll let Mark take a second look. -- Sami Siren On Wed, Jun 27, 2012 at 11:32 AM, "Trym R. Møller" wrote: > Hi Sami > > Regarding 2) A "simple" way t

Re: LeaderElection bugfix

the test method to LeaderElectionIntegrationTest and ran it few times but I can't get it to fail. -- Sami Siren

Re: How to update one field without losing the others?

=true -H 'Content-type:application/json' -d '{ "add": { "doc": { "id": "id", "title": "test", "price_f": 10 }}}' curl $URL?commit=true -H 'Content-type:application/json' -d '{ "add": { "doc": { "id": "id", "price_f": {"set": 5' If you are using solrj then there's a junit test method, testUpdateField(), that does something similar: http://svn.apache.org/viewvc/lucene/dev/trunk/solr/solrj/src/test/org/apache/solr/client/solrj/SolrExampleTests.java?view=markup -- Sami Siren

Re: SolrCloud and split-brain

t accept updates (even if that side has a working zk setup). > Now imagine if the client sending documents for indexing happened to be > sending documents to 2 nodes, say in round-robin fashion. In my understanding all updates are routed through a shard leader. -- Sami Siren

Re: SolrJ indexing pdf documents

equest req = new ContentStreamUpdateRequest( "/update/extract"); req.setParam("literal.id", "doc"); req.addFile(new File( "solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr-word.pdf")); server.request(req); server.commit(); -- Sami Siren

Re: StreamingUpdateSolrServer Connection Timeout Setting

The api doc for version 3.6.0 is available here: http://lucene.apache.org/solr/api/org/apache/solr/client/solrj/impl/StreamingUpdateSolrServer.html I think the default is coming from your OS if you are not setting it explicitly. -- Sami Siren On Fri, Jun 15, 2012 at 8:22 PM, Kissue Kissue

Re: solrj library requirements: slf4j-jdk14-1.5.5.jar

What is the version of solrj you are trying to get working? If you download version 3.6 of solr there's a directory dist/solrj-lib in the binary release artifact that includes the required dependencies. I would start with those. -- Sami Siren On Wed, Jun 6, 2012 at 5:34 PM, Welty, Ri

Re: SolrJ dependencies

x27;t those go into lucene/solr/dist/solrj-lib as wel? Yes they should. > Do I need to create a ticket for this? Please do so. -- Sami Siren

Re: Accent Characters

Vicente, Are you using CommonsHttpSolrServer or HttpSolrServer? If the latter then you are probably hitting this: https://issues.apache.org/jira/browse/SOLR-3375 The remedy is to use CommonshHttpSolrServer. -- Sami Siren On Thu, May 31, 2012 at 7:52 AM, Vicente Couto wrote: > Hello, J

Re: upgrade to 3.6

Hi, If you're using non ascii data with solrj you might want to test that it works for you properly. See for example https://issues.apache.org/jira/browse/SOLR-3375 -- Sami Siren On Fri, May 25, 2012 at 10:11 AM, Cam Bazz wrote: > Hello, > > I have upgraded from 1.4 to 3.6 -

Re: Arabic document analysis fails for HttpServer

eventually become solr 3.6.1. For now I recommend you use the Commons version of the solr server (if You need to be on released version) or then just check out the fixed version from the 3.6 branch. -- Sami Siren On Thu, May 24, 2012 at 6:23 PM, Shane Perry wrote: > Hi, > > Upgrading fr

Re: solr error when querying.

Ron, Did you actually add new xslt file there or did you try to use the example one, if the latter I believe the filename is example.xsl not example.xslt -- Sami Siren On Wed, May 23, 2012 at 5:30 PM, watson wrote: > Here is my query: > http://127.0.0.1:/solr/JOBS/select/??q=Apa

Re: Throws Null Pointer Exception Even Query is Correct in solr

What version of solr (solrj) are you using? -- Sami SIren On Thu, May 24, 2012 at 8:41 AM, in.abdul wrote: > Hi Dmitry , > > There is no out of memory execution in solr .. >            Thanks and Regards, >        S SYED ABDUL KATHER > > > > On Thu, May 24, 2012

Re: Solr Shards multi core slower then single big core

th for example separate hard discs for each shard splitting your index into smaller shards can in some cases make a huge difference in one box too. -- Sami Siren

Re: Dynamic core creation works in 3.5.0 fails in 3.6.0: At least one core definition required at run-time for Solr 3.6.0?

ke a reasonable feature so I would classify this as a bug. Not sure what others thing about it. -- Sami Siren

Re: # open files with SolrCloud

it seems to be working now. -- Sami Siren

Re: # open files with SolrCloud

On Thu, Apr 19, 2012 at 3:12 PM, Sami Siren wrote: > I have a simple solrcloud setup from trunk with default configs; 1 > shard with one replica. As few other people have reported there seems > to be some kind of leak somewhere that causes the number of open files > to grow over tim

# open files with SolrCloud

e for this? I don't even know where to start looking... -- Sami Siren

Re: [SoldCloud] leaking file descriptors

around 400-500. -- Sami Siren On Thu, Mar 1, 2012 at 12:36 PM, Markus Jelsma wrote: > Hi, > > Yesterday we had an issue with too many open files, which was solved because > a username was misspelled. But there is still a problem with open files. > > We cannot succesfully in

Re: Inconsistent Results with ZooKeeper Ensemble and Four SOLR Cloud Nodes

oud (1 shard, no replicas) cd solr/cloud-dev sh ./control.sh rebuild sh ./control.sh reinstall 1 sh ./control.sh start 1 #index content java -jar ../example/exampledocs/post.jar ../example/exampledocs/*.xml #after that you can run your queries -- Sami Siren

Re: [SolrCloud] Too many open files - internal server error

On Wed, Feb 29, 2012 at 5:53 PM, Markus Jelsma wrote: > Sami, > > As superuser: > $ lsof | wc -l > > But, just now, i also checked the system handler and it told me: > (error executing: ulimit -n) That's odd, you should see something like this there: &qu

Re: [SolrCloud] Too many open files - internal server error

ime. How did you check the number of filedescriptors used? Did you get this number from the system info handler (http://hotname:8983/solr/admin/system?indent=on&wt=json) or somehow differently? -- Sami Siren

Re: Unique key constraint and optimistic locking (versioning)

On Fri, Feb 24, 2012 at 12:06 PM, Per Steffensen wrote: > Sami Siren skrev: > >>>> Given that you've set a uniqueKey-field and there already exists a >>>> document with that uniqueKey, it will delete the old one and insert the >>>> new one. Ther

Re: Unique key constraint and optimistic locking (versioning)

but you should be able to get the latest data from Solr by using realtime get http://wiki.apache.org/solr/RealTimeGet -- Sami Siren

Re: distributed deletes working?

On Fri, Feb 17, 2012 at 6:03 PM, Jamie Johnson wrote: > Thanks Sami, so long at it's expected ;) > > In regards to the replication not working the way I think it should, > am I missing something or is it simply not working the way I think? It should work. I also tried to reprodu

Re: distributed deletes working?

be changed at some point. -- Sami Siren

Re: SolrCloud Replication Question

Do you have unique dataDir for each instance? 13.2.2012 14.30 "Jamie Johnson" kirjoitti:

Re: Parallel indexing in Solr

On Mon, Feb 6, 2012 at 5:55 PM, Per Steffensen wrote: > Sami Siren skrev: > >> On Mon, Feb 6, 2012 at 2:53 PM, Per Steffensen >> wrote: >> >> >> >>> >>> Actually right now, I am trying to find our what my bottleneck is. The >>&g

Re: Parallel indexing in Solr

ght not be a > Solr-related problem, I am investigating different things, but just wanted > to know a little more about how Jetty/Solr works in order to make a > qualified guess. What kind of/how many discs do you have for your shards? ..also what kind of server are you experimenting with? -- Sami Siren

Re: Commit and sessions

ate whether the last minutes of adds > made it. In addition to what Jan said I think you also need to watch out for out of memory exceptions and filled disk space because I think you loose your docs (since last commit) in those cases too. -- Sami Siren

Re: Difference between #indexed documents and #results in *:* query

Does all your 913 documents contain a unique key?  The uniqueKey field is "id" by default. --  Sami Siren On Wed, Jan 25, 2012 at 3:16 PM, m0rt0n wrote: > Thanks a lot for your answer; really appreciated. > > Unfortunately, I am still getting the same number of resu

Re: Stopword filter - refreshing stop word list periodically

llection1". So to reload that you'd call url: http://localhost:8983/solr/admin/cores?action=RELOAD&core=collection1 -- Sami Siren

Re: basic solr cloud questions

er of things yourself, > even if they might be done by SolrCloud automatically in the future. There is a patch in Jira: https://issues.apache.org/jira/browse/SOLR-2355 that adds a update processor suitable for doing simple distributed indexing with current version of Solr. -- Sami Siren

Re: [POLL] Where do you get Lucene/Solr from? Maven? ASF Mirrors?

; [] Other (someone in your company mirrors them internally or via a downstream > project) -- Sami Siren

Re: unable to run the solr in tomcat 5.0

post.jar also supports specifying alternative url, see output from java -jar post.jar -help for more info. -- Sami Siren uday kumar maddigatla wrote: hi you mis understood my question. When i try to use the command java -post.jar *.*. It is trying to Post files in Solr which is there in

Re: [VOTE] Community Logo Preferences

://issues.apache.org/jira/secure/attachment/12394266/apache_solr_b_red.jpg -- Sami Siren Ryan McKinley wrote: Please submit your preferences for the solr logo. For full voting details, see: http://wiki.apache.org/solr/LogoContest#Voting The eligible logos are: http://people.apache.org

Re: Tomcat6 env-entry

I don't recall any differences in tomcat 6 configuration compared to tomcat 5, did you try to follow the information on wiki for tomcat 5 on your installation? -- Sami Siren Matthew Runo wrote: > Ok, I updated it. I hope it makes sense =\ > > I'm not really familiar enou

Re: solr + maven?

what Lucene has recently experienced (fully usable maven artifacts for releases and nightly builds). If it has any value I could at least put some poms together. -- Sami Siren

Re: Solr 1.2 HTTP Client for Java

; repo. If they do nightly snapshots, it will be there Each project must actively push [1] released artifacts to maven repository, there is no other way of getting them there. [1] http://www.apache.org/dev/release-publishing.html#maven-repo -- Sami Siren

Re: crawler feed?

i plan to integrate after 0.9.0 is out. -- Sami Siren [1]http://blog.foofactory.fi/2007/02/online-indexing-integrating-nutch-with.html

Re: Index & search questions; special cases

build these nice utilities to be usable between projects. Not exactly sure how this could be accomplished but anyway something to consider. -- Sami Siren