SolrCloud with custom package in dataimport

2020-06-26 Thread stefan
Hey, Is it possible to reference a custom java class during the dataimport? The dataimport looks something like this: ``` db-data-config.xml ``` Sadly I was unable to find any information on this topic. Thanks for your help!

Re: Dataimport: Could not load driver: com.mysql.jdbc.Driver

2019-10-09 Thread Alexandre Rafalovitch
Try referencing the jar directly (by absolute path) with a statement in the solrconfig.xml (and reloading the core). The DIH example shipped with Solr shows how it works. This will help to see if the problem with not finding the jar or something else. Regards, Alex. On Wed, 9 Oct 2019 at 09:14

Re: Dataimport: Could not load driver: com.mysql.jdbc.Driver

2019-10-09 Thread Erick Erickson
Try starting Solr with the “-v” option. That will echo all the jars that are loaded and the paths. Where _exactly_ is the jar file? You say “in the lib folder of my core”, but that leaves a lot of room for interpretation. Are you running stand-alone or SolrCloud? Exactly how do you start Solr?

Re: Dataimport: Could not load driver: com.mysql.jdbc.Driver

2019-10-09 Thread guptavaibhav35
Hi, Kindly help me solve the issue when I am connecting NEO4j with solr. I am facing this issue in my log file while I have the jar file of neo4j driver in the lib folder of my core. Full Import failed:java.lang.RuntimeException: java.lang.RuntimeException: org.apache.solr.handler.dataimport.Data

Error in Dataimport without reason or log

2019-08-27 Thread Daniel Carrasco
Hello, I write because I'm having problems importing some data from a MariaDB database to my Solr Cloud cluster, and I'm not able to see the data or where's the import problem. My Solr has a dataimport that query a MariaDB database and index the data, but seems to be not wo

Re: Dataimport problem

2019-07-31 Thread Alexandre Rafalovitch
ing for all the > cores which have more than 8 SQL requests. But the same is working fine with > AWS hosting. Really baffled. > > Thanks and Regards, > Srinivas Kashyap > > -Original Message- > From: Erick Erickson > Sent: 31 July 2019 08:00 PM > To: solr-us

RE: Dataimport problem

2019-07-31 Thread Srinivas Kashyap
working fine with AWS hosting. Really baffled. Thanks and Regards, Srinivas Kashyap -Original Message- From: Erick Erickson Sent: 31 July 2019 08:00 PM To: solr-user@lucene.apache.org Subject: Re: Dataimport problem This code is a little old, but should give you a place to start: https

Re: Dataimport problem

2019-07-31 Thread Erick Erickson
p > > -Original Message- > From: Alexandre Rafalovitch > Sent: 31 July 2019 07:41 PM > To: solr-user > Subject: Re: Dataimport problem > > A couple of things: > 1) Solr on Tomcat has not been an option for quite a while. So, you must be > r

RE: Dataimport problem

2019-07-31 Thread Srinivas Kashyap
2019 07:41 PM To: solr-user Subject: Re: Dataimport problem A couple of things: 1) Solr on Tomcat has not been an option for quite a while. So, you must be running an old version of Solr. Which one? 2) Compare that you have the same Solr config. In Admin UI, there will be all O/S variables

Re: Dataimport problem

2019-07-31 Thread Alexandre Rafalovitch
can enable Dataimport(DIH) debug in Admin UI, so perhaps you can run a subset (1?) of the queries and see the difference 4) Worst case, you may want to track this in between Solr and DB by using network analyzer (e.g. Wireshark). That may show you the actual queries, timing, connection issues, etc 5

Dataimport problem

2019-07-31 Thread Srinivas Kashyap
Hello, We are trying to run Solr(Tomcat) on Azure instance and postgres being the DB. When I run full import(my core has 18 SQL queries), for some reason, the requests will go till 9 and it gets hung for eternity. But the same setup, solr(tomcat) and postgres database works fine with AWS hosti

Re: dataimport for full-import

2019-03-29 Thread Alexandre Rafalovitch
It is probably autocommit setting in your solrconfig.xml. But you may also want to consider indexing into a new core and then doing a core swap at the end. Or re-aliasing if you are running a multiCore collection. Regards, Alex On Fri, Mar 29, 2019, 2:25 AM 黄云尧, wrote: > when I do the ful

dataimport for full-import

2019-03-28 Thread 黄云尧
when I do the full-import , it may take about 1 hours,but these old documents will be deleted after 10 minite, it cause query nothing 。what do something method to controller the old documents will be deleted after longer?

Issue with dataimport xml validation with dtd and jetty: conflict of use for user.dir variable

2019-02-08 Thread jerome . dupont
Hello, I use solr and dataimport to index xml files with a dtd. The dtd is referenced like this Previously we were using solr4 in a tomcat container. During the import process, solr tries to validate the xml file with the dtd. To find it we were defining -Duser.dir=pathToDtD and solr could

Re: Dataimport UI - shows green even when import fails

2018-11-30 Thread Jan Høydahl
blem where the admin UI dataimport screen has a green > status summary bar even though an import has failed. > > Here's a screenshot: > > https://www.dropbox.com/s/94baej11nn75746/dih-green-import-failed.png?dl=0 > > What I did to get this: > Downloaded 7.5.0. >

Dataimport UI - shows green even when import fails

2018-11-29 Thread Shawn Heisey
I'm looking into a problem where the admin UI dataimport screen has a green status summary bar even though an import has failed. Here's a screenshot: https://www.dropbox.com/s/94baej11nn75746/dih-green-import-failed.png?dl=0 What I did to get this: Downloaded 7.5.0. Extracted the a

Sanity check on dataimport handler -- what are the implications if status request returns error?

2018-11-27 Thread Shawn Heisey
What might the implications be if a DIH status request returns an error response other than a 404? A 404 says either the handler or the core probably don't exist. My guess, and I admit that I haven't read the code closely, is that if the handler exists but is so broken that it cannot return a

Re: Dataimport not working on solrcloud

2018-08-21 Thread Shawn Heisey
On 8/20/2018 10:00 PM, Sushant Vengurlekar wrote: I have a dataimport working on standalone solr instance but the same doesn't work on solrcloud. I keep on hitting this error Full Import failed:java.lang.RuntimeException: java.lang.RuntimeExce

Dataimport not working on solrcloud

2018-08-20 Thread Sushant Vengurlekar
I have a dataimport working on standalone solr instance but the same doesn't work on solrcloud. I keep on hitting this error Full Import failed:java.lang.RuntimeException: java.lang.RuntimeException: org.apache.solr.handler.dataimport.DataImportHandlerException: Exception in invoking url

Re: Dataimport performance

2018-06-07 Thread Shawn Heisey
at's SEVEN AND A HALF YEARS OLD, that information doesn't help me understand exactly what it is you want to know.  The previous information in the topic is a question and answer about what kind of performance can be expected from the dataimport handler.  There's nothing about coding in it. Thanks, Shawn

Re: Dataimport performance

2018-06-07 Thread kotekaman
sorry. may i know how to code it? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

404 error on Solr 7.2.1 dataimport handler (on Windows via Cygwin)

2018-04-30 Thread PeterKerk
I'm running Solr 7.2.1 on Windows via Cygwin. I've installed Solr7.2.1 but I'm getting a 404 when trying to run the dataimport handler: http://localhost:8983/solr/tt-giftsamplecatalog/dataimport?command=full-import After calling this URL, I don't see any logging in the conso

Re: Uncheck dataimport checkboxes by default

2018-01-15 Thread Daniel Carrasco
; > > Hello, > > > > My question is just what I've summarized on the subject: Is there any way > > to change the default state of the checkboxes on dataimport admin page? > > > > I want to change the default state of the "clean" checkbox to uncheck >

Re: Uncheck dataimport checkboxes by default

2018-01-15 Thread Erick Erickson
your (presumed) screenshot is blank Best, Erick On Mon, Jan 15, 2018 at 2:30 AM, Daniel Carrasco wrote: > Hello, > > My question is just what I've summarized on the subject: Is there any way > to change the default state of the checkboxes on dataimport admin page? > >

Uncheck dataimport checkboxes by default

2018-01-15 Thread Daniel Carrasco
Hello, My question is just what I've summarized on the subject: Is there any way to change the default state of the checkboxes on dataimport admin page? I want to change the default state of the "clean" checkbox to uncheck because sometimes I import incremental data and I forgot

Re: SOLR nested dataimport issues

2017-12-18 Thread Emir Arnautović
Hi, I did not check it but it seems to me that it might be related to using full path in your fields xpath: you are iterating hash-es and you should probable set field paths assuming it is the new root. E.g. for id it would be: > HTH, Emir -- Monitoring - Log Management - Alerting - Anomaly Det

SOLR nested dataimport issues

2017-12-15 Thread Triveni
I am trying to import a nested xml using URLdatasource. But indexing is not happening. XML: ABC 1512016450886 XYZ access public access12 public12 My data-config.xml: http://abc:123/api/sample_api.xml"; processor="XPathEntityProcessor"

Re: Dataimport handler showing idle status with multiple shards

2017-12-05 Thread Sarah Weissman
From: Shawn Heisey Reply-To: "solr-user@lucene.apache.org" Date: Tuesday, December 5, 2017 at 1:31 PM To: "solr-user@lucene.apache.org" Subject: Re: Dataimport handler showing idle status with multiple shards On 12/5/2017 10:47 AM, Sarah Weissman wrote: I’ve rec

Re: Dataimport handler showing idle status with multiple shards

2017-12-05 Thread Shawn Heisey
On 12/5/2017 10:47 AM, Sarah Weissman wrote: I’ve recently been using the dataimport handler to import records from a database into a Solr cloud collection with multiple shards. I have 6 dataimport handlers configured on 6 different paths all running simultaneously against the same DB. I’ve

Dataimport handler showing idle status with multiple shards

2017-12-05 Thread Sarah Weissman
Hi, I’ve recently been using the dataimport handler to import records from a database into a Solr cloud collection with multiple shards. I have 6 dataimport handlers configured on 6 different paths all running simultaneously against the same DB. I’ve noticed that when I do this I often get

Re: Solr 7* Sorry, no dataimport-handler defined

2017-11-07 Thread Shawn Heisey
On 11/7/2017 6:49 AM, richardg wrote: > vs on the master that shows the error. > > 2017-11-07 13:29:14.131 INFO (qtp1839206329-36) [ > x:solr_aggregate_production] o.a.s.c.S.Request [solr_aggregate_production] > webapp=/solr path=/admin/mbeans > params={cat=QUERYHANDLER&wt=json&_=1510061366718}

Re: Solr 7* Sorry, no dataimport-handler defined

2017-11-07 Thread richardg
Yes I am referring to the dataimport tab in the admin UI and issue SOLR-10035. My previous setup w/ 6.3 did not show this error. I then upgraded to 7.1.0 and the error shows. I upgraded(downgraded) to versions 6.5.0 and 6.6.2 and I do not see the error. Version 7.0.1 also shows the error for

Re: Solr 7* Sorry, no dataimport-handler defined

2017-11-06 Thread Shawn Heisey
On 11/6/2017 4:26 PM, Shawn Heisey wrote: > If I start Solr "normally" or with the cloud example, then the > dataimport tab shows that error -- which is exactly as expected. I have opened an improvement issue so that particular error message isn't as vague.  It's

Re: Solr 7* Sorry, no dataimport-handler defined

2017-11-06 Thread Shawn Heisey
the admin UI when you click on dataimport.  The error is pretty self-explanitory -- Solr couldn't find any defined dataimport handlers.  At least one such handler must be set up in the config before you can use the dataimport tab. You mention that this was an issue with 6.4 and fixed ...

Solr 7* Sorry, no dataimport-handler defined

2017-11-06 Thread richardg
I see where this was an issue w/ 6.4 and fixed. I keep getting this error w/ 7.0.1 and 7.1.0. Works fine up until 6.6.2. Could this issue have been reintroduced? Is there somewhere to check what might be going on? I don't see anything in the error logs. -- Sent from: http://lucene.472066.n3

RE: DataImport Handler Out of Memory

2017-09-27 Thread Allison, Timothy B.
...@flexera.com] Sent: Wednesday, September 27, 2017 1:40 PM To: solr-user@lucene.apache.org Subject: DataImport Handler Out of Memory I am trying to create indexes using dataimport handler (Solr 5.2.1). Data is in mysql db and the number of records are more than 3.5 million. My solr server stops due to OOM

DataImport Handler Out of Memory

2017-09-27 Thread Deeksha Sharma
I am trying to create indexes using dataimport handler (Solr 5.2.1). Data is in mysql db and the number of records are more than 3.5 million. My solr server stops due to OOM (out of memory error). I tried starting solr by giving 12GB of RAM but still no luck. Also, I see that Solr fetches all

[bulk]: Re: Optimizing Dataimport from Oracle; cursor sharing; changing oracle session parameters

2017-08-17 Thread Mannott, Birgit
solr-user@lucene.apache.org Subject: [bulk]: RE: [bulk]: Re: Optimizing Dataimport from Oracle; cursor sharing; changing oracle session parameters Yes, I'm using Data Import Handler and I would prefer a solution for this way of import because it's already tested and the imported data is ok and

RE: Optimizing Dataimport from Oracle; cursor sharing; changing oracle session parameters

2017-08-15 Thread Phil Scadden
, only changed data is managed. -Original Message- From: Shawn Heisey [mailto:apa...@elyograg.org] Sent: Wednesday, 16 August 2017 5:42 a.m. To: solr-user@lucene.apache.org Subject: Re: Optimizing Dataimport from Oracle; cursor sharing; changing oracle session parameters On 8/15/2017 8:09

Re: Optimizing Dataimport from Oracle; cursor sharing; changing oracle session parameters

2017-08-15 Thread Walter Underwood
This might be a hack, but the CSV importer is really fast. Run the query in your favorite command line and export to CSV, then load it. You can even make batches. Maybe use ranges of the ID, then delete by query for that range. wunder Walter Underwood wun...@wunderwood.org http://observer.wunde

Re: Optimizing Dataimport from Oracle; cursor sharing; changing oracle session parameters

2017-08-15 Thread Shawn Heisey
On 8/15/2017 8:09 AM, Mannott, Birgit wrote: > I'm using solr 6.6.0 and I have to do a complex data import from an oracle db > concerning 3.500.000 data rows. > For each row I have 15 additional entities. That means that more than 52 > Million selects are send to the database. > For every select

Re: Optimizing Dataimport from Oracle; cursor sharing; changing oracle session parameters

2017-08-15 Thread Stefan Matheis
Birgit, any chance to utilise one of the caching strategies that DIH offers? Like building a complete map for one of the subentities? That would mean reading the whole table at the beginning and then only doing lookups by key. Or getting data from subentities with joins in your main entity? Hea

Re: [bulk]: Re: Optimizing Dataimport from Oracle; cursor sharing; changing oracle session parameters

2017-08-15 Thread David Hastings
t 15, 2017 4:33 PM > To: solr-user > Subject: [bulk]: Re: Optimizing Dataimport from Oracle; cursor sharing; > changing oracle session parameters > > I presume you're using Data Import Handler? An alternative when you get > into complex imports is to use a SolrJ client, here'

RE: [bulk]: Re: Optimizing Dataimport from Oracle; cursor sharing; changing oracle session parameters

2017-08-15 Thread Mannott, Birgit
Regards, Birgit -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Tuesday, August 15, 2017 4:33 PM To: solr-user Subject: [bulk]: Re: Optimizing Dataimport from Oracle; cursor sharing; changing oracle session parameters I presume you're using Dat

Re: Optimizing Dataimport from Oracle; cursor sharing; changing oracle session parameters

2017-08-15 Thread Erick Erickson
I presume you're using Data Import Handler? An alternative when you get into complex imports is to use a SolrJ client, here's a sample. That way you can use whatever tools the particular JDBC connector will allow and can be much faster. https://lucidworks.com/2012/02/14/indexing-with-solrj/ Best,

Optimizing Dataimport from Oracle; cursor sharing; changing oracle session parameters

2017-08-15 Thread Mannott, Birgit
Hi, I'm using solr 6.6.0 and I have to do a complex data import from an oracle db concerning 3.500.000 data rows. For each row I have 15 additional entities. That means that more than 52 Million selects are send to the database. For every select that is done I optimized the oracle execution path

Re: Different DateTime format in dataimport and index

2017-06-06 Thread SOLR4189
I don't use DB. I do dataimport from one collection of SOLR to another collection with the same configuration. -- View this message in context: http://lucene.472066.n3.nabble.com/Different-DateTime-format-in-dataimport-and-index-tp4339230p4339244.html Sent from the Solr - User mailing

Re: Different DateTime format in dataimport and index

2017-06-06 Thread Erick Erickson
name: pizza, pickupTime: 2017-06-06T19:00:00}* > and in reindex or dataimport I see in log: > *{id: test1, price: 100.0, name: pizza, pickupTime: Tue Jun 6 19:00:00 IDT > 2017}* > > Why do float and date have different format in index and dataimport? Is it > SOLR bug? > How can I

Different DateTime format in dataimport and index

2017-06-06 Thread SOLR4189
. So, my question is why in indexing of item I see in log: *{id: test1, price: 100, name: pizza, pickupTime: 2017-06-06T19:00:00}* and in reindex or dataimport I see in log: *{id: test1, price: 100.0, name: pizza, pickupTime: Tue Jun 6 19:00:00 IDT 2017}* Why do float and date have different format in

Re: Closed connection issue while doing dataimport

2017-04-02 Thread santosh sidnal
Thanks Shwan, that was good point to consider but we had porblem with holdability param in data-config.xml and Oracle 12c version of DB and client. BY remove Holdability parameter we are able to solve the issue. On 28 March 2017 at 18:19, Shawn Heisey wrote: > On 3/27/2017 7:13 PM, santosh sidn

Re: Closed connection issue while doing dataimport

2017-03-28 Thread Shawn Heisey
On 3/27/2017 7:13 PM, santosh sidnal wrote: > i am facing closed connection issue while doing dataimporter, any solution > to this> stack trace is as below > > > [3/27/17 8:54:41:399 CDT] 00b4 OracleDataSto > findMappingClass for : > Entry > java.sql.SQLRecover

Closed connection issue while doing dataimport

2017-03-27 Thread santosh sidnal
Hi All, i am facing closed connection issue while doing dataimporter, any solution to this> stack trace is as below [3/27/17 8:54:41:399 CDT] 00b4 OracleDataSto > findMappingClass for : Entry java.sql.SQLRecoverableException: Closed Connection at oracle.jdbc

Re: dataimport to a smaller Solr farm

2017-03-22 Thread Mikhail Khludnev
Hello, Dean. DIH is shard agnostic. How do you try to specify "a shard from the new collection"? On Tue, Mar 21, 2017 at 8:24 PM, deansg wrote: > Hello, > My team often uses the /dataimport & /dih handlers to move items from one > Solr collection to another. However, al

dataimport to a smaller Solr farm

2017-03-21 Thread deansg
Hello, My team often uses the /dataimport & /dih handlers to move items from one Solr collection to another. However, all the times we did that, the number of shards in the new collection was always the same or higher than in the old. Can /dataimport work if I have less shards in the

??????Aw: ??????Solr 5.5.0 Configure global jndi DS for dataimport

2017-02-07 Thread alias
???: "solr-user"; : Aw: ??Solr 5.5.0 Configure global jndi DS for dataimport Maybe someone is interested in solution: AND java:comp/env/jdbc/myds Both need the complete lookup name. Per > Gesendet: Dienstag, 07. Februar 2017 um 10:29 Uhr > Von: "Per Newgro

Aw: 回复:Solr 5.5.0 Configure global jndi DS for dataimport

2017-02-07 Thread Per Newgro
Maybe someone is interested in solution: AND java:comp/env/jdbc/myds Both need the complete lookup name. Per > Gesendet: Dienstag, 07. Februar 2017 um 10:29 Uhr > Von: "Per Newgro" > An: solr-user@lucene.apache.org > Betreff: Aw: 回复:Solr 5.5.0 Configure global

Aw: 回复:Solr 5.5.0 Configure global jndi DS for dataimport

2017-02-07 Thread Per Newgro
> Gesendet: Dienstag, 07. Februar 2017 um 10:02 Uhr > Von: alias <524839...@qq.com> > An: solr-user > Betreff: 回复:Solr 5.5.0 Configure global jndi DS for dataimport > > jndiName="java:comp/env/jdbc/myds" > > > -- 原始邮件 -- >

??????Solr 5.5.0 Configure global jndi DS for dataimport

2017-02-07 Thread alias
jndiName="java:comp/env/jdbc/myds" -- -- ??: "Per Newgro";; : 2017??2??7??(??) 4:47 ??: "solr-user-group"; : Solr 5.5.0 Configure global jndi DS for dataimport Hello, I would like to configur

Solr 5.5.0 Configure global jndi DS for dataimport

2017-02-07 Thread Per Newgro
Hello, I would like to configure a JNDI datasource for use in dataimport. From the documentation it shall be possible and easy. My environment: Debian OpenJDK Runtime Environment (build 1.8.0_111-8u111-b14-2~bpo8+1-b14) Solr 5.5.0 downloaded and installed as service in /opt/solr Installed core

Re: no dataimport-handler defined!

2017-01-26 Thread Shawn Heisey
On 1/26/2017 7:44 AM, Chris Rogers wrote: > Just tested the DIH example in 6.4 (bin/solr -e dih) > > Getting the same “No dataimport-handler defined!” for every one of the cores > installed as part of the example. Repeating a reply already posted elsewhere on this thread: It

Re: no dataimport-handler defined!

2017-01-26 Thread Alexandre Rafalovitch
Solr users, new and experienced On 26 January 2017 at 09:44, Chris Rogers wrote: > Hi Alex, > > Just tested the DIH example in 6.4 (bin/solr -e dih) > > Getting the same “No dataimport-handler defined!” for every one of the cores > installed as part of the example. > > Che

Re: no dataimport-handler defined!

2017-01-26 Thread Chris Rogers
Hi Alex, Just tested the DIH example in 6.4 (bin/solr -e dih) Getting the same “No dataimport-handler defined!” for every one of the cores installed as part of the example. Cheers, Chris On 24/01/2017, 15:07, "Alexandre Rafalovitch" wrote: Strange. If you run a pre

Re: no dataimport-handler defined!

2017-01-25 Thread sudhi
-dataimport-handler-defined-tp4315520p4315787.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: no dataimport-handler defined!

2017-01-25 Thread Shawn Heisey
s. It just says “Sorry, no dataimport-handler defined” in the SOLR > admin UI. A user on the IRC channel has run into what seems to be the same problem. This bug is caused by a change in the SolrInfoMBean class, part of some cleanup for new metrics. The output of the handler that normally live

Re: no dataimport-handler defined!

2017-01-24 Thread Alexandre Rafalovitch
r users, new and experienced > > > On 24 January 2017 at 07:43, Chris Rogers > wrote: > > Hi all, > > > > Having frustrating issues with getting SOLR 6.4.0 to recognize the > existence of my DIH config. I’m using Oracle Java8 jdk on Ubuntu 14.04.

Re: no dataimport-handler defined!

2017-01-24 Thread Chris Rogers
gt; The DIH .jar file appears to be loading correctly. There are no errors in the SOLR logs. It just says “Sorry, no dataimport-handler defined” in the SOLR admin UI. > > My config files are listed below. Can anyone spot any mistakes here?

Re: no dataimport-handler defined!

2017-01-24 Thread Chris Rogers
> Hi all, > > Having frustrating issues with getting SOLR 6.4.0 to recognize the existence of my DIH config. I’m using Oracle Java8 jdk on Ubuntu 14.04. > > The DIH .jar file appears to be loading correctly. There are no errors in the SOLR logs. It just says “Sorry, no dataimpor

Re: no dataimport-handler defined!

2017-01-24 Thread Alexandre Rafalovitch
just says “Sorry, no dataimport-handler defined” in the SOLR > admin UI. > > My config files are listed below. Can anyone spot any mistakes here? > > Many thanks, > Chris > > # solrconfig.xml ## > >regex=

no dataimport-handler defined!

2017-01-24 Thread Chris Rogers
Hi all, Having frustrating issues with getting SOLR 6.4.0 to recognize the existence of my DIH config. I’m using Oracle Java8 jdk on Ubuntu 14.04. The DIH .jar file appears to be loading correctly. There are no errors in the SOLR logs. It just says “Sorry, no dataimport-handler defined” in the

Re: Retaining a field value during DataImport

2016-09-26 Thread Selvam
Hi, Thanks, I will look into options specified. On Mon, Sep 26, 2016 at 4:35 PM, Alexandre Rafalovitch wrote: > Transformers do not see what's in the Solr index, they are too early > in the processing chain. > > You could probably do something by exporting that field's value, > caching it and

Re: Retaining a field value during DataImport

2016-09-26 Thread Alexandre Rafalovitch
Transformers do not see what's in the Solr index, they are too early in the processing chain. You could probably do something by exporting that field's value, caching it and injecting it back with transformer from that cache. Messy but doable. UpdateRequestProcessor would be able to do it, but yo

Retaining a field value during DataImport

2016-09-26 Thread Selvam
Hi All, We use DataImportHandler to import data from Redshift. We want to overwrite some 250M existing records (that has around 350 columns) while retaining the field value of only one column in those 250M records. The reason is, that one column is a multi-valued and requires a costly query to bui

Solr : DataImport failed from Cassandra due to TimedOut Exception

2016-09-21 Thread saravanan
data-config.xml Thanks Saravanan -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-DataImport-failed-from-Cassandra-due-to-TimedOut-Exception-tp4297088.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: DataImport-Solr6: Nested Entities

2016-08-19 Thread Shawn Heisey
On 8/18/2016 5:10 PM, Peri Subrahmanya wrote: > Hi, > > I have a simple one-to-many relationship setup in the data-import.xml and > when I try to index it using the dataImportHandler, Solr complains of “no > unique id found”. > > managed-schema.xml > id > solrconfig,xml: > > > id > >

Re: DataImport-Solr6: Nested Entities

2016-08-18 Thread Alexandre Rafalovitch
Well, do both parent and child entity have a field called 'id' containing their corresponding unique ids? That would be the first step. Regards, Alex. Newsletter and resources for Solr beginners and intermediates: http://www.solr-start.com/ On 19 August 2016 at 09:10, Peri Subrahmanya w

DataImport-Solr6: Nested Entities

2016-08-18 Thread Peri Subrahmanya
Hi, I have a simple one-to-many relationship setup in the data-import.xml and when I try to index it using the dataImportHandler, Solr complains of “no unique id found”. managed-schema.xml id solrconfig,xml: id data-import.xml

Re: trying DIH but get 'Sorry, no dataimport-handler defined!'

2016-05-24 Thread scott.chu
and everything is ok now! TOO WEIRD! scott.chu,scott@udngroup.com 2016/5/24 (週二) - Original Message - From: kostali hassan To: solr-user ; scott(自己) CC: Date: 2016/5/24 (週二) 16:55 Subject: Re: trying DIH but get 'Sorry, no dataimport-handler defined!' if you have in

Re: trying DIH but get 'Sorry, no dataimport-handler defined!'

2016-05-24 Thread kostali hassan
9:24,781 INFO (coreLoadExecutor-6-thread-1) [ ] > o.a.s.c.SolrResourceLoader Adding > 'file:/D:/portable_sw/solr-6.0.0/dist/solr-dataimporthandler-extras-6.0.0.jar' > to classloader > > * So I think dih jars are loaded ok. > > I go to localhost:893 in browser and select core 'testdih', then click > 'DataImport' item but rightpane shows "Sorry, no dataimport-handler > defined!". > > What do I miss? > > > scott.chu,scott@udngroup.com > 2016/5/24 (週二) >

Re: trying DIH but get 'Sorry, no dataimport-handler defined!'

2016-05-24 Thread scott.chu
6/5/24 (週二) 16:35 Subject: trying DIH but get 'Sorry, no dataimport-handler defined!' I do following things: * I create folder : D:\solr-6.0.0\myconfigsets\testdih. * Copy D:\portable_sw\solr-6.0.0\example\example-DIH\solr\db\conf to D:\solr-6.0.0\myconfigsets\testdih. * G

trying DIH but get 'Sorry, no dataimport-handler defined!'

2016-05-24 Thread scott.chu
INFO (coreLoadExecutor-6-thread-1) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/D:/portable_sw/solr-6.0.0/dist/solr-dataimporthandler-extras-6.0.0.jar' to classloader * So I think dih jars are loaded ok. I go to localhost:893 in browser and select core 'testdih', then click 'DataImport

RE: dataimport db-data-config.xml

2016-04-29 Thread Davis, Daniel (NIH/NLM) [C]
om: kishor [mailto:krajus...@gmail.com] Sent: Friday, April 29, 2016 4:58 AM To: solr-user@lucene.apache.org Subject: dataimport db-data-config.xml I want to import data from mysql-table and csv file ata the same time beacuse some data are in mysql tables and some are in csv file . I want to ma

dataimport db-data-config.xml

2016-04-29 Thread kishor
.nabble.com/dataimport-db-data-config-xml-tp4270673p4273614.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: dataimport db-data-config.xml

2016-04-17 Thread Reth RM
ot;TemplateTransformer"> > > template="user1-${user1.id}"/> > > > This code is not working please suggest any more example > > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/dataimport-db-data-config-xml-tp4270673.html > Sent from the Solr - User mailing list archive at Nabble.com. >

dataimport db-data-config.xml

2016-04-15 Thread kishor
.472066.n3.nabble.com/dataimport-db-data-config-xml-tp4270673.html Sent from the Solr - User mailing list archive at Nabble.com.

dataimport db-data-config.xml

2016-04-15 Thread kishor
.472066.n3.nabble.com/dataimport-db-data-config-xml-tp4270674.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Not able to do DataImport from MSSQL server to solr server

2016-03-14 Thread Shawn Heisey
On 3/14/2016 2:31 AM, Adi@GTN wrote: > Am using the below config details in order to connect the database, and pull > the query but in the connection details it is mentioned as > authenticateMethod=ntlm, am bit confused here am not sure what is this > authentication method, now am not able to conne

Not able to do DataImport from MSSQL server to solr server

2016-03-14 Thread Adi@GTN
debug and understand what is the username it is being used in-order to connect the database. Can anyone help me understanding and give some inputs on how to debug. Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/Not-able-to-do-DataImport-from-MSSQL-server-to

Re: sorry, no dataimport-handler defined!

2016-02-03 Thread kostali hassan
onfig.xml by default. > > > > But before we go into details, what are you trying to accomplish with > Solr? > > > > -Original Message- > > From: Jean-Jacques MONOT [mailto:jj_mo...@yahoo.fr] > > Sent: Monday, February 01, 2016 2:31 PM > > To: s

Re: sorry, no dataimport-handler defined!

2016-02-02 Thread Jean-Jacques Monot
he.org > Subject: Potential SPAM:sorry, no dataimport-handler defined! > > Hello > > I am using SOLR 5.4.1 and the graphical admin UI. > > I successfully created multiples cores and indexed various documents, using > in line commands : (create -c) and (post.jar) o

sorry, no dataimport-handler defined!

2016-02-02 Thread Davis, Daniel (NIH/NLM) [C]
: Jean-Jacques MONOT [mailto:jj_mo...@yahoo.fr] Sent: Monday, February 01, 2016 2:31 PM To: solr-user@lucene.apache.org Subject: Potential SPAM:sorry, no dataimport-handler defined! Hello I am using SOLR 5.4.1 and the graphical admin UI. I successfully created multiples cores and indexed various

Re: sorry, no dataimport-handler defined!

2016-02-01 Thread Susheel Kumar
UI. > > I successfully created multiples cores and indexed various documents, > using in line commands : (create -c) and (post.jar) on W10. > > But in the GUI, when I click on "Dataimport", I get the following message > : "sorry, no dataimport-handler defined!"

sorry, no dataimport-handler defined!

2016-02-01 Thread Jean-Jacques MONOT
Hello I am using SOLR 5.4.1 and the graphical admin UI. I successfully created multiples cores and indexed various documents, using in line commands : (create -c) and (post.jar) on W10. But in the GUI, when I click on "Dataimport", I get the following message : "sorry, no dat

Re: Many files /dataImport in same project

2015-11-03 Thread Alexandre Rafalovitch
On 3 November 2015 at 10:38, Gora Mohanty wrote: >> I missed previous discussions, but the DIH config file is given in a >> query parameter. So, if there is a bunch of them on a file system, one >> could probably do >> find . - name "*.dihconf" | xargs curl . > > Sorry, I might be missing some

Re: Many files /dataImport in same project

2015-11-03 Thread Gora Mohanty
On 3 November 2015 at 21:25, Alexandre Rafalovitch wrote: > On 3 November 2015 at 10:38, Gora Mohanty wrote: >>> I missed previous discussions, but the DIH config file is given in a >>> query parameter. So, if there is a bunch of them on a file system, one >>> could probably do >>> find . - name

Re: Many files /dataImport in same project

2015-11-03 Thread Gora Mohanty
On 2 November 2015 at 22:38, Alexandre Rafalovitch wrote: > On 2 November 2015 at 11:30, Gora Mohanty wrote: >> As per my last >> follow-up, there is currently no way to have DIH automatically pick up >> different data-config files without manually editing the DIH >> configuration each time. > >

Re: Many files /dataImport in same project

2015-11-03 Thread Erick Erickson
ata-import? > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Many-files-dataImport-in-same-project-tp4237731p4237868.html > Sent from the Solr - User mailing list archive at Nabble.com.

Re: Many files /dataImport in same project

2015-11-03 Thread fabigol
-dataImport-in-same-project-tp4237731p4237868.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Many files /dataImport in same project

2015-11-03 Thread fabigol
ed to launch after each other. So exite there a way to launch to launch 6 once. Thank you still hoping to have been clear enough. thank a lot -- View this message in context: http://lucene.472066.n3.nabble.com/Many-files-dataImport-in-same-project-tp4237731p4237865.html Sent from the Solr - User ma

Re: Many files /dataImport in same project

2015-11-02 Thread Alexandre Rafalovitch
On 2 November 2015 at 11:30, Gora Mohanty wrote: > As per my last > follow-up, there is currently no way to have DIH automatically pick up > different data-config files without manually editing the DIH > configuration each time. I missed previous discussions, but the DIH config file is given in a

Re: Many files /dataImport in same project

2015-11-02 Thread Gora Mohanty
On 2 November 2015 at 21:50, fabigol wrote: > Hi, > i have many files of config dataImport > I want to start at once instead of launching DataImport for each file. > is it possible?? Not to be antagonistic, but did you not ask this before, and have various people not tried to hel

  1   2   3   4   5   >