, 2017 2:12 PM
To: 'solr-user@lucene.apache.org'
Subject: RE: DIH issue with streaming xml file
Thank you for your response. I will look into this link. Also, sorry I did
not specify the file type. I am working with XML files.
~~~
William Kevin Miller
ECS Fe
[mailto:arafa...@gmail.com]
Sent: Monday, June 12, 2017 1:26 PM
To: solr-user
Subject: Re: DIH issue with streaming xml file
Solr 6.5.1 DIH setup has - somewhat broken - RSS example (redone as ATOM
example in 6.6) that shows how to get stuff from https URL. You can see the
atom example here:
https
reate a custom entity processor?
>
>
>
>
> ~~~
> William Kevin Miller
>
> ECS Federal, Inc.
> USPS/MTSC
> (405) 573-2158
>
>
> -Original Message-
> From: Alexandre Rafalovitch [mailto:arafa...@gmail.com]
> Sent: Monday, June 12, 2017 12:57 PM
> To: solr-user
>
) 573-2158
-Original Message-
From: Alexandre Rafalovitch [mailto:arafa...@gmail.com]
Sent: Monday, June 12, 2017 12:57 PM
To: solr-user
Subject: Re: DIH issue with streaming xml file
How do you get a list of URLs for the files on the remote server? That's
probably the first issue. Once you have
How do you get a list of URLs for the files on the remote server? That's
probably the first issue. Once you have the URLs in an outside entity or
two, you can feed them one by one into the inner entity.
Regards,
Alex.
http://www.solr-start.com/ - Resources for Solr users, new and experien
I am using Solr 6.5.1 and working on importing xml files using the
DataImportHandler. I am wanting to get the files from a remote server, but I
am dealing with multiple xml files in multiple folders. I am using a nested
entity in my dataConfig. Below is an example of how I have my dataConfig
Yes Upayavira, that's exactly what prompted me to ask Erick as soon as I
read https://cwiki.apache.org/confluence/display/solr/Config+Sets
Erick, Regarding my delta-import not working I do see the
dataimport.properties in zookeeper. after I "upconfig" and "linkconfig" my
conf files into ZK...see b
It is worth noting that the ref guide page on configsets refers to
non-cloud mode (a useful new feature) whereas people may confuse this
with configsets in cloud mode, which use Zookeeper.
Upayavira
On Sun, Sep 20, 2015, at 04:59 AM, Ravi Solr wrote:
> Cant thank you enough for clarifying it at
Cant thank you enough for clarifying it at length. Yeah its pretty
confusing even for experienced Solr users. I used the upconfig and
linkconfig commands to update 4 collections into zookeeper...As you
described, I lucked out as I used the same name for configset and the
collection and hence did no
Let's back up a second. Configsets are what _used_ to be in the conf
directory for each core on a local drive, it's just that they're now
kept up on Zookeeper. Otherwise, you'd have to put them on each
instance in SolrCloud, and bringing up a new replica on a new machine
would look a lot like addin
Thanks Erick, I will report back once the reindex is finished. Oh, your
answer reminded me of another question - Regarding configsets the
documentation says
"On a multicore Solr instance, you may find that you want to share
configuration between a number of different cores."
Can the same be used
Just pushing up the entire configset would be easiest, but the
Zookeeper command line tools allow you to push up a single
file if you want.
Yeah, it puzzles me too that the import worked yesterday, not really
sure what happened, the file shouldn't just disappear
Erick
On Sat, Sep 19, 2015 at
Thank you for the prompt response Erick. I did a full-import yesterday, you
are correct that I did not push dataimport.properties to ZK, should it have
not worked even for a full import ?. You may be right about 'clean' option,
I will reindex again today. BTW how do we push a single file to a speci
Could not read DIH properties from /configs/sitesearchcore/dataimport.properties
This looks like somehow you didn't push this file up to Zookeeper. You
can check what files are there in the admin UI. How you indexed
yesterday is a mystery though, unless somehow this file was removed
from ZK.
As f
I am facing a weird problem. As part of upgrade from 4.7.2 (Master-Slave)
to 5.3.0 (Solrcloud) I re-indexed 1.5 million records via DIH using
SolrEntityProcessor yesterday, all of them indexed properly. Today morning
I just ran the DIH again with delta import and I lost all docs...what am I
missing
Seems like the issue got fixed after I updated my import query to the following;
On May 31, 2014, at 9:24 AM, PeriS wrote:
> db-import.xml:
>
> query="SELECT p.person_id, p.details, p.authz_id,
> p.last_modified, a.address_info from person p, address a where p.pe
db-import.xml:
schema.xml:
person_id
Thanks
Peri
On May 31, 2014, at 8:05 AM, Ahmet Arslan wrote:
> Hi,
>
> Did you restart solr? Can you paste relevant portions of data-config.xml and
> schema.xml?
>
>
>
> On Saturday, May 31, 2014 3:46 AM, PeriS wrote:
> I added the prima
Hi,
Did you restart solr? Can you paste relevant portions of data-config.xml and
schema.xml?
On Saturday, May 31, 2014 3:46 AM, PeriS wrote:
I added the primaryKey as the and still same result.
On May 30, 2014, at 8:38 PM, Ahmet Arslan wrote:
> Hi,
>
> Sure, have a look at definition i
I added the primaryKey as the and still same result.
On May 30, 2014, at 8:38 PM, Ahmet Arslan wrote:
> Hi,
>
> Sure, have a look at definition in example schema.xml
>
> http://wiki.apache.org/solr/UniqueKey
>
>
>
>
> On Saturday, May 31, 2014 3:35 AM, PeriS wrote:
> No. Is there a wa
Hi,
Sure, have a look at definition in example schema.xml
http://wiki.apache.org/solr/UniqueKey
On Saturday, May 31, 2014 3:35 AM, PeriS wrote:
No. Is there a way to have the primary key of my entity be the unique key?
On May 30, 2014, at 7:00 PM, Ahmet Arslan wrote:
> Hi,
>
> Do you
No. Is there a way to have the primary key of my entity be the unique key?
On May 30, 2014, at 7:00 PM, Ahmet Arslan wrote:
> Hi,
>
> Do you have uniqueKey defined in schema.xml ?
>
>
>
> On Saturday, May 31, 2014 1:23 AM, PeriS wrote:
> Hi,
>
> I have followed the documentation to set up
Hi,
Do you have uniqueKey defined in schema.xml ?
On Saturday, May 31, 2014 1:23 AM, PeriS wrote:
Hi,
I have followed the documentation to set up my delta query, but when I call the
delta-import, the index is happening again for the same record and ends up
being indexed twice. Any clues pl
Hi,
I have followed the documentation to set up my delta query, but when I call the
delta-import, the index is happening again for the same record and ends up
being indexed twice. Any clues please?
Thanks
-Peri
*** DISCLAIMER *** This is a PRIVATE message. If you are not the intended
rec
66.n3.nabble.com/DIH-Issue-newbie-to-solr-tp2695407p2758500.html
Sent from the Solr - User mailing list archive at Nabble.com.
On Mon, Mar 21, 2011 at 10:59 PM, neha wrote:
> Thanks Gora it works..!!! Thanks again. One last question, the documents get
> indexed well and all but when I issue full-import command it still says
> Total Requests made to DataSource 0
[...]
Not sure why that is, but would guess that it is somet
.nabble.com/DIH-Issue-newbie-to-solr-tp2695407p2710876.html
Sent from the Solr - User mailing list archive at Nabble.com.
Thanks Gora...it works.. Thanks again..:)
Neha
--
View this message in context:
http://lucene.472066.n3.nabble.com/DIH-Issue-newbie-to-solr-tp2695407p2710864.html
Sent from the Solr - User mailing list archive at Nabble.com.
On Mon, Mar 21, 2011 at 9:45 PM, neha wrote:
> Hi Gora,
> The absolute path solved the issue, but in a weird situation though.
Great. That should be most of your issue solved.
>
> The
> index files are
creating anew project /test/solr/ I copied the data
directory from /example/solr/data/index. DO you think that is causing an
issue, if yes what needs to be changed.
Thanks,
Neha
--
View this message in context:
http://lucene.472066.n3.nabble.com/DIH-Issue-newbie-to-solr-tp2695407p2710560.html
In general, it works best to start with one of the examples and slowly
change it to match what you want.
On Sun, Mar 20, 2011 at 10:16 PM, Gora Mohanty wrote:
> (Sorry for the delay in replying: Was a little busy this weekend.)
> On Sun, Mar 20, 2011 at 5:20 AM, neha wrote:
>> The path is correc
(Sorry for the delay in replying: Was a little busy this weekend.)
On Sun, Mar 20, 2011 at 5:20 AM, neha wrote:
> The path is correct and also the base dir points to the list of .xml files
> not just a single file.
OK.
> This is the link to the xml file:
Another thing that I see is that the xpa
The path is correct and also the base dir points to the list of .xml files
not just a single file.
This is the link to the xml file:
http://pastebin.com/7EzRUj9L
Thanks,
Neha
--
View this message in context:
http://lucene.472066.n3.nabble.com/DIH-Issue-newbie-to-solr-tp2695407p2704182.html
On Fri, Mar 18, 2011 at 11:52 PM, neha wrote:
> Here are the links to the file
[...]
> Data-config.xml
>
> http://pastebin.com/ncXr1LzV
[...]
One thing that immediately jumps out is the baseDir
attribute in your top-level entry. You have
baseDir=/local/home/abc/ruby/Solr/apache-solr-1.4.1/example
erProperties
INFO: Read dataimport.properties
Mar 17, 2011 5:08:20 PM org.apache.solr.handler.dataimport.SolrWriter
persist
INFO: Wrote last indexed time to dataimport.properties
Mar 17, 2011 5:08:20 PM org.apache.solr.handler.dataimport.DocBuilder
execute
INFO: Time taken = 0:0:0.24
##
On Fri, Mar 18, 2011 at 2:45 AM, neha wrote:
> I am a newbie to solr I have an issue with DIH but unable to pinpoint what is
> causing the issue. I am using the demo jetty installation of Solr and tried
> to create a project with new schema.xml, solrconfig.xml and data-config.xml
> files. when I r
ob/master/solr/conf/schema.xml
https://github.com/projectblacklight/blacklight-jetty/blob/master/solr/conf/solrconfig.xml
data-config.xml file
#
-
##
PLease help me with this issue.
Thanks,
Neha
--
View this message in
solr document.
Thanks,
Barani
--
View this message in context:
http://old.nabble.com/DIH-Issue-in-Delta-Query-tp27714483p27714483.html
Sent from the Solr - User mailing list archive at Nabble.com.
37 matches
Mail list logo
