Re: Can't Get Past Step 2 in the Tutorial

[Mauricio Scheffer]

The error says that port 8983 is already in use by some other application.
Try some other port:

java -Djetty.port=8984 -jar start.jar

--
Mauricio


On Mon, Aug 29, 2011 at 10:39 PM, Waldo Jaquith  wrote:

> Howdy,
>
> I’m having an incredibly frustrating time getting started with Solr. I’ve
> got a relatively fresh Slicehost server, running CentOS 5.3. I followed the
> instructions in the tutorial [1], installing Oracle Java JDK as per [2], and
> got only as far as “java -jar start.jar.” (You can see the output of that at
> the bottom of my e-mail.) Now if I open up
> http://localhost:8983/solr/admin/ , I get a 404 from “Jetty://“, saying
> "Problem accessing /solr/admin/. Reason: NOT_FOUND.” I have no idea of what
> to do with this. I have zero experience with Solr. I figured the surest way
> to see if it was something I wanted to use was to just try it, and obviously
> that hasn’t gone very well.
>
> Note that I have zero experience with Java, other than finding that every
> interaction with it over the past 15 years has deepened my loathing for it.
> Assume that I know nothing about Java and you will overestimate me. I’m only
> e-mailing y’all because I was bitching about this on Twitter after a couple
> of hours or attempting to make this work, and a couple of people encouraged
> me to just try querying this list before nuking Java from orbit, having a
> few stiff drinks, and forgetting that this ever happened.
>
> Any suggestions?
>
> Best,
> Waldo
>
>
> [1] http://lucene.apache.org/solr/tutorial.html
> [2]
> http://www.if-not-true-then-false.com/2010/install-sun-oracle-java-jdk-jre-7-on-fedora-centos-red-hat-rhel/
>
>
>
> $ java -jar start.jar
> 2011-08-29 20:50:51.876:INFO::Logging to STDERR via
> org.mortbay.log.StdErrLog
> 2011-08-29 20:50:52.061:INFO::jetty-6.1-SNAPSHOT
> Aug 29, 2011 8:50:52 PM org.apache.solr.core.SolrResourceLoader
> locateSolrHome
> INFO: JNDI not configured for solr (NoInitialContextEx)
> Aug 29, 2011 8:50:52 PM org.apache.solr.core.SolrResourceLoader
> locateSolrHome
> INFO: solr home defaulted to 'solr/' (could not find system property or
> JNDI)
> Aug 29, 2011 8:50:52 PM org.apache.solr.core.SolrResourceLoader 
> INFO: Solr home set to 'solr/'
> Aug 29, 2011 8:50:52 PM org.apache.solr.servlet.SolrDispatchFilter init
> INFO: SolrDispatchFilter.init()
> Aug 29, 2011 8:50:52 PM org.apache.solr.core.SolrResourceLoader
> locateSolrHome
> INFO: JNDI not configured for solr (NoInitialContextEx)
> Aug 29, 2011 8:50:52 PM org.apache.solr.core.SolrResourceLoader
> locateSolrHome
> INFO: solr home defaulted to 'solr/' (could not find system property or
> JNDI)
> Aug 29, 2011 8:50:52 PM org.apache.solr.core.CoreContainer$Initializer
> initialize
> INFO: looking for solr.xml:
> /home/waldo/apache-solr-3.3.0/example/solr/solr.xml
> Aug 29, 2011 8:50:52 PM org.apache.solr.core.SolrResourceLoader
> locateSolrHome
> INFO: JNDI not configured for solr (NoInitialContextEx)
> Aug 29, 2011 8:50:52 PM org.apache.solr.core.SolrResourceLoader
> locateSolrHome
> INFO: solr home defaulted to 'solr/' (could not find system property or
> JNDI)
> Aug 29, 2011 8:50:52 PM org.apache.solr.core.CoreContainer 
> INFO: New CoreContainer: solrHome=solr/ instance=493847021
> Aug 29, 2011 8:50:52 PM org.apache.solr.core.SolrResourceLoader 
> INFO: Solr home set to 'solr/'
> Aug 29, 2011 8:50:52 PM org.apache.solr.core.SolrResourceLoader 
> INFO: Solr home set to 'solr/./'
> Aug 29, 2011 8:50:52 PM org.apache.solr.core.SolrConfig initLibs
> INFO: Adding specified lib dirs to ClassLoader
> Aug 29, 2011 8:50:52 PM org.apache.solr.core.SolrResourceLoader
> replaceClassLoader
> INFO: Adding
> 'file:/home/waldo/apache-solr-3.3.0/contrib/extraction/lib/jempbox-LICENSE-ASL.txt'
> to classloader
> Aug 29, 2011 8:50:52 PM org.apache.solr.core.SolrResourceLoader
> replaceClassLoader
> INFO: Adding
> 'file:/home/waldo/apache-solr-3.3.0/contrib/extraction/lib/tika-parsers-LICENSE-ASL.txt'
> to classloader
> Aug 29, 2011 8:50:52 PM org.apache.solr.core.SolrResourceLoader
> replaceClassLoader
> INFO: Adding
> 'file:/home/waldo/apache-solr-3.3.0/contrib/extraction/lib/poi-ooxml-LICENSE-ASL.txt'
> to classloader
> Aug 29, 2011 8:50:52 PM org.apache.solr.core.SolrResourceLoader
> replaceClassLoader
> INFO: Adding
> 'file:/home/waldo/apache-solr-3.3.0/contrib/extraction/lib/tika-parsers-0.8.jar'
> to classloader
> Aug 29, 2011 8:50:52 PM org.apache.solr.core.SolrResourceLoader
> replaceClassLoader
> INFO: Adding
> 'file:/home/waldo/apache-solr-3.3.0/contrib/extraction/lib/bcmail-NOTICE.txt'
> to classloader
> Aug 29, 2011 8:50:52 PM org.apache.solr.core.SolrResourceLoader
> replaceClassLoader
> INFO: Adding
> 'file:/home/waldo/apache-solr-3.3.0/contrib/extraction/lib/pdfbox-1.3.1.jar'
> to classloader
> Aug 29, 2011 8:50:52 PM org.apache.solr.core.SolrResourceLoader
> replaceClassLoader
> INFO: Adding
> 'file:/home/waldo/apache-solr-3.3.0/contrib/extraction/lib/poi-ooxml-schemas-NOTICE.txt'
> to classloader
> Aug 29, 2011 8:5

Re: Solr and DateTimes - bug?

[Mauricio Scheffer]

Hi Nicklas,
Use a nullable DateTime type instead of MinValue. It's semantically more
correct, and SolrNet will do the right mapping.
I also heard that Mono had a bug in date parsing, it didn't behave just like
.NET :
https://github.com/mausch/SolrNet/commit/f3a76ea5535633f4b301e644e25eb2dc7f0cb7ef
IIRC this bug was fixed in Mono 2.10 or so, so make sure you're running the
latest version.
Finally, there's a specific mailing list for questions about SolrNet:
http://groups.google.com/group/solrnet

Cheers,
Mauricio



On Mon, Sep 12, 2011 at 7:54 AM, Nicklas Overgaard wrote:

> I see. I'm using that date to flag that my entity "has not yet ended". I
> can just use another constant which Solr is capable of returning in the
> correct format. The nice thing about DateTime.MinValue is that it's just
> part of the .net framework :)
>
> Hope that the issue is resolved at some point.
>
> I'm wondering if it would be possible for you (or someone else) to fix the
> issue with years from 1 to 999 being formatted incorrectly, and then
> creating a new ticket for the issue with negative years?
>
> Best regards,
>
> Nicklas
>
>
> On 2011-09-12 07:02, Chris Hostetter wrote:
>
>> : The XML output when performing a query via the solr interface is like
>> this:
>> :1-01-**01T00:00:00Z
>>
>> i think you mean:1-01-01T00:00:**00Z
>>
>> :>  >  So my question is: Is this a bug in the solr output engine, or
>> should mono
>> :>  >  be able to parse the date as given from solr? I have not yet tried
>> it out
>> :>  >  on .net as I do not have access to a windows machine at the moment.
>>
>> it is in fact a bug in Solr that not a lot of people have been overly
>> concerned with some most people don't deal with dates that far back
>>
>> https://issues.apache.org/**jira/browse/SOLR-1899
>>
>> ...I spent a little time working on it at one point but got side tracked
>> by other things since there are a coupld of related issues with the
>> canonical iso8601 date format arround year "0" that made it non obvious
>> what hte "ideal" solution was.
>>
>> -Hoss
>>
>
>

Re: term vector parser in solr.NET

[Mauricio Scheffer]

TermVectorComponent support is a pending issue:
http://code.google.com/p/solrnet/issues/detail?id=68

Please use the SolrNet mailing list for specific questions about it:
http://groups.google.com/group/solrnet

Cheers,
Mauricio


On Mon, Sep 19, 2011 at 7:33 AM, jame vaalet  wrote:

> hi,
> i was wondering if there is any method to get back the term vector list
> from
> solr through solr.NET?
> from the source code for SOLR.NET i couldn't notice any term vector parser
> in SOLR.NET .
>
> --
>
> -JAME
>

Re: Too long to index PDF - SOLR 3.5, SOLRNet 0.4.0.2001, Tom Cat 7.0

[Mauricio Scheffer]

Try setting the StreamType to application/pdf, that way Tika doesn't have
to infer it.
BTW the second argument to ExtractParameters is the unique key... a value
of "*" probably doesn't make sense.

--
Mauricio


On Wed, Dec 7, 2011 at 5:50 PM, Soumitra Banerjee <
soumitrabaner...@gmail.com> wrote:

> All -
>
> I am using SOLR 3.5, SOLRNet 0.4.0.2001, Tom Cat 7.0 and am running a job
> to extract the text from pds, stored on my local hard disk.
>
> *Tomcat StdErr log Shows:*
>
> INFO: [core1] webapp=/Solr path=/update/extract params={extractOnly=true&
> literal.id=*&resource.name
> =C:\XXX\10310.pdf&extractFormat=text&version=2.2}
> status=0 QTime=125
> Dec 7, 2011 12:29:36 PM org.apache.solr.update.processor.LogUpdateProcessor
> finish
> INFO: {} 0 141
> Dec 7, 2011 12:29:36 PM org.apache.solr.core.SolrCore execute
> INFO: [core1] webapp=/Solr path=/update/extract params={extractOnly=true&
> literal.id=*&resource.name=C:XXX\10311.pdf&extractFormat=text&version=2.2}
> status=0 QTime=141
> Dec 7, 2011 12:29:36 PM org.apache.solr.update.processor.LogUpdateProcessor
> finish
> INFO: {} 0 125
> Dec 7, 2011 12:29:36 PM org.apache.solr.core.SolrCore execute
> INFO: [core1] webapp=/Solr path=/update/extract params={extractOnly=true&
> literal.id=*&resource.name
> =C:\XXX\3M_US_EN_10313.pdf&extractFormat=text&version=2.2}
> status=0 QTime=125
>
> *Catalina Log Shows:*
> **
> INFO: {} 0 281
> Dec 7, 2011 12:29:04 PM org.apache.solr.core.SolrCore execute
> INFO: [core1] webapp=/Solr path=/update/extract params={extractOnly=true&
> literal.id=*&resource.name
> =C:\XXX\11511.pdf&extractFormat=text&version=2.2}
> status=0 QTime=281
> Dec 7, 2011 12:29:05 PM org.apache.solr.update.processor.LogUpdateProcessor
> finish
> INFO: {} 0 391
> Dec 7, 2011 12:29:05 PM org.apache.solr.core.SolrCore execute
> INFO: [core1] webapp=/Solr path=/update/extract params={extractOnly=true&
> literal.id=*&resource.name
> =C:XXX\_11513.pdf&extractFormat=text&version=2.2}
> status=0 QTime=391
> Dec 7, 2011 12:29:05 PM org.apache.solr.update.processor.LogUpdateProcessor
> finish
> INFO: {} 0 328
> Dec 7, 2011 12:29:05 PM org.apache.solr.core.SolrCore execute
> INFO: [core1] webapp=/Solr path=/update/extract params={extractOnly=true&
> literal.id=*&resource.name
> =C:\XXX\11514.pdf&extractFormat=text&version=2.2}
> status=0 QTime=328
>
> The average pdf file size is around 50 KB. My questions are as follows:
>
> 1. Can I improve performance by updating any configutaion file for -
> SolrConfig, Tomcat, others?
> 2. Since I am using :
>
> var response = solr.Extract(new ExtractParameters(pdffile, "*")
>
>
> from SOLRNet 0.4.0.2001, which just came out (Beta), is this a known issue
> to be fixed in upcomming versions?
>
>
> Any help/pointers from the experts will be highly appreciated. Also let me
> know if you would need additional information and  will be more than happy
> to provide that.
>
> Regards, Soumitra
>

Re: Query: URl too long

[Mauricio Scheffer]

Frederico,
This is indeed a SolrNet issue. You can switch to POST in queries by
implementing a ISolrConnection decorator. In the Get() method you'd build a
POST request instead of the standard GET.
Please use the SolrNet forum for further questions about SolrNet.

Cheers,
Mauricio

On Mon, Jul 12, 2010 at 9:33 AM, kenf_nc  wrote:

>
> Frederico,
> You should also pose your question on the SolrNet forum,
> http://groups.google.com/group/solrnet?hl=en
> Switching from GET to POST isn't a Solr issue, but a SolrNet issue.
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Query-URl-too-long-tp959990p960208.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Re: Solr Git Tags

[Mauricio Scheffer]

AFAICT the new SVN trunk doesn't have any tags either (or history):
http://svn.apache.org/viewvc/lucene/dev/tags/
If you're seeking 1.4.1 I'd use the old SVN repo.
http://svn.apache.org/viewvc/lucene/solr/tags/release-1.4.1/

--
Mauricio



On Mon, Nov 8, 2010 at 2:42 PM, Will Milspec  wrote:

> Hi all,
>
> (This question is more oriented to the developer but may find relevant to
> the solr user interested in perusing the source)
>
> I've cloned the git lucene-solr repository and was surprised to find no
> tags.
>   empty here: http://git.apache.org/lucene-solr.git/refs/tags/
>
> Whereas the 'older' git repository ((pre-lucene-solr-merge)   has tags ,
> i.e. 1.4.0, 1.4.1, etc.
>  http://git.apache.org/solr.git/refs/tags/
>
> Can someone point me to an explanation? Do I need to use svn instead?
>
> I seek to check out the 1.4.1 source so I could patch a class. I want to
> patch against the current stable version (1.4.1) rather than the latest
> commit.
>
> thanks,
>
> will
>

Re: Solr on Google App Engine

[Mauricio Scheffer]

Solr on GAE has been discussed a couple of times, see these threads:

http://www.mail-archive.com/java-u...@lucene.apache.org/msg26010.html

http://www.mail-archive.com/solr-user@lucene.apache.org/msg24473.html

http://mail-archives.apache.org/mod_mbox/lucene-dev/201005.mbox/%3co2w952e01251005032245r79d6bfd6zbe08ece212c82...@mail.gmail.com%3e


--
Mauricio



On Thu, Dec 9, 2010 at 9:07 AM, Praveen Agrawal  wrote:

> Hi,
> I was wondering if Solr can be deployed/run on Google App Engine. GAE has
> some restrictions, notably no local file write access is allowed, instead
> applications must use JDO/JPA etc.
>
> I believe Solr can be deployed/run on Amazon EC2.
>
> Has anyone tried Solr on these two hosts?
>
> Thanks.
> Praveen
>

Re: Embedding SOLR in Dot NET Application

[Mauricio Scheffer]

See:
http://stackoverflow.com/questions/1749314/is-solr-available-for-net

http://stackoverflow.com/questions/3992530/is-any-work-being-done-on-a-net-port-of-solr

--
Mauricio



On Wed, Jan 5, 2011 at 6:59 AM, sumita  wrote:

>
> Hi,
>
> I wanted some information about whether it is possible to embed SOLR in a
> DOT NET application, something like SOLRJ for Java.  I have searched the
> net
> and found out that both SOLRSHARP and SOLRNET provide apis to query a
> running SOLR server(ehich in turn requires a JVM to run).
>
> However, our requirements is a bit different in the sense that we are
> looking for a dot net version of the SOLR libraries(dll etc), so that we
> can
> embed it in our application.  Currently, we are using Lucene API in our
> application for creating a search engine, but want to shift to SOLR to
> implement its inbuilt faceting feature.
>
> Any pointers in this regards would be really helpful.
>
> regards,
> Sumita
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Embedding-SOLR-in-Dot-NET-Application-tp2197589p2197589.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Re: SOLR vs SQL

[Mauricio Scheffer]

This article explains in-depth why calculating facets is not practical in
pure SQL: http://www.kimbly.com/blog/000239.html

Cheers,
Mauricio

On Wed, Sep 2, 2009 at 5:30 AM, gwk  wrote:

> Fuad Efendi wrote:
>
>> "No results found for 'surface area 377', displaying all properties."
>> - why do we need SOLR then...
>>
>>
>>
>>
>>
> Hi Fuad,
>
> The search box is only used for geographical search, i.e.
> country/region/city searches. The watermark on the homepage indicates this
> but the "search again" box on the search results page does not, I'll see if
> we can fix that.
>
> We use Solr not so much for the searchbox, which to be honest was an
> afterthought. But we do use Solr for faceting. Honestly, the thought of
> writing an SQL query which calculates all these facet counts every time a
> search parameter is changes gives me a headache, I don't think it's possible
> to do it in one query (although maybe, but I don't think anybody would want
> to maintain it). As for performance, every nontrivial database/search engine
> is affected by dataset for all but the simplest queries, and in my tests
> Solr trumps Mysql by a huge margin for our use case. We use a database to
> store our data in a somewhat normalized way, which is good for data
> consistency, but not so good for retrieval speeds. This is what makes Solr
> so useful for us, we can index all data in denormalized form with all data
> for a property in one record. While the (sql) database remains authoritative
>
> Full-text search is only one part of Solr, while an important part it isn't
> the only reason for using Solr. In our case, since we provide support for
> multiple language we try not to store textual descriptions but every facet a
> property can have. This gives us exactly the data needed to perform faceting
> but not so much on the full text search (which is used mind you, to find
> suggestions when you use the search box).
>
> Regards,
>
> gwk
>

Re: Solr Porting to .Net

[Mauricio Scheffer]

SolrNet is only a http client to Solr.
I've been experimenting with IKVM but wasn't very successful... There seem
to be some issues with class loading, but unfortunately I don't have much
time to continue these experiments right now. In case you're interested in
continuing this, here's the repository:
http://code.google.com/p/mausch/source/browse/trunk/SolrIKVM

Also recently someone registered a project on google code with the same
intentions, but no commits yet: http://code.google.com/p/solrwin/

Cheers,
Mauricio

On Wed, Sep 30, 2009 at 7:09 AM, Pravin Paratey  wrote:

> You may want to check out - http://code.google.com/p/solrnet/
>
> 2009/9/30 Antonio Calò :
> > Hi All
> >
> > I'm wondering if is already available a Solr version for .Net or if it is
> > still under development/planning. I've searched on Solr website but I've
> > found only info on Lucene .Net project.
> >
> > Best Regards
> >
> > Antonio
> >
> > --
> > Antonio Calò
> > --
> > Software Developer Engineer
> > @ Intellisemantic
> > Mail anton.c...@gmail.com
> > Tel. 011-56.90.429
> > --
> >
>

Re: Solr Porting to .Net

[Mauricio Scheffer]

Solr is a server that runs on Java and it exposes a http interface.SolrNet
is a client library for .Net that connects to a Solr instance via its http
interface.
My experiment (let's call it SolrIKVM) is an attempt to run Solr on .Net.

Hope that clear things up.

On Wed, Sep 30, 2009 at 11:50 AM, Antonio Calò  wrote:

> I guys, thanks for your prompt feedback.
>
>
> So, you are saying that SolrNet is just a wrapper written in C#, that
> connnect the Solr (still written in Java that run on the IKVM) ?
>
> Is my understanding correct?
>
> Regards
>
> Antonio
>
> 2009/9/30 Mauricio Scheffer 
>
> > SolrNet is only a http client to Solr.
> > I've been experimenting with IKVM but wasn't very successful... There
> seem
> > to be some issues with class loading, but unfortunately I don't have much
> > time to continue these experiments right now. In case you're interested
> in
> > continuing this, here's the repository:
> > http://code.google.com/p/mausch/source/browse/trunk/SolrIKVM
> >
> > Also recently someone registered a project on google code with the same
> > intentions, but no commits yet: http://code.google.com/p/solrwin/
> >
> > <http://code.google.com/p/mausch/source/browse/trunk/SolrIKVM>Cheers,
> > Mauricio
> >
> > On Wed, Sep 30, 2009 at 7:09 AM, Pravin Paratey 
> wrote:
> >
> > > You may want to check out - http://code.google.com/p/solrnet/
> > >
> > > 2009/9/30 Antonio Calò :
> > > > Hi All
> > > >
> > > > I'm wondering if is already available a Solr version for .Net or if
> it
> > is
> > > > still under development/planning. I've searched on Solr website but
> > I've
> > > > found only info on Lucene .Net project.
> > > >
> > > > Best Regards
> > > >
> > > > Antonio
> > > >
> > > > --
> > > > Antonio Calò
> > > > --
> > > > Software Developer Engineer
> > > > @ Intellisemantic
> > > > Mail anton.c...@gmail.com
> > > > Tel. 011-56.90.429
> > > > --
> > > >
> > >
> >
>
>
>
> --
> Antonio Calò
> --
> Software Developer Engineer
> @ Intellisemantic
> Mail anton.c...@gmail.com
> Tel. 011-56.90.429
> --
>

Re: Conditional deduplication

[Mauricio Scheffer]

See http://wiki.apache.org/solr/FieldCollapsing

On Wed, Sep 30, 2009 at 4:41 PM, Michael  wrote:

> If I index a bunch of email documents, is there a way to say"show me all
> email documents, but only one per To: email address"
> so that if there are a total of 10 distinct To: fields in the corpus, I get
> back 10 email documents?
>
> I'm aware of http://wiki.apache.org/solr/Deduplication but I want to
> retain
> the ability to search across all of my email documents most of the time,
> and
> only occasionally search for the distinct ones.
>
> Essentially I want to do a
> SELECT DISTINCT to_field FROM documents
> where a normal search is a
> SELECT * FROM documents
>
> Thanks for any pointers.
>

Re: "Only one usage of each socket address" error

[Mauricio Scheffer]

Did you try this?
http://blogs.msdn.com/dgorti/archive/2005/09/18/470766.aspx
Also, please
post the full exception stack trace.

2009/10/2 Steinar Asbjørnsen 

> Tried running solr on jetty now, and I still get the same error:(.
>
> Steinar
>
> Den 1. okt. 2009 kl. 16.23 skrev Steinar Asbjørnsen:
>
>
>  Hi.
>>
>> This situation is still bugging me.
>> I thought i had it fixed yday, but no...
>>
>> Seems like this goes both for deleting and adding, but I'll explain the
>> delete-situation here:
>> When I'm deleting documents(~5k) from a index, i get a error message
>> saying
>> "Only one usage of each socket address (protocol/network address/port) is
>> normally permitted 127.0.0.1:8983".
>>
>> I've tried  both delete by id and delete by query, and both gives me the
>> same error.
>> The command that is giving me the errormessage is solr.Delete(id) and
>> solr.Delete(new SolrQuery("id:"+id)).
>>
>> The command is issued with SolrNet, and I'm not sure if this is SolrNet or
>> solr related.
>>
>> I cannot find anything that helps me out in the catalina-log.
>> Are there any other logs that should be checked?
>>
>> I'm grateful for any pointers :)
>>
>> Thanks,
>> Steinar
>>
>> Den 29. sep. 2009 kl. 11.15 skrev Steinar Asbjørnsen:
>>
>>  Seems like the post in the SolrNet group:
>>> http://groups.google.com/group/solrnet/browse_thread/thread/7e3034b626d3e82d?pli=1
>>>  helped
>>> me get trough.
>>>
>>> Thanks you solr-user's for helping out too!
>>>
>>> Steinar
>>>
>>> Videresendt melding:
>>>
>>>  Fra: Steinar Asbjørnsen 
 Dato: 28. september 2009 17.07.15 GMT+02.00
 Til: solr-user@lucene.apache.org
 Emne: Re: "Only one usage of each socket address" error

 I'm using the add(MyObject) command form ()in a foreach loop to add my
 objects to the index.

 In the catalina-log i cannot see anything that helps me out.
 It stops at:
 28.sep.2009 08:58:40 org.apache.solr.update.processor.LogUpdateProcessor
 finish
 INFO: {add=[12345]} 0 187
 28.sep.2009 08:58:40 org.apache.solr.core.SolrCore execute
 INFO: [core2] webapp=/solr path=/update params={} status=0 QTime=187
 Whitch indicates nothing wrong.

 Are there any other logs that should be checked?

 What it seems like to me at the moment is that the foreach is passing
 objects(documents) to solr faster then solr can add them to the index. As 
 in
 I'm eventually running out of connections (to solr?) or something.

 I'm running another incremental update that with other objects where the
 foreachs isn't quite as fast. This job has added over 100k documents 
 without
 failing, and still going. Whereas the problematic job fails after ~3k.

 What I've learned trough the day tho, is that the index where my feed is
 failing is actually redundant.
 I.e I'm off the hook for now.

 Still I'd like to figure out whats going wrong.

 Steinar

  There's nothing in that output that indicates something we can help
> with over in solr-user land.  What is the call you're making to Solr?  Did
> Solr log anything anomalous?
>
>Erik
>
>
> On Sep 28, 2009, at 4:41 AM, Steinar Asbjørnsen wrote:
>
>  I just posted to the SolrNet-group since i have the exact same(?)
>> problem.
>> Hope I'm not beeing rude posting here as well (since the SolrNet-group
>> doesn't seem as active as this mailinglist).
>>
>> The problem occurs when I'm running an incremental feed(self made) of
>> a index.
>>
>> My post:
>> [snip]
>> Whats happening is that i get this error message (in VS):
>> "A first chance exception of type
>> 'SolrNet.Exceptions.SolrConnectionException' occurred in SolrNet.DLL"
>> And the web browser (which i use to start the feed says:
>> "System.Data.SqlClient.SqlException: Timeout expired.  The timeout
>> period elapsed prior to completion of the operation or the server is
>> not responding."
>> At the time of writing my index contains 15k docs, and "lacks" ~700k
>> docs that the incremental feed should take care of adding to the
>> index.
>> The error message appears after 3k docs are added, and before 4k
>> docs are added.
>> I'm committing each 1%1000==0.
>> In addittion autocommit is set to:
>> 
>> 1
>> 
>> More info:
>> From schema.xml:
>> > required="true" />
>> > required="false" />
>> I'm fetching data from a (remote) Sql 2008 Server, using sqljdbc4.jar.
>> And Solr is running on a local Tomcat-installation.
>> SolrNet version: 0.2.3.0
>> Solr Specification Version: 1.3.0.2009.08.29.08.05.39
>>
>> [/snip]
>> Any suggestions on how to fix this would be much apreceiated.
>>
>> Regards,
>> Steinar
>>
>
>

>>>
>>
>

Re: How to get WildCard/prefix in SolrSharp

[Mauricio Scheffer]

AFAIK this needs to be set in the config in your case, which is still an
open issue: http://issues.apache.org/jira/browse/SOLR-218

On Wed, Nov 11, 2009 at 9:25 AM, theashik  wrote:

>
> In Solrj, there is a method called setAllowLeadingWildcard(true). I need to
> call the same method in SolrSharp API as well. But I don't find the class
> "SolrQueryParser.cs" in SolrSharp API. Can any one suggest me how to call
> that method, if I can use any provided namespace as
> "org.apache.solr.SolrSharp.Search.SolrQueryParser" in SolrSharp.
>
>
> Thank you
> Ashik Rajbhandari
> --
> View this message in context:
> http://old.nabble.com/How-to-get-WildCard-prefix-in-SolrSharp-tp26300435p26300435.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>

Re: javabin in .NET?

[Mauricio Scheffer]

It's one of my pending issues for SolrNet (
http://code.google.com/p/solrnet/issues/detail?id=71 )
I've looked at the code, it doesn't seem terribly complex to port to C#. It
would be kind of cumbersome to test it though.
I just didn't implement it yet because I'm getting good enough performance
with XML (and other people as well:
http://groups.google.com/group/solrnet/msg/4de8224a33279906 )

Cheers,
Mauricio

On Thu, Nov 12, 2009 at 1:26 PM, Erik Hatcher wrote:

> Has anyone looked into using the javabin response format from .NET (instead
> of SolrJ)?
>
> It's mainly a curiosity.
>
> How much better could performance/bandwidth/throughput be?  How difficult
> would it be to implement some .NET code (C#, I'd guess being the best
> choice) to handle this response format?
>
> Thanks,
>Erik
>
>

Re: javabin in .NET?

[Mauricio Scheffer]

I use DOM. Honestly, I haven't run any perf tests, it all just runs well
enough for me. Then again, my documents and resultsets are typically small
(~1KB docs and ~50 docs per resultset). How big are your documents?


On Thu, Nov 12, 2009 at 2:40 PM, wojtekpia  wrote:

>
> I was thinking of going this route too because I've found that parsing XML
> result sets using XmlDocument + XPath can be very slow (up to a few
> seconds)
> when requesting ~100 documents. Are you getting good performance parsing
> large result sets? Are you using SAX instead of DOM?
>
> Thanks,
> Wojtek
>
>
> mausch wrote:
> >
> > It's one of my pending issues for SolrNet (
> > http://code.google.com/p/solrnet/issues/detail?id=71 )
> > I've looked at the code, it doesn't seem terribly complex to port to C#.
> > It
> > would be kind of cumbersome to test it though.
> > I just didn't implement it yet because I'm getting good enough
> performance
> > with XML (and other people as well:
> > http://groups.google.com/group/solrnet/msg/4de8224a33279906 )
> >
> > Cheers,
> > Mauricio
> >
>
> --
> View this message in context:
> http://old.nabble.com/javabin-in-.NET--tp26321914p26323001.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>

Re: javabin in .NET?

[Mauricio Scheffer]

Like I said before, it has served me and other people very well so far.
AFAIK there is no StAX implementation for .Net, there is XmlReader but it's
quite more complex to use than XmlDocument (DOM).
Of course, I always welcome patches.

Cheers,
Mauricio

On Thu, Nov 12, 2009 at 3:34 PM, Walter Underwood wrote:

> DOM is the wrong choice for unmarshalling XML data from a protocol. The DOM
> is slow and bloated. You need that if you are manipulating an XML document,
> but not if you are stripmining the data from it then throwing the document
> away.
>
> Try a StAX parser: http://en.wikipedia.org/wiki/StAX
>
> That should be simpler and much, much faster.
>
> wunder
>
> On Nov 12, 2009, at 10:01 AM, Mauricio Scheffer wrote:
>
> > I use DOM. Honestly, I haven't run any perf tests, it all just runs well
> > enough for me. Then again, my documents and resultsets are typically
> small
> > (~1KB docs and ~50 docs per resultset). How big are your documents?
> >
> >
> > On Thu, Nov 12, 2009 at 2:40 PM, wojtekpia  wrote:
> >
> >>
> >> I was thinking of going this route too because I've found that parsing
> XML
> >> result sets using XmlDocument + XPath can be very slow (up to a few
> >> seconds)
> >> when requesting ~100 documents. Are you getting good performance parsing
> >> large result sets? Are you using SAX instead of DOM?
> >>
> >> Thanks,
> >> Wojtek
> >>
> >>
> >> mausch wrote:
> >>>
> >>> It's one of my pending issues for SolrNet (
> >>> http://code.google.com/p/solrnet/issues/detail?id=71 )
> >>> I've looked at the code, it doesn't seem terribly complex to port to
> C#.
> >>> It
> >>> would be kind of cumbersome to test it though.
> >>> I just didn't implement it yet because I'm getting good enough
> >> performance
> >>> with XML (and other people as well:
> >>> http://groups.google.com/group/solrnet/msg/4de8224a33279906 )
> >>>
> >>> Cheers,
> >>> Mauricio
> >>>
> >>
> >> --
> >> View this message in context:
> >> http://old.nabble.com/javabin-in-.NET--tp26321914p26323001.html
> >> Sent from the Solr - User mailing list archive at Nabble.com.
> >>
> >>
>
>

Re: javabin in .NET?

[Mauricio Scheffer]

Nope. It has to be manually ported. Not so much because of the language
itself but because of differences in the libraries.


2009/11/13 Noble Paul നോബിള്‍ नोब्ळ् 

> Is there any tool to directly port java to .Net? then we can etxract
> out the client part of the javabin code and convert it.
>
> On Thu, Nov 12, 2009 at 9:56 PM, Erik Hatcher 
> wrote:
> > Has anyone looked into using the javabin response format from .NET
> (instead
> > of SolrJ)?
> >
> > It's mainly a curiosity.
> >
> > How much better could performance/bandwidth/throughput be?  How difficult
> > would it be to implement some .NET code (C#, I'd guess being the best
> > choice) to handle this response format?
> >
> > Thanks,
> >Erik
> >
> >
>
>
>
> --
> -
> Noble Paul | Principal Engineer| AOL | http://aol.com
>

Re: javabin in .NET?

[Mauricio Scheffer]

I meant the standard IO libraries. They are different enough that the code
has to be manually ported. There were some automated tools back when
Microsoft introduced .Net, but IIRC they never really worked.

Anyway it's not a big deal, it should be a straightforward job. Testing it
thoroughly cross-platform is another thing though.

2009/11/13 Noble Paul നോബിള്‍ नोब्ळ् 

> The javabin format does not have many dependencies. it may have 3-4
> classes an that is it.
>
> On Fri, Nov 13, 2009 at 6:05 PM, Mauricio Scheffer
>  wrote:
> > Nope. It has to be manually ported. Not so much because of the language
> > itself but because of differences in the libraries.
> >
> >
> > 2009/11/13 Noble Paul നോബിള്‍ नोब्ळ् 
> >
> >> Is there any tool to directly port java to .Net? then we can etxract
> >> out the client part of the javabin code and convert it.
> >>
> >> On Thu, Nov 12, 2009 at 9:56 PM, Erik Hatcher 
> >> wrote:
> >> > Has anyone looked into using the javabin response format from .NET
> >> (instead
> >> > of SolrJ)?
> >> >
> >> > It's mainly a curiosity.
> >> >
> >> > How much better could performance/bandwidth/throughput be?  How
> difficult
> >> > would it be to implement some .NET code (C#, I'd guess being the best
> >> > choice) to handle this response format?
> >> >
> >> > Thanks,
> >> >Erik
> >> >
> >> >
> >>
> >>
> >>
> >> --
> >> -
> >> Noble Paul | Principal Engineer| AOL | http://aol.com
> >>
> >
>
>
>
> --
> -
> Noble Paul | Principal Engineer| AOL | http://aol.com
>

Re: javabin in .NET?

[Mauricio Scheffer]

Original code is here: http://bit.ly/hkCbI
I just started porting it here: http://bit.ly/37hiOs
It needs: tests/debugging, porting NamedList, SolrDocument, SolrDocumentList
Thanks for any help!

Cheers,
Mauricio

2009/11/14 Noble Paul നോബിള്‍ नोब्ळ् 

> OK. Is there anyone trying it out? where is this code ? I can try to help
> ..
>
> On Fri, Nov 13, 2009 at 8:10 PM, Mauricio Scheffer
>  wrote:
> > I meant the standard IO libraries. They are different enough that the
> code
> > has to be manually ported. There were some automated tools back when
> > Microsoft introduced .Net, but IIRC they never really worked.
> >
> > Anyway it's not a big deal, it should be a straightforward job. Testing
> it
> > thoroughly cross-platform is another thing though.
> >
> > 2009/11/13 Noble Paul നോബിള്‍ नोब्ळ् 
> >
> >> The javabin format does not have many dependencies. it may have 3-4
> >> classes an that is it.
> >>
> >> On Fri, Nov 13, 2009 at 6:05 PM, Mauricio Scheffer
> >>  wrote:
> >> > Nope. It has to be manually ported. Not so much because of the
> language
> >> > itself but because of differences in the libraries.
> >> >
> >> >
> >> > 2009/11/13 Noble Paul നോബിള്‍ नोब्ळ् 
> >> >
> >> >> Is there any tool to directly port java to .Net? then we can etxract
> >> >> out the client part of the javabin code and convert it.
> >> >>
> >> >> On Thu, Nov 12, 2009 at 9:56 PM, Erik Hatcher <
> erik.hatc...@gmail.com>
> >> >> wrote:
> >> >> > Has anyone looked into using the javabin response format from .NET
> >> >> (instead
> >> >> > of SolrJ)?
> >> >> >
> >> >> > It's mainly a curiosity.
> >> >> >
> >> >> > How much better could performance/bandwidth/throughput be?  How
> >> difficult
> >> >> > would it be to implement some .NET code (C#, I'd guess being the
> best
> >> >> > choice) to handle this response format?
> >> >> >
> >> >> > Thanks,
> >> >> >Erik
> >> >> >
> >> >> >
> >> >>
> >> >>
> >> >>
> >> >> --
> >> >> -
> >> >> Noble Paul | Principal Engineer| AOL | http://aol.com
> >> >>
> >> >
> >>
> >>
> >>
> >> --
> >> -
> >> Noble Paul | Principal Engineer| AOL | http://aol.com
> >>
> >
>
>
>
> --
> -
> Noble Paul | Principal Engineer| AOL | http://aol.com
>

Re: javabin in .NET?

[Mauricio Scheffer]

Yep, I think I mostly nailed the unmarshalling. Need more tests though. And
then integrate it to SolrNet.
Is there any way (or are there any plans) to have an update handler that
accepts javabin?

2009/11/16 Noble Paul നോബിള്‍ नोब्ळ् 

> start with a JavabinDecoder only so that the class is simple to start with.
>
> 2009/11/16 Noble Paul നോബിള്‍  नोब्ळ् :
> > For a client the marshal() part is not important.unmarshal() is
> > probably all you need
> >
> > On Sun, Nov 15, 2009 at 12:36 AM, Mauricio Scheffer
> >  wrote:
> >> Original code is here: http://bit.ly/hkCbI
> >> I just started porting it here: http://bit.ly/37hiOs
> >> It needs: tests/debugging, porting NamedList, SolrDocument,
> SolrDocumentList
> >> Thanks for any help!
> >>
> >> Cheers,
> >> Mauricio
> >>
> >> 2009/11/14 Noble Paul നോബിള്‍ नोब्ळ् 
> >>
> >>> OK. Is there anyone trying it out? where is this code ? I can try to
> help
> >>> ..
> >>>
> >>> On Fri, Nov 13, 2009 at 8:10 PM, Mauricio Scheffer
> >>>  wrote:
> >>> > I meant the standard IO libraries. They are different enough that the
> >>> code
> >>> > has to be manually ported. There were some automated tools back when
> >>> > Microsoft introduced .Net, but IIRC they never really worked.
> >>> >
> >>> > Anyway it's not a big deal, it should be a straightforward job.
> Testing
> >>> it
> >>> > thoroughly cross-platform is another thing though.
> >>> >
> >>> > 2009/11/13 Noble Paul നോബിള്‍ नोब्ळ् 
> >>> >
> >>> >> The javabin format does not have many dependencies. it may have 3-4
> >>> >> classes an that is it.
> >>> >>
> >>> >> On Fri, Nov 13, 2009 at 6:05 PM, Mauricio Scheffer
> >>> >>  wrote:
> >>> >> > Nope. It has to be manually ported. Not so much because of the
> >>> language
> >>> >> > itself but because of differences in the libraries.
> >>> >> >
> >>> >> >
> >>> >> > 2009/11/13 Noble Paul നോബിള്‍ नोब्ळ् 
> >>> >> >
> >>> >> >> Is there any tool to directly port java to .Net? then we can
> etxract
> >>> >> >> out the client part of the javabin code and convert it.
> >>> >> >>
> >>> >> >> On Thu, Nov 12, 2009 at 9:56 PM, Erik Hatcher <
> >>> erik.hatc...@gmail.com>
> >>> >> >> wrote:
> >>> >> >> > Has anyone looked into using the javabin response format from
> .NET
> >>> >> >> (instead
> >>> >> >> > of SolrJ)?
> >>> >> >> >
> >>> >> >> > It's mainly a curiosity.
> >>> >> >> >
> >>> >> >> > How much better could performance/bandwidth/throughput be?  How
> >>> >> difficult
> >>> >> >> > would it be to implement some .NET code (C#, I'd guess being
> the
> >>> best
> >>> >> >> > choice) to handle this response format?
> >>> >> >> >
> >>> >> >> > Thanks,
> >>> >> >> >Erik
> >>> >> >> >
> >>> >> >> >
> >>> >> >>
> >>> >> >>
> >>> >> >>
> >>> >> >> --
> >>> >> >> -
> >>> >> >> Noble Paul | Principal Engineer| AOL | http://aol.com
> >>> >> >>
> >>> >> >
> >>> >>
> >>> >>
> >>> >>
> >>> >> --
> >>> >> -
> >>> >> Noble Paul | Principal Engineer| AOL | http://aol.com
> >>> >>
> >>> >
> >>>
> >>>
> >>>
> >>> --
> >>> -
> >>> Noble Paul | Principal Engineer| AOL | http://aol.com
> >>>
> >>
> >
> >
> >
> > --
> > -
> > Noble Paul | Principal Engineer| AOL | http://aol.com
> >
>
>
>
> --
> -
> Noble Paul | Principal Engineer| AOL | http://aol.com
>

Example Solr instance

[Mauricio Scheffer]

Hi everyone. I'm developing a Solr client for .NET (
http://code.google.com/p/solrnet/) and I was wondering if I could use the
Solr instance at example.solrstuff.org (the one used by solrjs) to build an
online demo of my library... Of course, this would be just read-only access,
no updates. I would also put a cap on the number of rows so that people
couldn't ask for 1000 rows for example.Please let me know your opinion about
this. Thanks.

Cheers,
Mauricio

Re: Example Solr instance

[Mauricio Scheffer]

Yes, I'm aware of SolrSharp. I exposed my reasons to build another client in
my blog (http://bugsquash.blogspot.com/2007/11/introducing-solrnet.html),
it's a different approach. This is not something that I'm starting now -
I've already used my client in production for over a year.
I see on the front page of the Solr wiki that there's yet another client for
.NET (http://code.google.com/p/deveel-solr). IMHO having a choice is a good
thing...

Mauricio

On Thu, Feb 12, 2009 at 5:39 AM, Otis Gospodnetic <
otis_gospodne...@yahoo.com> wrote:

> Mauricio - are you aware of SolrSharp - a Solr client for .NET?  Would it
> be better to contribute to SolrSharp instead of creating another .NET
> client, or is your client going to be built very differently?
>
>
> Otis
> --
> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>
>
>
>
> 
> From: Mauricio Scheffer 
> To: solr-user@lucene.apache.org
> Sent: Wednesday, February 11, 2009 9:27:59 PM
> Subject: Example Solr instance
>
> Hi everyone. I'm developing a Solr client for .NET (
> http://code.google.com/p/solrnet/) and I was wondering if I could use the
> Solr instance at example.solrstuff.org (the one used by solrjs) to build
> an
> online demo of my library... Of course, this would be just read-only
> access,
> no updates. I would also put a cap on the number of rows so that people
> couldn't ask for 1000 rows for example.Please let me know your opinion
> about
> this. Thanks.
>
> Cheers,
> Mauricio
>

Re: Example Solr instance

[Mauricio Scheffer]

Hi Noble, the Solr instance is not exactly at example.solrstuff.org. I don't
want to write here the exact url, it might get picked up by a bot...

On Thu, Feb 12, 2009 at 4:51 AM, Noble Paul നോബിള്‍ नोब्ळ् <
noble.p...@gmail.com> wrote:

> this link is not working example.solrstuff.org. who is maintaining it?
>
> On Thu, Feb 12, 2009 at 7:57 AM, Mauricio Scheffer
>  wrote:
> > Hi everyone. I'm developing a Solr client for .NET (
> > http://code.google.com/p/solrnet/) and I was wondering if I could use
> the
> > Solr instance at example.solrstuff.org (the one used by solrjs) to build
> an
> > online demo of my library... Of course, this would be just read-only
> access,
> > no updates. I would also put a cap on the number of rows so that people
> > couldn't ask for 1000 rows for example.Please let me know your opinion
> about
> > this. Thanks.
> >
> > Cheers,
> > Mauricio
> >
>
>
>
> --
> --Noble Paul
>

Re: Spatial Solr (JTeam)

[Mauricio Scheffer]

Seems to work for me... (I mean, I don't get a NoClassDefFoundError but I
have other issues).
I just put spatial-solr-1.0-RC3.jar in the core's lib directory and it
worked.

On Wed, Dec 23, 2009 at 8:25 PM, Thomas Rabaix wrote:

> Hello,
>
> I would like to set up the spatial solr plugin from
> http://www.jteam.nl/news/spatialsolr on solr 1.4. However I am getting a
> error message when solr start.
>
> SEVERE: java.lang.NoClassDefFoundError:
> org/apache/solr/search/QParserPlugin
>
> I guess nl.jteam.search.solrext.spatial.SpatialTierQueryParserPlugin
> extends QParserPlugin. I have checked into the solr.war file (the one
> provided by solr download webpage) and the class is present.
>
> Do you know if the current version "SSP version 1.0-RC3" is compatible with
> solr 1.4 ?
>
> Thanks
>
> --
> Thomas Rabaix
>

Spatial / Local Solr radius

[Mauricio Scheffer]

Hi everyone,
I'm getting inconsistent behavior from Spatial Solr when searching with
different radii. For the same lat/long I get:

radius=1 -> 1 result
radius=10 -> 0 result
radius=25 -> 2 results
radius=100 -> 2 results
radius=250 -> 0 results

I don't understand why radius=10 and 250 return no results. Is this a known
bug? I'm using the default configuration as specified in the PDF.
BTW I also tried LocalSolr with the same results.

Thanks
Mauricio

Re: Spatial / Local Solr radius

[Mauricio Scheffer]

q={!spatial lat=43.705 long=116.3635 radius=100}*:*

with no other parameters.
When changing the radius to 250 I get no results.

In my config I have startTier = 9 and endTier = 17 (default values)


On Mon, Dec 28, 2009 at 1:24 PM, Grant Ingersoll  wrote:

> What do your queries look like?
>
> On Dec 28, 2009, at 9:30 AM, Mauricio Scheffer wrote:
>
> > Hi everyone,
> > I'm getting inconsistent behavior from Spatial Solr when searching with
> > different radii. For the same lat/long I get:
> >
> > radius=1 -> 1 result
> > radius=10 -> 0 result
> > radius=25 -> 2 results
> > radius=100 -> 2 results
> > radius=250 -> 0 results
> >
> > I don't understand why radius=10 and 250 return no results. Is this a
> known
> > bug? I'm using the default configuration as specified in the PDF.
> > BTW I also tried LocalSolr with the same results.
> >
> > Thanks
> > Mauricio
>
>

Re: Remove the deleted docs from the Solr Index

[Mauricio Scheffer]

Here's a couple more options:

http://stackoverflow.com/questions/1555610/solr-dih-how-to-handle-deleted-documents/


Cheers,
Mauricio

On Mon, Dec 28, 2009 at 5:51 PM, Mohamed Parvez  wrote:

> I am using Solr 1.4 and DIH to build the index from a table.
>
> I use full import once to create the index and then i keep using delta
> import to update the index.
>
> All woks fine as long a the table gets added with only new rows.
>
> if there are some rows in the table that get deleted then the index does
> not
> get updated and has stale data.
>
> I have looked into the below options:
>
> 1] deletedPkQuery and deltaImportQuery :-
> Both are of no use, as there is no way any DB SQL query can return the row
> from the table, if the row is already deleted from the table.
>
> 2] preImportDeleteQuery and postImportDeleteQuery :-
> Both are of no use, as they work only with full import. ( Also there is no
> way any DB SQL query can return the row from the table, if the row
> is already deleted from the table)
>
> 3] Creating a new field in the table, named delete, and setting it as true
> and instead of actually deleting the row from the table:-
> This is not possible as that table is a sort of getting updated from
> external content management system, with news updates and has 1000 of new
> rows added and 1000 deleted every hour. Cant keep the rows in the table
> when
> when the content has expired.
>
> Am I missing something?  How to keep the Index updated when the rows are
> deleted from the table.
>
>
> --
>

Re: Spatial / Local Solr radius

[Mauricio Scheffer]

It's jteam's plugin ( http://www.jteam.nl/news/spatialsolr ) which AFAIK is
just the latest patch for SOLR-773 packaged as a stand-alone plugin.

I'll try to contact jteam directly.

Thanks
Mauricio

On Mon, Dec 28, 2009 at 8:02 PM, Grant Ingersoll wrote:

>
> On Dec 28, 2009, at 11:47 AM, Mauricio Scheffer wrote:
>
> > q={!spatial lat=43.705 long=116.3635 radius=100}*:*
>
> What's QParser is the "spatial" plugin? I don't know of any such QParser in
> Solr.  Is this a third party tool?  If so, I'd suggest asking on that list.
>
> >
> > with no other parameters.
> > When changing the radius to 250 I get no results.
> >
> > In my config I have startTier = 9 and endTier = 17 (default values)
> >
> >
> > On Mon, Dec 28, 2009 at 1:24 PM, Grant Ingersoll 
> wrote:
> >
> >> What do your queries look like?
> >>
> >> On Dec 28, 2009, at 9:30 AM, Mauricio Scheffer wrote:
> >>
> >>> Hi everyone,
> >>> I'm getting inconsistent behavior from Spatial Solr when searching with
> >>> different radii. For the same lat/long I get:
> >>>
> >>> radius=1 -> 1 result
> >>> radius=10 -> 0 result
> >>> radius=25 -> 2 results
> >>> radius=100 -> 2 results
> >>> radius=250 -> 0 results
> >>>
> >>> I don't understand why radius=10 and 250 return no results. Is this a
> >> known
> >>> bug? I'm using the default configuration as specified in the PDF.
> >>> BTW I also tried LocalSolr with the same results.
> >>>
> >>> Thanks
> >>> Mauricio
> >>
> >>
>
> --
> Grant Ingersoll
> http://www.lucidimagination.com/
>
> Search the Lucene ecosystem using Solr/Lucene:
> http://www.lucidimagination.com/search
>
>

Re: Updating a single field in a Solr document

[Mauricio Scheffer]

Here's the corresponding issue:
https://issues.apache.org/jira/browse/SOLR-139

On Tue, Jan 19, 2010 at 1:36 PM, Raghuveer Kancherla <
raghuveer.kanche...@aplopio.com> wrote:

> Is this feature planned in any of the future releases. I ask because it
> will
> help me plan my system architecture accordingly.
>
> Thanks,
> Raghu
>
>
>
> On Tue, Jan 19, 2010 at 7:28 PM, Shalin Shekhar Mangar <
> shalinman...@gmail.com> wrote:
>
> > On Mon, Jan 18, 2010 at 5:11 PM, Raghuveer Kancherla <
> > raghuveer.kanche...@aplopio.com> wrote:
> >
> > > Hi,
> > > I have 2 fields one with captures the category of the documents and an
> > > other
> > > which is a pre processed text of the document. Text of the document is
> > > fairly large.
> > > The category of the document changes often while the text remains the
> > same.
> > > Search happens on both fields.
> > >
> > > The problem is, I have to index both the text and the category each
> time
> > > the
> > > category changes. The text being large obviously makes this suboptimal.
> > Is
> > > there a patch or a tricky way to avoid indexing the text field every
> > time.
> > >
> > >
> > Sure, make the text field as stored, read the old document and create the
> > new one. Sorry, there is no way to update an indexed document in Solr
> > (yet).
> >
> > --
> > Regards,
> > Shalin Shekhar Mangar.
> >
>

Re: Local Solr Inconsistent results for radius

[Mauricio Scheffer]

Hi Emad,

I had the same issue (
http://old.nabble.com/Spatial---Local-Solr-radius-td26943608.html ), it
seems that this happens only on eastern areas of the world. Try inverting
the sign of all your longitudes, or translate all your longitudes to the
west.

Cheers,
Mauricio

On Fri, Feb 12, 2010 at 7:22 AM, Emad Mushtaq
wrote:

> Hello,
>
> I have a question related to local solr. For certain locations (latitude,
> longitude), the spatial search does not work. Here is the query I try to
> make which gives me no results:
>
> q=*&qt=geo&sort=geo_distance asc&lat=33.718151&long=73.
> 060547&radius=450
>
> However if I make the same query with radius=449, it gives me results.
>
> Here is part of my solrconfig.xml containing startTier and endTier:
>
> 
>  class="com.pjaol.search.solr.update.LocalUpdateProcessorFactory">
>latitude 
>longitude 
>
>9
>17
>   
>   
>   
>   
>
> What do I need to do to fix this problem?
>
>
> --
> Muhammad Emad Mushtaq
> http://www.emadmushtaq.com/
>

Re: Local Solr Inconsistent results for radius

[Mauricio Scheffer]

Yes, it seems to be a bug, at least with the code you and I are using. If
you don't need to search across the whole globe, try translating your
longitudes as I suggested.

On Fri, Feb 12, 2010 at 3:04 PM, Emad Mushtaq
wrote:

> Hello Mauricio,
>
> Do you know why such a problem occurs. Has it to do with certain latitudes,
> longitudes. If so why is it happening. Is it a bug in local solr?
>
> On Fri, Feb 12, 2010 at 5:50 PM, Mauricio Scheffer <
> mauricioschef...@gmail.com> wrote:
>
> > Hi Emad,
> >
> > I had the same issue (
> > http://old.nabble.com/Spatial---Local-Solr-radius-td26943608.html ), it
> > seems that this happens only on eastern areas of the world. Try inverting
> > the sign of all your longitudes, or translate all your longitudes to the
> > west.
> >
> > Cheers,
> > Mauricio
> >
> > On Fri, Feb 12, 2010 at 7:22 AM, Emad Mushtaq
> > wrote:
> >
> > > Hello,
> > >
> > > I have a question related to local solr. For certain locations
> (latitude,
> > > longitude), the spatial search does not work. Here is the query I try
> to
> > > make which gives me no results:
> > >
> > > q=*&qt=geo&sort=geo_distance asc&lat=33.718151&long=73.
> > > 060547&radius=450
> > >
> > > However if I make the same query with radius=449, it gives me results.
> > >
> > > Here is part of my solrconfig.xml containing startTier and endTier:
> > >
> > > 
> > >  > > class="com.pjaol.search.solr.update.LocalUpdateProcessorFactory">
> > >latitude 
> > >longitude 
> > >
> > >9
> > >17
> > >   
> > >   
> > >   
> > >   
> > >
> > > What do I need to do to fix this problem?
> > >
> > >
> > > --
> > > Muhammad Emad Mushtaq
> > > http://www.emadmushtaq.com/
> > >
> >
>
>
>
> --
> Muhammad Emad Mushtaq
> http://www.emadmushtaq.com/
>

Solr ad on stackoverflow.com

[Mauricio Scheffer]

Stackoverflow.com is serving ads for open source projects:
http://meta.stackoverflow.com/questions/31913/open-source-advertising-sidebar-1h-2010

I think it would be good publicity for Solr to have a banner there... anyone
up for designing one? (if it's ok with the Solr dev team, of course)

Cheers,
Mauricio

Re: DIH - Deleting documents

[Mauricio Scheffer]

Take a look at the DIH special commands:
http://wiki.apache.org/solr/DataImportHandler#Special_Commands
Some other
options:
http://stackoverflow.com/questions/1555610/solr-dih-how-to-handle-deleted-documents

Cheers,
Mauricio

2010/3/23 André Maldonado 

> Hy all.
>
> How can I delete documents when using DataImportHandler on a delta import?
>
> Thank's
>
> "Então aproximaram-se os que estavam no barco, e adoraram-no, dizendo: És
> verdadeiramente o Filho de Deus." (Mateus 14:33)
>

Re: Spatial / Local Solr radius

[Mauricio Scheffer]

Hi Michael

I exchanged a few mails with jteam, ultimately I realized my longitudes'
signs were inverted so I was mapping to China instead of U.S. Still a bug,
but inverting those longitudes "fixed" the problem in my case since I'm not
running world-wide searches.
Before that I ran a test to determine  what radii failed for a grid of 3x3
lat/long with radius between 10 and 2500, if you're interested I can send
you the results to compare.
Also I'm running RC3, I see RC4 is out but haven't tried it.
It would be interesting to see if this happens with the new spatial
functions in trunk.

--
Mauricio


On Tue, Mar 30, 2010 at 4:00 PM, Michael  wrote:

> Mauricio,
>
> I was wondering whether you had heard anything back from jteam
> regarding this issue. I have also noticed it and was wondering why It
> was happening.
>
> One thing I noticed is that this problem only appears for "sparse"
> datasets as compared to "dense" ones. For example, I have two datasets
> I've been testing with - one with 56 U.S. cities (the "sparse" set)
> and one with over 197000 towns and cities (the "dense" set). The dense
> set exhibited no problems with consistency searching at various radii,
> but the sparse set exhibited the same issues you experienced.
>
> Michael D.
>
> On Mon, Dec 28, 2009 at 7:39 PM, Mauricio Scheffer
>  wrote:
> > It's jteam's plugin ( http://www.jteam.nl/news/spatialsolr ) which AFAIK
> is
> > just the latest patch for SOLR-773 packaged as a stand-alone plugin.
> >
> > I'll try to contact jteam directly.
> >
> > Thanks
> > Mauricio
> >
> > On Mon, Dec 28, 2009 at 8:02 PM, Grant Ingersoll  >wrote:
> >
> >>
> >> On Dec 28, 2009, at 11:47 AM, Mauricio Scheffer wrote:
> >>
> >> > q={!spatial lat=43.705 long=116.3635 radius=100}*:*
> >>
> >> What's QParser is the "spatial" plugin? I don't know of any such QParser
> in
> >> Solr.  Is this a third party tool?  If so, I'd suggest asking on that
> list.
> >>
> >> >
> >> > with no other parameters.
> >> > When changing the radius to 250 I get no results.
> >> >
> >> > In my config I have startTier = 9 and endTier = 17 (default values)
> >> >
> >> >
> >> > On Mon, Dec 28, 2009 at 1:24 PM, Grant Ingersoll 
> >> wrote:
> >> >
> >> >> What do your queries look like?
> >> >>
> >> >> On Dec 28, 2009, at 9:30 AM, Mauricio Scheffer wrote:
> >> >>
> >> >>> Hi everyone,
> >> >>> I'm getting inconsistent behavior from Spatial Solr when searching
> with
> >> >>> different radii. For the same lat/long I get:
> >> >>>
> >> >>> radius=1 -> 1 result
> >> >>> radius=10 -> 0 result
> >> >>> radius=25 -> 2 results
> >> >>> radius=100 -> 2 results
> >> >>> radius=250 -> 0 results
> >> >>>
> >> >>> I don't understand why radius=10 and 250 return no results. Is this
> a
> >> >> known
> >> >>> bug? I'm using the default configuration as specified in the PDF.
> >> >>> BTW I also tried LocalSolr with the same results.
> >> >>>
> >> >>> Thanks
> >> >>> Mauricio
> >> >>
> >> >>
> >>
> >> --
> >> Grant Ingersoll
> >> http://www.lucidimagination.com/
> >>
> >> Search the Lucene ecosystem using Solr/Lucene:
> >> http://www.lucidimagination.com/search
> >>
> >>
> >
>

NoSuchFieldError: submap

[Mauricio Scheffer]

Hi, I'm trying to build from source to apply the field collapsing patch.
'Ant dist' runs just fine, no errors, but at startup I get a
"NoSuchFieldError: submap" exception (stack trace:
http://pastebin.com/NXsf0KJS ). This is before sending any requests. I don't
have any 'submap' field defined anywhere.
Has anyone seen this? Any ideas?

Thanks,
Mauricio

Re: NoSuchFieldError: submap

[Mauricio Scheffer]

Thanks Hoss, yeah I had an outdated jar, I ran ant clean then ant dist and
all is well now.

--
Mauricio

On Fri, May 28, 2010 at 3:39 PM, Chris Hostetter
wrote:

>
> : Hi, I'm trying to build from source to apply the field collapsing patch.
> : 'Ant dist' runs just fine, no errors, but at startup I get a
> : "NoSuchFieldError: submap" exception (stack trace:
> : http://pastebin.com/NXsf0KJS ). This is before sending any requests. I
> don't
> : have any 'submap' field defined anywhere.
> : Has anyone seen this? Any ideas?
>
> the "field" in question isn't refering to a field in your index -- it's a
> java error refering to a field of a java class.
>
> in a nutshell: some class file you are using at runtime is inconsistent
> with a class file thta you used at compile time.  the "submap" field of
> some object is manipulated on line 89 of your SynonymFilter.java file, but
> that object doesn't have a "submap" field.
>
> typically this type of problem happens when you doing have a clean
> classpath: older versions of jars are included as well, or the jars  you
> compiled against aren't included but other differnet jars with the same
> classes in them are.
>
>
>
> -Hoss
>
>