Solr question

2008-03-18 Thread Raghav Kapoor
Hi All:
I am new to Solr and I am facing a question if solr would can be helpful in a 
project that I'm working on.
The project is a client/server app that requires a client app to index the 
documents and send the results in rdf to server. The client needs to be smart 
enough to know when a new document has been added to a specified folder, index 
it and send the results in rdf/xml to the server. The server will be a web 
service which will parse the xml and store the metadata in the a database. The 
search will be conducted on the server and will return the results from the 
database which will be links to the documents on the client. The client , which 
is also running a webserver will take the request when the user clicks on the 
link to the document residing on the client. 
I believe lucene will be useful in this scenario and solr can be used as a web 
app. 
I would like to get any input on this architecture and would request any 
pointers if there is any app already doing something similar and how 
lucene/solr can be useful in this case.

Thanks for your time.


Best Regards
Raghav 


  

Never miss a thing.  Make Yahoo your home page. 
http://www.yahoo.com/r/hs


Help Requested

2008-03-19 Thread Raghav Kapoor
Hi All:

I am new to Solr and I am facing a question if solr can be helpful in a project 
that I'm working on.
The project is a client/server app that requires a client app to index the 
documents and send the results in rdf to server. 
The client needs to be smart enough to know when a new document has been added 
to a specified folder, index it and send the results in rdf/xml to the server. 
The server will be a web service which will parse the xml and store the 
metadata in the a database. The search will be conducted on the server and will 
return the results from the database which will be links to the documents on 
the client. 
The client , which is also running a webserver will take the request when the 
user clicks on the link to the document residing on the client. 
I believe lucene will be useful in this scenario and solr can be used as a web 
app. 
I would like to get any input on this architecture and would request any 
pointers if there is any app already doing something similar and how 
lucene/solr can be useful in this case.

I would highly appreciate any thoughts on this !

Best Regards
Raghav 


  

Looking for last minute shopping deals?  
Find them fast with Yahoo! Search.  
http://tools.search.yahoo.com/newsearch/category.php?category=shopping


Re: Help Requested

2008-03-20 Thread Raghav Kapoor
Thanks Norberto !

> Any particular reason why need the server in this
> situation? pretty much
> everything you are doing can be done locally.
> Except, probably, cross linking
> between client's documents. I have no idea in what
> kind of environment this app
> is supposed to run (home? office LAN? the interweb
> :P ? ). 

So its going to be a client/server app where all the
documents will be stored on the client and only
metadata of those docs will be sent to the server.
That way server does not have to store any real
documents. Its an internet based application. Search
on the server will read the metadata for keywords and
send the request to all the clients that contain
documents with that keyword. We cannot store
everything on one client, all clients are different
machines distributed all over the world.

> you don't need a webserver for this, just generate a
> page in from your
> webserver with file:// links and all you need is to
> render it locally. 

How will the client serve the documents stored locally
through a standard mechanism (like port 80) to send
documents to the server when the server requests the
documents ? The client will not open any special ports
for the server, so we need the web server, I guess ? 


> there are plenty of desktop document indexers using
> lucene on some form or
> another, and other indexing technologies. I dont
> know if any uses Solr  - yet.
> And i know of a few apps out there that do something
> similar to what you
> describe though with different design as the goals
> are somewhat different.


The client application needs to give the users an
ability of handling metadata of the documents that
will be sent to the server so that efficient searching
can be conducted, so I assume we need a web app like
solr (or create our own using lucene).

Let me know your thoughts and thanks again for your
reply !

Regards

Raghav.


--- Norberto Meijome <[EMAIL PROTECTED]> wrote:

> On Wed, 19 Mar 2008 21:22:42 -0700 (PDT)
> Raghav Kapoor <[EMAIL PROTECTED]> wrote:
> 
> > I am new to Solr and I am facing a question if
> solr can be helpful in a project that I'm working
> on.
> 
> welcome :)
> 
> > The project is a client/server app that requires a
> client app to index the documents and send the
> results in rdf to server. 
> > The client needs to be smart enough to know when a
> new document has been added to a specified folder,
> index it and send the results in rdf/xml to the
> server. The server will be a web service which will
> parse the xml and store the metadata in the a
> database. The search will be conducted on the server
> and will return the results from the database which
> will be links to the documents on the client.
> 
> Any particular reason why need the server in this
> situation? pretty much
> everything you are doing can be done locally.
> Except, probably, cross linking
> between client's documents. I have no idea in what
> kind of environment this app
> is supposed to run (home? office LAN? the interweb
> :P ? ). 
> 
> > The client , which is also running a webserver
> will take the request when the user clicks on the
> link to the document residing on the client. 
> 
> you don't need a webserver for this, just generate a
> page in from your
> webserver with file:// links and all you need is to
> render it locally. 
> 
> > I believe lucene will be useful in this scenario
> and solr can be used as a web app. 
> > I would like to get any input on this architecture
> and would request any pointers if there is any app
> already doing something similar and how lucene/solr
> can be useful in this case.
> 
> there are plenty of desktop document indexers using
> lucene on some form or
> another, and other indexing technologies. I dont
> know if any uses Solr  - yet.
> And i know of a few apps out there that do something
> similar to what you
> describe though with different design as the goals
> are somewhat different.
> 
> B
> _
> {Beto|Norberto|Numard} Meijome
> 
> "Some cause happiness wherever they go; others,
> whenever they go."
>   Oscar Wilde
> 
> I speak for myself, not my employer. Contents may be
> hot. Slippery when wet.
> Reading disclaimers makes you go blind. Writing them
> is worse. You have been
> Warned.
> 



  

Be a better friend, newshound, and 
know-it-all with Yahoo! Mobile.  Try it now.  
http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ


Reusing lucene index file in Solr

2008-03-21 Thread Raghav Kapoor
Hi All:

I have a simple question :

How can we re-use an existing lucene index file (.cfs)
in Solr and search on it in solr?
I need to do this as the index is created on one
machine(client) to be used by solr server for
searching. The solr server will refer to this index
file by some http url. We cannot store this index file
on the solr server.

Any thoughts will be appreciated !

Regards

Raghav.




  

Never miss a thing.  Make Yahoo your home page. 
http://www.yahoo.com/r/hs


Re: Reusing lucene index file in Solr

2008-03-22 Thread Raghav Kapoor
Hi Erik,

Thanks for your response !

On Page 180 of Lucene In action, there is a reference
for searching multiple indexes remotely using RMI. I
am still trying to figure out how that works and if
that would fit in our scenario. We have multiple
client machines running a web server where the indexes
will reside. Can the server running solr query these
indexes remotely over http ?

Regards,

Raghav


--- Erik Hatcher <[EMAIL PROTECTED]> wrote:

> 
> On Mar 22, 2008, at 12:32 AM, Raghav Kapoor wrote:
> > How can we re-use an existing lucene index file
> (.cfs)
> > in Solr and search on it in solr?
> > I need to do this as the index is created on one
> > machine(client) to be used by solr server for
> > searching. The solr server will refer to this
> index
> > file by some http url. We cannot store this index
> file
> > on the solr server.
> 
> Solr needs file-level access to the Lucene index,
> perhaps by some  
> shared disk - but not via HTTP.
> 
> You certainly can use an indexed created by pure
> Java Lucene in Solr,  
> provided the schema.xml jives with how the index is
> structured and is  
> to be queried.
> 
>   Erik
> 
> 



  

Be a better friend, newshound, and 
know-it-all with Yahoo! Mobile.  Try it now.  
http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ


Converting lucene index into solr usable xml

2008-03-22 Thread Raghav Kapoor
Hi All:

How can we convert the lucene index file into format
that solr can understand. I have very little knowledge
about solr and not sure if there is a way we can post 
the .cfs index file directly to the solr server with
this command :-
java -jar post.jar ?

I assume post.jar only takes xml documents ?

Any help would be appreciated !

Regards

Raghav


  

Looking for last minute shopping deals?  
Find them fast with Yahoo! Search.  
http://tools.search.yahoo.com/newsearch/category.php?category=shopping


Re: Reusing lucene index file in Solr

2008-03-22 Thread Raghav Kapoor
Hi Yonik,

Thanks for reply !

Once we have exported the index file on the server
where Solr is running, how can we configure solr to
use that index file and search on it ?

In short, how does solr search on java lucene indexed
files ?

I am very new to Solr and am still trying to learn the
basics. Since there is no proper documentation on
solr, this mailing list is my only hope.

Thanks

Raghav !
--- Yonik Seeley <[EMAIL PROTECTED]> wrote:

> On Sat, Mar 22, 2008 at 12:22 PM, Raghav Kapoor
> <[EMAIL PROTECTED]> wrote:
> >  On Page 180 of Lucene In action, there is a
> reference
> >  for searching multiple indexes remotely using
> RMI. I
> >  am still trying to figure out how that works and
> if
> >  that would fit in our scenario. We have multiple
> >  client machines running a web server where the
> indexes
> >  will reside. Can the server running solr query
> these
> >  indexes remotely over http ?
> 
> You need something running locally to read and
> export the lucene index
> via whatever method.
> Reconsider your requirements to see if they really
> make sense.
> 
> -Yonik
> 



  

Never miss a thing.  Make Yahoo your home page. 
http://www.yahoo.com/r/hs