Re: pagerank??

2012-04-04 Thread Bing Li
According to my knowledge, Solr cannot support this. In my case, I get data by keyword-matching from Solr and then rank the data by PageRank after that. Thanks, Bing On Wed, Apr 4, 2012 at 6:37 AM, Manuel Antonio Novoa Proenza < mano...@estudiantes.uci.cu> wrote: > Hello, > > I have in my Solr

Re: Solr & HBase - Re: How is Data Indexed in HBase?

2012-02-23 Thread Bing Li
nt schema and index the > rank too for range queries and such. is my understanding of your scenario > wrong? > > thanks > > > On Wed, Feb 22, 2012 at 9:51 AM, Bing Li wrote: > >> Mr Gupta, >> >> Thanks so much for your reply! >> >> In my use

Re: Solr & HBase - Re: How is Data Indexed in HBase?

2012-02-22 Thread Bing Li
>> It's on our road map. >> >> FYI >> >> On Wed, Feb 22, 2012 at 9:28 AM, Bing Li wrote: >> >> > Jacques, >> > >> > Yes. But I still have questions about that. >> > >> > In my system, when users search with a keywor

How is Data Indexed in HBase?

2012-02-22 Thread Bing Li
Dear all, I wonder how data in HBase is indexed? Now Solr is used in my system because data is managed in inverted index. Such an index is suitable to retrieve unstructured and huge amount of data. How does HBase deal with the issue? May I replaced Solr with HBase? Thanks so much! Best regards,

Re: How to Sort By a PageRank-Like Complicated Strategy?

2012-01-28 Thread Bing Li
e: > You can update the document in the index quite frequently. IDNK what > your requirement is, another option would be to boost query time. > > On Sun, Jan 22, 2012 at 5:51 AM, Bing Li wrote: > > Dear Shashi, > > > > Thanks so much for your reply! > > > &

Re: How to Sort By a PageRank-Like Complicated Strategy?

2012-01-22 Thread Bing Li
Kant wrote: > Lucene has a mechanism to "boost" up/down documents using your custom > ranking algorithm. So if you come up with something like Pagerank > you might do something like doc.SetBoost(myboost), before writing to index. > > > > On Sat, Jan 21, 2012 at 5:07

Re: How to Sort By a PageRank-Like Complicated Strategy?

2012-01-21 Thread Bing Li
p N data you have > got. > > Sent from my iPad > > On Jan 21, 2012, at 1:33 PM, Bing Li wrote: > > > Dear all, > > > > I am using SolrJ to implement a system that needs to provide users with > > searching services. I have some questions about Solr searc

How to Sort By a PageRank-Like Complicated Strategy?

2012-01-21 Thread Bing Li
Dear all, I am using SolrJ to implement a system that needs to provide users with searching services. I have some questions about Solr searching as follows. As I know, Lucene retrieves data according to the degree of keyword matching on text field (partial matching). But, if I search data by str

Sort for Retrieved Data

2012-01-20 Thread Bing Li
Dear all, I have a question when sorting retrieved data from Solr. As I know, Lucene retrieves data according to the degree of keyword matching on text field (partial matching). If I search data by string field (complete matching), how does Lucene sort the retrieved data? If I add some filters,

Re: When Index is Updated Frequently

2011-03-04 Thread Bing Li
, in most Internet systems, the amount of mutable data is much less than that of immutable one. How do you think about my solution? Best, LB On Sat, Mar 5, 2011 at 2:45 AM, Michael McCandless < luc...@mikemccandless.com> wrote: > On Fri, Mar 4, 2011 at 10:09 AM, Bing Li wrote: > >

When Index is Updated Frequently

2011-03-04 Thread Bing Li
Dear all, According to my experiences, when the Lucene index updated frequently, its performance must become low. Is it correct? In my system, most data crawled from the Web is indexed and the corresponding index will NOT be updated any more. However, some indexes should be updated frequently li

Re: SolrJ Tutorial

2011-03-03 Thread Bing Li
Dear Lance, Could you tell me where I can find the unit tests code? I appreciate so much for your help! Best regards, LB On Sat, Jan 22, 2011 at 3:58 PM, Lance Norskog wrote: > The unit tests are simple and show the steps. > > Lance > > On Fri, Jan 21, 2011 at 10:41 PM,

Selection Between Solr and Relational Database

2011-03-03 Thread Bing Li
Dear all, I have started to learn Solr for two months. At least right now, my system runs good in a Solr cluster. I have a question when implementing one feature in my system. When retrieving documents by keyword, I believe Solr is faster than relational database. However, if doing the following

My Plan to Scale Solr

2011-02-17 Thread Bing Li
Dear all, I started to learn how to use Solr three months ago. My experiences are still limited. Now I crawl Web pages with my crawler and send the data to a single Solr server. It runs fine. Since the potential users are large, I decide to scale Solr. After configuring replication, a single ind

Detailed Steps for Scaling Solr

2011-02-11 Thread Bing Li
Dear all, I need to construct a site which supports searching for a large index. I think scaling Solr is required. However, I didn't get a tutorial which helps me do that step by step. I only have two resources as references. But both of them do not tell me the exact operations. 1) http://www.luc

Re: Solr Out of Memory Error

2011-02-09 Thread Bing Li
Dear Adam, I also got the OutOfMemory exception. I changed the JAVA_OPTS in catalina.sh as follows. ... if [ -z "$LOGGING_MANAGER" ]; then JAVA_OPTS="$JAVA_OPTS -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager" else JAVA_OPTS="$JAVA_OPTS -server -Xms8096m -Xmx80

Open Too Many Files

2011-02-02 Thread Bing Li
Dear all, I got an exception when querying the index within Solr. It told me that too many files are opened. How to handle this problem? Thanks so much! LB [java] org.apache.solr.client.solrj. SolrServerException: java.net.SocketException: Too many open files [java] at org.apache.solr.c

SolrDocumentList Size vs NumFound

2011-01-26 Thread Bing Li
Dear all, I got a weird problem. The number of searched documents is much more than 10. However, the size of SolrDocumentList is 10 and the getNumFound() is the exact count of results. When I need to iterate the results as follows, only 10 are displayed. How to get the rest ones?

Re: SolrJ Tutorial

2011-01-22 Thread Bing Li
n Sat, Jan 22, 2011 at 3:58 PM, Lance Norskog wrote: > The unit tests are simple and show the steps. > > Lance > > On Fri, Jan 21, 2011 at 10:41 PM, Bing Li wrote: > > Hi, all, > > > > In the past, I always used SolrNet to interact with Solr. It works great. >

SolrJ Tutorial

2011-01-21 Thread Bing Li
Hi, all, In the past, I always used SolrNet to interact with Solr. It works great. Now, I need to use SolrJ. I think it should be easier to do that than SolrNet since Solr and SolrJ should be homogeneous. But I cannot find a tutorial that is easy to follow. No tutorials explain the SolrJ programmi

Re: Indexing and Searching Chinese with SolrNet

2011-01-18 Thread Bing Li
Dear Jelsma, After configuring the Tomcat URIEncoding, Chinese characters can be processed correctly. I appreciate so much for your help! Best, LB On Wed, Jan 19, 2011 at 3:02 AM, Markus Jelsma wrote: > Hi, > > Yes but Tomcat might need to be configured to accept, see the wiki for more > inform

Re: Indexing and Searching Chinese with SolrNet

2011-01-18 Thread Bing Li
Dear Jelsma, My servlet container is Tomcat 7. I think it should accept Chinese characters. But I am not sure how to configure it. From the console of Tomcat, I saw that the Chinese characters in the query are not displayed normally. However, it is fine in the Solr Admin page. I am not sure eithe

Indexing and Searching Chinese with SolrNet

2011-01-18 Thread Bing Li
Dear all, After reading some pages on the Web, I created the index with the following schema. .. .. It must be correct, right? However, when sending a query though SolrNet

Indexing and Searching Chinese

2011-01-18 Thread Bing Li
Hi, all, Now I cannot search the index when querying with Chinese keywords. Before using Solr, I ever used Lucene for some time. Since I need to crawl some Chinese sites, I use ChineseAnalyzer in the code to run Lucene. I know Solr is a server for Lucene. However, I have no idea know how to conf

SolrHome and Solr Data Dir in solrconfig.xml

2010-12-09 Thread Bing Li
indexes are put under $TOMCAT_HOME/bin. This is NOT what I expect. I hope indexes are under SolrHome. Could you please give me a hand? Best, Bing Li

Solr Got Exceptions When "schema.xml" is Changed

2010-12-04 Thread Bing Li
Dear all, I am a new user of Solr. Now I am just trying to try some basic samples. Solr can be started correctly with Tomcat. However, when putting a new schema.xml under SolrHome/conf and starting Tomcat again, I got the following two exceptions. The Solr cannot be started correctly unless usin

Import Data Into Solr

2010-12-02 Thread Bing Li
wish to import the Lucene indexes into Solr, may I have any other approaches? I know that Solr is a serverized Lucene. Thanks, Bing Li

Re: How to Transmit and Append Indexes

2010-11-19 Thread Bing Li
ching large indexes in a large scale distributed environment, right? Thanks! Bing On Sat, Nov 20, 2010 at 3:01 AM, Gora Mohanty wrote: > On Sat, Nov 20, 2010 at 12:05 AM, Bing Li wrote: > > Dear Erick, > > > > Thanks so much for your help! I am new in Solr. So I have no id

Re: How to Transmit and Append Indexes

2010-11-19 Thread Bing Li
to the updated index upon > successful replication. > > Older versions of Solr used rsynch & etc. > > Best > Erick > > On Fri, Nov 19, 2010 at 10:52 AM, Bing Li wrote: > >> Hi, all, >> >> I am working on a distributed searching system. Now I have

Re: Is it fine to transmit indexes in this way?

2010-11-19 Thread Bing Li
queries must be responded instantly. That's what I mean "appending". Does it happen in Solr? Best, Bing On Sat, Nov 20, 2010 at 1:58 AM, Gora Mohanty wrote: > On Fri, Nov 19, 2010 at 10:53 PM, Bing Li wrote: > > Hi, all, > > > > Since I didn't find that L

Is it fine to transmit indexes in this way?

2010-11-19 Thread Bing Li
o existing indexes? Does the appending affect the querying? I am learning Solr. But it seems that Solr does that for me. However, I have to set up Tomcat to use Solr. I think it is a little bit heavy. Thanks! Bing Li

How to Transmit and Append Indexes

2010-11-19 Thread Bing Li
which I can transmit. After transmission, how to append them to the old indexes? Does the appending block searching? Thanks so much for your help! Bing Li