Re: Are subqueries possible in Solr? If so, are they performant?

2009-11-09 Thread Vicky_Dev


Hi Team,
Is it possible to write subqueries in dismaxrequest handler?

~Vikrant


Edoardo Marcora wrote:
> 
> Does Solr have the ability to do subqueries, like this one (in SQL):
> 
> SELECT id, first_name
> FROM student_details
> WHERE first_name IN (SELECT first_name
> FROM student_details
> WHERE subject= 'Science'); 
> 
> If so, how performant is this kind of queries?
> 

-- 
View this message in context: 
http://old.nabble.com/Are-subqueries-possible-in-Solr--If-so%2C-are-they-performant--tp24467023p26271600.html
Sent from the Solr - User mailing list archive at Nabble.com.



Re: Are subqueries possible in Solr? If so, are they performant?

2009-11-09 Thread Vicky_Dev

Thanks Otis for your response.

Is it possible to get result of one solr query feed into another Solr Query?

Issue which I am facing right now is::
I am getting results from one query and I just need 2 index attribute values
. These index attribute values are used for form new Query to Solr. 

Since Solr gives result only for GET request, hence there is restriction on
: forming query with all values.

Please do send your views on above problem

Thanks
~Vikrant




Otis Gospodnetic wrote:
> 
> You can mimic them by combining 2 clauses with an AND.
> e.g.
> cookies
> vs.
> cookies AND vanilla
> 
> Otis
> --
> Sematext is hiring -- http://sematext.com/about/jobs.html?mls
> Lucene, Solr, Nutch, Katta, Hadoop, HBase, UIMA, NLP, NER, IR
> 
> 
> 
> - Original Message 
>> From: Vicky_Dev 
>> To: solr-user@lucene.apache.org
>> Sent: Mon, November 9, 2009 1:48:03 PM
>> Subject: Re: Are subqueries possible in Solr? If so, are they performant?
>> 
>> 
>> 
>> Hi Team,
>> Is it possible to write subqueries in dismaxrequest handler?
>> 
>> ~Vikrant
>> 
>> 
>> Edoardo Marcora wrote:
>> > 
>> > Does Solr have the ability to do subqueries, like this one (in SQL):
>> > 
>> > SELECT id, first_name
>> > FROM student_details
>> > WHERE first_name IN (SELECT first_name
>> > FROM student_details
>> > WHERE subject= 'Science'); 
>> > 
>> > If so, how performant is this kind of queries?
>> > 
>> 
>> -- 
>> View this message in context: 
>> http://old.nabble.com/Are-subqueries-possible-in-Solr--If-so%2C-are-they-performant--tp24467023p26271600.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
> 
> 
> 

-- 
View this message in context: 
http://old.nabble.com/Are-subqueries-possible-in-Solr--If-so%2C-are-they-performant--tp24467023p26278872.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Are subqueries possible in Solr? If so, are they performant?

2009-11-09 Thread Vicky_Dev

Thanks Otis for your response.

Is it possible to get result of one solr query feed into another Solr Query?

Issue which I am facing right now is::
I am getting results from one query and I just need 2 index attribute values
. These index attribute values are used for form new Query to Solr. 

Since Solr gives result only for GET request, hence there is restriction on
: forming query with all values.

Please do send your views on above problem

Thanks
~Vikrant




Otis Gospodnetic wrote:
> 
> You can mimic them by combining 2 clauses with an AND.
> e.g.
> cookies
> vs.
> cookies AND vanilla
> 
> Otis
> --
> Sematext is hiring -- http://sematext.com/about/jobs.html?mls
> Lucene, Solr, Nutch, Katta, Hadoop, HBase, UIMA, NLP, NER, IR
> 
> 
> 
> - Original Message 
>> From: Vicky_Dev 
>> To: solr-user@lucene.apache.org
>> Sent: Mon, November 9, 2009 1:48:03 PM
>> Subject: Re: Are subqueries possible in Solr? If so, are they performant?
>> 
>> 
>> 
>> Hi Team,
>> Is it possible to write subqueries in dismaxrequest handler?
>> 
>> ~Vikrant
>> 
>> 
>> Edoardo Marcora wrote:
>> > 
>> > Does Solr have the ability to do subqueries, like this one (in SQL):
>> > 
>> > SELECT id, first_name
>> > FROM student_details
>> > WHERE first_name IN (SELECT first_name
>> > FROM student_details
>> > WHERE subject= 'Science'); 
>> > 
>> > If so, how performant is this kind of queries?
>> > 
>> 
>> -- 
>> View this message in context: 
>> http://old.nabble.com/Are-subqueries-possible-in-Solr--If-so%2C-are-they-performant--tp24467023p26271600.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
> 
> 
> 

-- 
View this message in context: 
http://old.nabble.com/Are-subqueries-possible-in-Solr--If-so%2C-are-they-performant--tp24467023p26278875.html
Sent from the Solr - User mailing list archive at Nabble.com.



Re: complex queries

2009-11-11 Thread Vicky_Dev


Hi Erik,

Is it possible to get result of one solr query feed into another Solr Query?

Issue which I am facing right now is::
I am getting results from one query and I just need 2 index attribute values
. These index attribute values are used for form new Query to Solr.

Since Solr gives result only for GET request, hence there is restriction on
: forming query with all values.

Please do send your views on above problem

Thanks
~Vikrant 



Erik Hatcher wrote:
> 
> 
> On May 6, 2008, at 8:57 PM, Kevin Osborn wrote:
>> I don't think this is possible, but I figure that I would ask.
>>
>> So, I want to find documents that match a search term and where a  
>> field in those documents are also in the results of a subquery.  
>> Basically, I am looking for the Solr equivalent of doing a SQL IN  
>> clause.
> 
> "search clause" AND field:(value1 OR value2 OR value3)
> 
> does that do the trick for you?If not, could you elaborate with  
> an example?
> 
>   Erik
> 
> 
> 

-- 
View this message in context: 
http://old.nabble.com/complex-queries-tp17095335p26312245.html
Sent from the Solr - User mailing list archive at Nabble.com.



exclude some fields from copying dynamic fields | schema.xml

2009-11-13 Thread Vicky_Dev

Hi, 
we are using the following entry in schema.xml to make a copy of one type of
dynamic field to another : 
 

Is it possible to exclude some fields from copying.

We are using Solr1.3

~Vikrant

-- 
View this message in context: 
http://old.nabble.com/exclude-some-fields-from-copying-dynamic-fields-%7C-schema.xml-tp26335109p26335109.html
Sent from the Solr - User mailing list archive at Nabble.com.



Re: exclude some fields from copying dynamic fields | schema.xml

2009-11-15 Thread Vicky_Dev

Thanks for response

Defining field is not working :( 

Is there any way to stop copy task for particular set of values

Thanks
~Vikrant



Lance Norskog-2 wrote:
> 
> There is no direct way.
> 
> Let's say you have a "nocopy_s" and you do not want a copy
> "nocopy_str_s". This might work: declare "nocopy_str_s" as a field and
> make it not indexed and not stored. I don't know if this will work.
> 
> It requires two overrides to work: 1) that declaring a field name that
> matches a wildcard will override the default wildcard rule, and 2)
> that "stored=false indexed=false" works.
> 
> On Fri, Nov 13, 2009 at 3:23 AM, Vicky_Dev
>  wrote:
>>
>> Hi,
>> we are using the following entry in schema.xml to make a copy of one type
>> of
>> dynamic field to another :
>> 
>>
>> Is it possible to exclude some fields from copying.
>>
>> We are using Solr1.3
>>
>> ~Vikrant
>>
>> --
>> View this message in context:
>> http://old.nabble.com/exclude-some-fields-from-copying-dynamic-fields-%7C-schema.xml-tp26335109p26335109.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
> 
> 
> 
> -- 
> Lance Norskog
> goks...@gmail.com
> 
> 

-- 
View this message in context: 
http://old.nabble.com/exclude-some-fields-from-copying-dynamic-fields-%7C-schema.xml-tp26335109p26367099.html
Sent from the Solr - User mailing list archive at Nabble.com.



Solr tutorial

2008-08-04 Thread Vicky_Dev

Hi 

I am Newbie to Solr . I am looking for guide to build a Solr based search. I
was not able to find any book/reference manual on Solr which can help out in
building application around solr. 

Links mentioned "02 October 2007 - Solr at OSSummit Asia" on
http://lucene.apache.org/solr/ is not working

Kindly send links for tutorials around building application around Solr. I
am looking for reference manual like
..http://static.springframework.org/spring/docs/2.0.x/spring-reference.pdf 

Thanks in Advance

Vikrant


-- 
View this message in context: 
http://www.nabble.com/Solr-tutorial-tp18816315p18816315.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Solr tutorial

2008-08-04 Thread Vicky_Dev


Thanks Erik for quick response

Vikrant


Erik Hatcher wrote:
> 
> 
> On Aug 4, 2008, at 1:55 PM, Vicky_Dev wrote:
>> I am Newbie to Solr . I am looking for guide to build a Solr based  
>> search. I
>> was not able to find any book/reference manual on Solr which can  
>> help out in
>> building application around solr.
>>
>> Links mentioned "02 October 2007 - Solr at OSSummit Asia" on
>> http://lucene.apache.org/solr/ is not working
> 
> OSSummit Asia did not materialize last year - it was "postponed", and  
> may occur later this  year: <http://www.ossummit.com/>.
> 
> There are several Lucene/Solr/Mahout related sessions at the upcoming  
> ApacheCon US, so please consider attending this great conference.
> 
>> Kindly send links for tutorials around building application around  
>> Solr.
> 
> The best tutorial is built right in:
> <http://lucene.apache.org/solr/tutorial.html 
>  >
> 
> And you'll get your questions answered here when you run into any  
> issues.
> 
> 
>   Erik
> 
> 
> 

-- 
View this message in context: 
http://www.nabble.com/Solr-tutorial-tp18816315p18817850.html
Sent from the Solr - User mailing list archive at Nabble.com.



solr 1.3 ??

2008-08-04 Thread Vicky_Dev

Hi

Any ideas on when 1.3 might be released? 

In solr 1.3, there are really good features like--DataImportHandler which I
want to use in my project. Trunk folder is changing regularly. 

Can we get solr 1.3 release as soon as possible? Otherwise some interim
release (1.2.x) containing DataImportHandler will also a good option. 

Any Thoughts?

~Vikrant

-- 
View this message in context: 
http://www.nabble.com/solr-1.3tp18824290p18824290.html
Sent from the Solr - User mailing list archive at Nabble.com.



Re: solr 1.3 ??

2008-08-05 Thread Vicky_Dev


Thanks for response Norberto 

Problem is that ..we can not use non release version whilst starting new
project. 

For e.g.: if you use one method which is introduced in DataImportHAndler and
later in point in solr 1.3, same method is removed then we have to revise
all code.

Can we get solr 1.3 release as soon as possible? Otherwise some interim
release (1.2.x) containing DataImportHandler will also a good option. 

Are we expecting solr 1.3 release soon ???

~Vikrant 



Norberto Meijome-2 wrote:
> 
> On Mon, 4 Aug 2008 21:13:09 -0700 (PDT)
> Vicky_Dev <[EMAIL PROTECTED]> wrote:
> 
>> Can we get solr 1.3 release as soon as possible? Otherwise some interim
>> release (1.2.x) containing DataImportHandler will also a good option. 
>> 
>> Any Thoughts?
> 
> 
> have you tried one of the nightly builds? I've been following it every so
> often...sometimes there is a problem, but hardly ever... you can find a
> build
> you are comfortable with, and it'll be far closer to the actual 1.3 when
> released than 1.2 .
> 
> B
> 
> _
> {Beto|Norberto|Numard} Meijome
> 
> Quantum Logic Chicken:
>   The chicken is distributed probabalistically on all sides of the
>   road until you observe it on the side of your course.
> 
> I speak for myself, not my employer. Contents may be hot. Slippery when
> wet.
> Reading disclaimers makes you go blind. Writing them is worse. You have
> been
> Warned.
> 
> 

-- 
View this message in context: 
http://www.nabble.com/solr-1.3tp18824290p18833196.html
Sent from the Solr - User mailing list archive at Nabble.com.



Indexing time boosts on particular field

2008-08-05 Thread Vicky_Dev

Hi

Requirement: For given document , if course type = "MATHMATICS" then search
results contains Course type "MATHMATICS"  documents then show search
results should show Course type "MATHMATICS"  documents prior than any other
documents.

Course Type will be one of the field whist creating solr index

I have went through Index-time boost documentation. It is saying:

An Index-time boost on a value of a multiValued field applies to all values
for that field and not on individual values.

Is there any way to boost Course type "MATHMATICS"  documents at index time?

Thanks in advance
~Vikrant



-- 
View this message in context: 
http://www.nabble.com/Indexing-time-boosts-on-particular-field-tp18839400p18839400.html
Sent from the Solr - User mailing list archive at Nabble.com.


External Application (JIVE) : integration

2008-08-11 Thread Vicky_Dev

Hi 

I am beginner in Solr. 

Question: We have two types of search in site. 
a) First one is : Product search . Since all data is within database (our
control environment, this type of search can be implemented using Solr
(based on Lucene index) 
b) Second one is: External application / Third party search--Jive search
(Community search)

For second type of search web services are exposed. We can pass search query
to external application and retrieve results from third party.

Now results from both searches needs to be combined and shown to user 

For e.g. If search query contains "Canon" then site search will give site
results (suppose 90 search results) and Jive search gives 30 items 

Now on screen we have to shown combined results. Results should be sorted by
relevance . Search results shown on screen can contain --first result record
from site search , second result record from jive 
Third from Jive and next one from site search . It entirely depend on
relevance to search query strin

Is it possible to dynamically add third party results to search results and
call function to rearrange search results ?

~Vikrant



-- 
View this message in context: 
http://www.nabble.com/External-Application-%28JIVE%29-%3A-integration-tp18926597p18926597.html
Sent from the Solr - User mailing list archive at Nabble.com.



Synonym Pattern | Need more details

2008-10-15 Thread Vicky_Dev

Hi

We are using Solr 1.3 Synonym feature. There are different patterns found in
Solr conf ..synnym folder.

Can somebody explain meaning of different patterns?

PATTERN 1:
#some test synonym mappings unlikely to appear in real input text
aaa => 
bbb => 1 2
ccc => 1,2

PATTERN 2:
a\=>a => b\=>b
a\,a => b\,b

PATTERN 3:
fooaaa,baraaa,bazaaa

# Some synonym groups specific to this example
GB,gib,gigabyte,gigabytes
MB,mib,megabyte,megabytes
Television, Televisions, TV, TVs
#notice we use "gib" instead of "GiB" so any WordDelimiterFilter coming
#after us won't split it into two words.

PATTERN 4:

Java ==> Programming, Object  Coffee


Please explain above patterns within Synonym file.

If "Java ==> Programming, Object  Coffee" means when user searches for Java
Search term, display results for documents containing Programming OR
documents containing Object OR documents containing Coffee

Suppose equivalent synonym for Java is Object Oriented language... How this
should be represented in synonym txt file

Thanks in advance

~Vikrant Shirbhate

-- 
View this message in context: 
http://www.nabble.com/Synonym-Pattern-%7C-Need-more-details-tp2214p2214.html
Sent from the Solr - User mailing list archive at Nabble.com.



Data Folder in Multicore | Solconfig entry not working

2008-10-15 Thread Vicky_Dev

Hi All,

We are using latest solr release 1.3.  Solr has been configured to use
multicore feature. Index has been created successfully. And when using Solr
Admin screen, index document is coming up correctly in the response. But
when I start locating index (.cfs) file into folders . File is not created
at all. 

Solr Config xml entry (core 1) :

${solr.data.dir:./solr/data} 

Even 0 is set to zero
, then also index file is not getting created within multicore/core0/data

Please send your thoughts on this issue.  Is there any additional setting we
have to do for indexes

Thanks in advance

~Vikrant Shirbhate
-- 
View this message in context: 
http://www.nabble.com/Data-Folder-in-Multicore-%7C-Solconfig-entry-not-working-tp2839p2839.html
Sent from the Solr - User mailing list archive at Nabble.com.



Re: Data Folder in Multicore | Solconfig entry not working

2008-10-23 Thread Vicky_Dev

Thanks Hoss..

That really work like magic :) 

~Vikrant Shirbhate


hossman wrote:
> 
> 
> : Admin screen, index document is coming up correctly in the response. But
> : when I start locating index (.cfs) file into folders . File is not
> created
> : at all. 
> : 
> : Solr Config xml entry (core 1) :
> : 
> : ${solr.data.dir:./solr/data} 
> 
> unless yo uare defining a solr.data.dir system property, i believe that 
> "./solr/data" directory is getting created in whatever the current working 
> directory is for your Servlet Container.  if you eliminate that  
> directive solr will create a data directory in the directory you have for 
> your core.
> 
> 
> 
> 
> -Hoss
> 
> 
> 

-- 
View this message in context: 
http://www.nabble.com/Data-Folder-in-Multicore-%7C-Solconfig-entry-not-working-tp2839p20136634.html
Sent from the Solr - User mailing list archive at Nabble.com.



DataImportHandler for updating indexes and DiscMax Request Handler for query

2008-12-20 Thread Vicky_Dev

Hi Team,

I am currently using DiscMax Request Handler for indexing and querying to
Solr. DiscMax Request Handler (Ranking / Boosting/ Blocking etc.)  is
working correclty. 

Issue: 
There are different database table on which query was done and accordingly
Solr index will be created. 
If any contents in any of database table are changed (delete/update/insert),
index should be updated (Java class/webservice) should get called to update
index. Logic for creating/ updating index is very specific to requirements

After going through Solr 1.3 documentation, Dataimporthandler seems to be
good one. Since after changes in database table, it will automatically
update indexes.


Is it possible to 
--customize dataimporthandler to call webservice and send updated data (e.g.
product ID's in PRODUCTS table) to webservice.

--use Data importhandler for updating indexes and DiscMax Request Handler
for query

We are using Solr 1.3 version and oracle 10G database.

Any pointers will be helpful

Thanks
~Vikrant

Vikrant Shirbhate


-- 
View this message in context: 
http://www.nabble.com/DataImportHandler-for-updating-indexes-and-DiscMax-Request-Handler-for-query-tp21107873p21107873.html
Sent from the Solr - User mailing list archive at Nabble.com.



Date field issue within DismaxrequestHandler | searchterm is invalid date field.

2009-01-18 Thread Vicky_Dev

Hi, 

We are facing issues while using dismaxrequesthandler for date fields. 

We have to define date fields in  of solrConfig.xml. 

 ..
productPublicationDate_product_dt^1.0  

as soon as we add this in solrConfig.xml, dismax stops working for other
attributes. 

?q=searchterm&qt=dismaxrequest gives error:

"The request sent by the client was syntactically incorrect (Invalid Date
String:'searchTerm')."
This is because dismax request tries to search the term in all the
attributes defined in  tag, Is there any way to avoid this search. 

Please suggest what should we do to solve the issue. 

SolrConfig.xml  Contents 

 
 
  
  false
  
  false
  
  10
  
 explicit 
  
 0.01 
 isbn10_product_s^1.0 isbn13_product_s^1.0
Index_Type_s^1.0 prdMainTitle_product_s^1.0 categoryIds_product_s^1.0
imprint_product_s^1.0 strapline_product_s^1.0 subject_product_s^1.0
prdPubDate_product_s^1.0 readBy_product_s^1.0 aluminator_product_s^1.0
editor_product_s^1.0 productType_product_s^1.0 authorLastName_product_s^1.0
edition_product_s^1.0 discipline_product_s^1.0 copyrightYear_product_s^1.0
courseId_course_s^1.0 indexType_course_s^1.0 courseType_course_s^1.0
courseJacketImage_course_s^1.0 sourceGroupName_course_s^1.0
subCompany_course_s^1.0 courseCodeSeq_course_s^1.0 discCode_course_s^1.0
displayName_course_s^1.0 programId_program_s^1.0 indexType_program_s^1.0
programType_program_s^1.0 groupNm_program_s^1.0 introText_program_s^1.0
programJacketImage_program_s^1.0 productPublicationDate_product_dt^1.0 

  
 
  
 


 english^90 hindi^123 Glorious^2000 highlighting^1000
maths^100 ab^12 erer^4545 
  
*,score 
  
 
 
  spellcheck

  


Thanks in advance

~Vikrant
Vikrant Shirbhate


-- 
View this message in context: 
http://www.nabble.com/Date-field-issue-within-DismaxrequestHandler--%7C-searchterm-is-invalid-date-field.-tp21526607p21526607.html
Sent from the Solr - User mailing list archive at Nabble.com.



Re: Tools for Managing Synonyms, Elevate, etc.

2009-02-02 Thread Vicky_Dev

Mark,

Use GUI (may be custom build one) to read files which are present on Solr
server. These files can be read using webservice/RMI call. 

Do all manipulation on synonyms.txt contents and then call webservice/RMI
call to save that information. After saving information , just call RELOAD.


Check
::http://wiki.apache.org/solr/CoreAdmin#head-3f125034c6a64611779442539812067b8b430930

 http://localhost:8983/solr/admin/cores?action=RELOAD&core=core0 

Hope this helps

~Vikrant




Cohen, Mark - IS&T wrote:
> 
> I'm considering building some tools for our internal non-technical staff
> to write to synonyms.txt, elevate.xml, spellings.txt, and protwords.txt
> so software developers don't have to maintain them.  Before my team
> starts building these tools, has anyone done this before?  If so, are
> these tools available as open source?  
> 
> Thanks,
> Mark Cohen
> 
> 

-- 
View this message in context: 
http://www.nabble.com/Tools-for-Managing-Synonyms%2C-Elevate%2C-etc.-tp21696372p21796832.html
Sent from the Solr - User mailing list archive at Nabble.com.



Re: Dynamic fields in schema.xml file

2009-02-02 Thread Vicky_Dev

Hi Sagar,

Change dynamic field attribute( C,D and E)--stored = true and validate

if above suggestion is not working , can you share your schema and
solrconfig xml contents?


~Vikrant


Sagar Khetkade-2 wrote:
> 
> 
> 
> Hi,
>  
> I am trying out the dynamic field in schema.xml with its attribute as
> true. Right now I indexing 1 articles having five fields in which the
> two fields are explicitly mention as text field and others are the dynamic
> fields. But while search if the query is fired on the last of the dynamic
> field then the results are retrieved but not for the earlier dynamic
> fields. 
>  
> Eg:  A, B, C, D and E  are the fields. A and B are the explicitly
> mentioned fields with A fields having attribute as indexed=true and
> stored=true and B is having indexed=true. Here A field is unique so is a
> required fields.
> Other fields coming (C, D and E) are considered as dynamic fields with
> attribute indexed=true. So if search is made on E the results are
> retrieved but results are not coming while search on C and D. 
> I have also cross verified with document frequency count. The document
> frequency count is coming for A, B and C field but not on C and D fields. 
> I am stuck up on this issue. Is the schema ( my thinking ) is wrong or
> something else. 
>  
> Regards,
> Sagar Khetkade
> _
> Plug in to the MSN Tech channel for a full update on the latest gizmos
> that made an impact.
> http://computing.in.msn.com/
> 

-- 
View this message in context: 
http://www.nabble.com/Dynamic-fields-in-schema.xml-file-tp21784970p21796922.html
Sent from the Solr - User mailing list archive at Nabble.com.



Query | Solr conf and data (index) distribution using master slave configuration

2009-04-22 Thread Vicky_Dev

I am working on replicating data from one Solr set on a Linux Box to Second
Solr on another Linux box. In order to achieve the same we will use the
SolrCollectionDistributionScripts(snapshooter, snappuller etc) and rsync
utility.

Configurations:
1. Apache Solr 1.3.0
2. Machines : Linux
3. Topology --1 Master and 1 slave

Settings done:

Solr on the both Linux boxes contains multiple cores. I have disintegrated
the data to be indexed among multicores, sample solr path of data folder for
the same is like:

Path :: {SOLR_HOME}/solr/multicore//data

Sample :
/apache-solr-1.3.0/example/solr/multicore/CORE_WWW.ABCD.COM/data

* SOLR_HOME :: /apache-solr-1.3.0/example/
** multi_corename :: CORE_WWW.ABCD.COM

Thus we will be going to have multiple cores on master as well as slaves
servers

As mentioned on http://wiki.apache.org/solr/CollectionDistribution :For the
Solr distribution scripts, the name of the index directory can be defined by
the environment variable data_dir in the configuration file
conf/scripts.conf

Example conf/scripts.conf file on  slave solr server :
user=
solr_hostname=localhost
solr_port=8080
rsyncd_port=18983
data_dir=${SOLR_HOME}/solr/muticore/CORE_WWW.ABCD.COM /data
webapp_name=solr
master_host=10.x.xx.xxx
master_data_dir=${SOLR_HOME}/solr/muticore/CORE_WWW.ABCD.COM/data
master_status_dir=${SOLR_HOME}/solr/muticore/CORE_WWW.ABCD.COM /status

The index directory name mentioned above should match the value used by the
Solr server which is defined in solr/conf/solrconfig.xml.

Following are few queries:

1. Please confirm whether the tag entry  : 
In solrconfig.xml should match for the  Slave solr server / master solr
server in accordance to the scripts.conf configuration settings.
   
2. Also let us know whether some specific handling has to be done in case of
using multi cores during replication.

3. Are there any pitfalls in using the solr distribution scripts and rsync
utility.

~Vikrant
-- 
View this message in context: 
http://www.nabble.com/Query-%7C-Solr-conf-and-data-%28index%29-distribution-using-master-slave-configuration-tp23189692p23189692.html
Sent from the Solr - User mailing list archive at Nabble.com.



Re: Query | Solr conf and data (index) distribution using master slave configuration

2009-04-24 Thread Vicky_Dev

Thanks Shalin for your reply

Is it possible to replicate conf folder from master to slave?


~Vikrant



Shalin Shekhar Mangar wrote:
> 
> On Thu, Apr 23, 2009 at 10:10 AM, Vicky_Dev
> wrote:
> 
>>
>> 1. Please confirm whether the tag entry  : 
>> In solrconfig.xml should match for the  Slave solr server / master solr
>> server in accordance to the scripts.conf configuration settings.
> 
> 
> Yes, dataDir in solrconfig.xml and scripts.conf should be same.
> 
> 
>>
>>
>> 2. Also let us know whether some specific handling has to be done in case
>> of
>> using multi cores during replication.
> 
> 
> You'd need to setup replication separately for each core.
> -- 
> Regards,
> Shalin Shekhar Mangar.
> 
> 

-- 
View this message in context: 
http://www.nabble.com/Query-%7C-Solr-conf-and-data-%28index%29-distribution-using-master-slave-configuration-tp23189692p23214016.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Searching across multivalued fields

2009-06-18 Thread Vicky_Dev

Hi Michel,

We are also facing same problem mentioned in the post (we are using
dismaxrequesthandler)::

Ex: There is product title field in which --possible values
1) in unique key ID =1000
prdTitle_s field contains value "ladybird classic"

2) in unique key ID =1001
prdTitle_s field contains value "ladybird" 

When we are searching for --q=prdTitle_s:"ladybird"&qt=dismax , we are
getting 2 results --  unique key ID =1000 and  unique key ID =1001 

Is it possible to just exact match which is nothing but unique key = 1001?

Note: by default mm value is 100% per Solr documentation

~Vikrant





Michael Ludwig-4 wrote:
> 
> MilkDud schrieb:
>> Ok, so lets suppose i did index across just the album.  Using that
>> index, how would I be able to handle searches of the form "artist name
>> track name".
> 
> What does the user interface look like? Do you have separate fields for
> artists and tracks? Or just one field?
> 
>> If i do the search using a phrase query, this won't match anything
>> because the artist and track are not in one field (hence my idea of
>> creating a third concatenated field).
> 
> What do you expect the user to enter?
> 
> * "dream theater innocence faded" - certainly wrong
> * dream theater "innocence faded" - much better
> 
> Use the DisMax query parser to read the query, as I suggested in my
> first reply. You need to become more familiar with the various search
> facilities, that will probably steer your ideas in more promising
> directions. Read up about DisMax.
> 
>> If i make it a non phrase query, itll return albums that have those
>> words across all the tracks, which is not ideal.  I.e. if you search
>> for a track titled "love me" you will get back albums with the words
>> love and me in different tracks.
> 
> That doesn't make sense me to me. Did you inspect your query using
> debugQuery=true as I suggested? What did it boil down to?
> 
>> Basically, i'd like it to look at each track individually
> 
> That tells me you're thinking database and table scan.
> 
>> and if the artist + just one track match all the search terms, then
>> that counts as a match.  Does that make sense?  If i index on the
>> track level, that should work, but then i have to store album/artist
>> info on each track.
> 
> I think the following makes much more sense:
> 
>>> An album should be a document and have the following fields (and
>>> maybe more, if you have more data attached to it):
>>>
>>> id - unique, an identifier
>>> title - album title
>>> interpret - the musician, possibly multi-valued
>>> track - every song or whatever, definitely multi-valued
> 
> Read up about multi-valued fields (sample schema.xml, for example, or
> Google) if you're unsure what this is; your posting subject, however,
> suggests you aren't.
> 
> Regards,
> 
> Michael Ludwig
> 
> 

-- 
View this message in context: 
http://www.nabble.com/Searching-across-multivalued-fields-tp24056297p24093897.html
Sent from the Solr - User mailing list archive at Nabble.com.



Re: Boost Query effect with Standard Request Handler

2009-06-18 Thread Vicky_Dev

Hi Hossman,

We are also facing similar issue:

is there any way to boost fields in standard query parser itself?

~Vikrant




hossman wrote:
> 
> 
> : The reason I brought the question back up is that hossman said:
>   ...
> : I tried it and it didn't work, so I was curious if I was still doing
> : something wrong.
> 
> no ... i'm just a foolish foolish man who says things with a lot of 
> authority even though i clearly don't know what i'm talking about.
> 
> bq isn't supported directly by SearchHandler, and i need to learn to 
> double check the code before i answer questions about changes i wasn't 
> intimately involved with :)  ... sorry about that.
> 
> 
> -Hoss
> 
> 
> 

-- 
View this message in context: 
http://www.nabble.com/Boost-Query-effect-with-Standard-Request-Handler-tp20042301p24094722.html
Sent from the Solr - User mailing list archive at Nabble.com.



Re: Master Slave data distribution | rsync fail issue

2009-07-02 Thread Vicky_Dev

Yes. Permissions are same across cores

~Vikrant


Bill Au wrote:
> 
> Are the user/group/permissions on the snapshot files the same for both
> cases
> (manual vs postCommit/postOptimize events)?
> 
> Bill
> 
> On Tue, May 5, 2009 at 12:54 PM, tushar kapoor <
> tushar_kapoor...@rediffmail.com> wrote:
> 
>>
>> Hi,
>>
>> I am facing an issue while performing snapshot pulling thru Snappuller
>> script from slave server :
>> We have the setup of multicores on Master Solr and Slave Solr servers.
>> Scenario , 2 cores are set :
>> i)  CORE_WWW.ABCD.COM
>> ii) CORE_WWW.XYZ.COM
>>
>> rsync-enable and rsync-start script run from CORE_WWW.ABCD.COM on master
>> server. Thus rsyncd.commf file got generated on CORE_WWW.ABCD.COM  only ,
>> but not on CORE_WWW.XYZ.COM.
>> Rsyncd.conf of CORE_WWW.ABCD.COM :
>>  rsyncd.conf file 
>> uid = webuser
>> gid = webuser
>> use chroot = no
>> list = no
>> pid file =
>> /opt/apache-tomcat-6.0.18/apache-solr-1.3.0/example/solr/multicore/
>> CORE_WWW.ABCD.COM/logs/rsyncd.pid
>> log file =
>> /opt/apache-tomcat-6.0.18/apache-solr-1.3.0/example/solr/multicore/
>> CORE_WWW.ABCD.COM/logs/rsyncd.log
>> [solr]
>>path =
>> /opt/apache-tomcat-6.0.18/apache-solr-1.3.0/example/solr/multicore/
>> CORE_WWW.ABCD.COM/data
>>comment = Solr
>>
>> rsync error used to get generated while doing the  pulling of master
>> server
>> snapshot of a particular core "CORE_WWW.XYZ.COM" from slave end, for core
>> "CORE_WWW.ABCD.COM" snappuller occured without any error.
>>
>> Also, this issue is coming only when snapshot are generated at master end
>> thru the way given below:
>> A)  Snapshot are generated automatically by
>> editing  “${SOLR_HOME}/solr/conf/solrconfig.xml” to let either commit
>> index
>> or optimize index trigger the snapshooter (search “postCommit” and
>> “postOptimize” to find the configuration section).
>>
>> Sample of solrconfig.xml entry on Master server End:
>> I)
>> 
>>  >
>> name="exe">/opt/apache-tomcat-6.0.18/apache-solr-1.3.0/example/solr/multicore/
>> CORE_WWW.ABCD.COM/bin/snapshooter
>>  >
>> name="dir">/opt/apache-tomcat-6.0.18/apache-solr-1.3.0/example/solr/multicore/
>> CORE_WWW.ABCD.COM/bin
>>  true
>>   arg1 arg2 
>>   MYVAR=val1 
>>
>>
>> same way done for core "CORE_WWW.XYZ.COM" solrConfig.xml.
>> II) The   tag remains commented on both the cores .XML on master
>> server.
>>
>> Log sample  for more clearity :
>> rsyncd.log of the core "CORE_WWW.XYZ.COM":
>> 2009/05/01 15:48:40 command: ./rsyncd-start
>> 2009/05/01 15:48:40 [15064] rsyncd version 2.6.3 starting, listening on
>> port
>> 18983
>> 2009/05/01 15:48:40 rsyncd started with
>>
>> data_dir=/opt/apache-tomcat-6.0.18/apache-solr-1.3.0/example/solr/multicore/
>> CORE_WWW.XYZ.COm/data
>> and accepting requests
>> 2009/05/01 15:50:36 [15195] rsync on solr/snapshot.20090501153311/ from
>> deltrialmac.mac1.com (10.210.7.191)
>> 2009/05/01 15:50:36 [15195] rsync: link_stat "snapshot.20090501153311/."
>> (in
>> solr) failed: No such file or directory (2)
>> 2009/05/01 15:50:36 [15195] rsync error: some files could not be
>> transferred
>> (code 23) at main.c(442)
>> 2009/05/01 15:52:23 [15301] rsync on solr/snapshot.20090501155030/ from
>> delpearsondm.sapient.com (10.210.7.191)
>> 2009/05/01 15:52:23 [15301] wrote 3438 bytes  read 290 bytes  total size
>> 2779
>> 2009/05/01 16:03:31 [15553] rsync on solr/snapshot.20090501160112/ from
>> deltrialmac.mac1.com (10.210.7.191)
>> 2009/05/01 16:03:31 [15553] rsync: link_stat "snapshot.20090501160112/."
>> (in
>> solr) failed: No such file or directory (2)
>> 2009/05/01 16:03:31 [15553] rsync error: some files could not be
>> transferred
>> (code 23) at main.c(442)
>> 2009/05/01 16:04:27 [15674] rsync on solr/snapshot.20090501160054/ from
>> deltrialmac.mac1.com (10.210.7.191)
>> 2009/05/01 16:04:27 [15674] wrote 4173214 bytes  read 290 bytes  total
>> size
>> 4174633
>>
>> I m unable to figure out that from where "/." gets appeneded at the end
>> "snapshot.20090501153311/."
>> "Snappuller.log"
>> 2009/05/04 16:55:43 started by solrUser
>> 2009/05/04 16:55:43 command:
>> /opt/apache-solr-1.3.0/example/solr/multicore/
>> CORE_WWW.PUFFINBOOKS.CA/bin/snappuller
>> -u  webuser
>> 2009/05/04 16:55:52 pulling snapshot snapshot.20090504164935
>> 2009/05/04 16:56:09 rsync failed
>> 2009/05/04 16:56:24 failed (elapsed time: 41 sec)
>>
>> Error shown on console :
>> rsync: link_stat "snapshot.20090504164935/." (in solr) failed: No such
>> file
>> or directory (2)
>> client: nothing to do: perhaps you need to specify some filenames or the
>> --recursive option?
>> rsync error: some files could not be transferred (code 23) at main.c(723)
>>
>> B) The same issue is not coming while manually running the Snapshot
>> script
>> after reguler interval of time at Master server and then running
>> Snappuller
>> script at slave end for multiple cores. The postCommit/postOptimize part
>> of
>> solrCon