Hi Salman,
here is the my debug query dump please help!. I am unable to find the
wildcards in it.
<?xml version="1.0" encoding="UTF-8"?><response><lst
name="responseHeader"> <bool name="partialResults">true</bool> <int
name="status">0</int> <int name="QTime">10080</int></lst><result
name="response" numFound="976303" start="0"></result><lst
name="facet_counts"> <lst name="facet_queries"/> <lst
name="facet_fields"> <lst name="city"> <int name="delhi
ncr">884159</int> <int name="delhi">629472</int> <int
name="mumbai">491426</int> <int name="ahmedabad">259356</int>
<int name="chennai">259029</int> <int
name="bengaluru">257193</int> <int name="kolkata">195077</int>
<int name="pune">193569</int> <int
name="hyderabad">179369</int> <int name="jaipur">115356</int>
<int name="coimbatore">111644</int> <int
name="noida">86794</int> <int name="surat">80621</int> <int
name="gurgaon">72815</int> <int name="rajkot">68982</int>
<int name="vadodara">65082</int> <int name="ludhiana">63244</int>
<int name="thane">55091</int> <int name="indore">50225</int>
<int name="ghaziabad">49756</int> <int
name="faridabad">45322</int> <int name="navi mumbai">40127</int>
<int name="tiruppur">37639</int> <int
name="nagpur">37126</int> <int name="kochi">32874</int> </lst>
<lst name="datatype"> <int name="product">966816</int>
<int name="offer">6003</int> <int name="company">3484</int>
</lst> </lst> <lst name="facet_dates"/> <lst
name="facet_ranges"/></lst><lst name="debug"> <str
name="rawquerystring">misc items</str> <str name="querystring">misc
items</str> <str
name="parsedquery">BoostedQuery(boost(+(((titlex:misc^1.5 |
smalldesc:misc | titlews:misc^0.5 | city:misc | usrpcatname:misc |
mcatnametext:misc^0.2)~0.3 (titlex:item^1.5 | smalldesc:item |
titlews:items^0.5 | city:items | usrpcatname:item |
mcatnametext:item^0.2)~0.3)~1) (mcatnametext:"misc item"^0.5)~0.3
(titlews:"misc items")~0.3 (titlex:"misc item"^3.0)~0.3
(smalldesc:"misc item"^2.0)~0.3 (usrpcatname:"misc item")~0.3
(),product(map(query(+(titlex:"item imsw")~0.3
(),def=0.0),0.0,0.0,1.0),map(query(+(titlex:"misc item imsw")~0.3
(),def=0.0),0.0,0.0,1.0),map(int(sdesclen),0.0,150.0,1.0),map(int(sdesclen),0.0,0.0,0.1),map(int(CustTypeWt),699.0,699.0,1.2),map(int(CustTypeWt),199.0,199.0,1.3),map(int(CustTypeWt),0.0,179.0,1.35),1.0/(3.16E-11*float(ms(const(1398852652419),date(lastactiondatet)))+1.0),map(ms(const(1398852652419),date(blpurchasedate)),0.0,2.6E9,1.15),map(query(+(attribs:hot)~0.3
(titlex:hot^3.0 | smalldesc:hot^2.0 | titlews:hot | city:hot |
usrpcatname:hot |
mcatnametext:hot^0.5)~0.3,def=0.0),0.0,0.0,1.0),map(query(+(attribs:dupimg)~0.3
(titlex:dupimg^3.0 | smalldesc:dupimg^2.0 | titlews:dupimg |
city:dupimg | usrpcatname:dupimg |
mcatnametext:dupimg^0.5)~0.3,def=0.0),0.0,0.0,1.0),map(query(+(isphoto:T)~0.3
(),def=0.0),0.0,0.0,0.1))))</str> <str
name="parsedquery_toString">boost(+(((titlex:misc^1.5 | smalldesc:misc
| titlews:misc^0.5 | city:misc | usrpcatname:misc |
mcatnametext:misc^0.2)~0.3 (titlex:item^1.5 | smalldesc:item |
titlews:items^0.5 | city:items | usrpcatname:item |
mcatnametext:item^0.2)~0.3)~1) (mcatnametext:"misc item"^0.5)~0.3
(titlews:"misc items")~0.3 (titlex:"misc item"^3.0)~0.3
(smalldesc:"misc item"^2.0)~0.3 (usrpcatname:"misc item")~0.3
(),product(map(query(+(titlex:"item imsw")~0.3
(),def=0.0),0.0,0.0,1.0),map(query(+(titlex:"misc item imsw")~0.3
(),def=0.0),0.0,0.0,1.0),map(int(sdesclen),0.0,150.0,1.0),map(int(sdesclen),0.0,0.0,0.1),map(int(CustTypeWt),699.0,699.0,1.2),map(int(CustTypeWt),199.0,199.0,1.3),map(int(CustTypeWt),0.0,179.0,1.35),1.0/(3.16E-11*float(ms(const(1398852652419),date(lastactiondatet)))+1.0),map(ms(const(1398852652419),date(blpurchasedate)),0.0,2.6E9,1.15),map(query(+(attribs:hot)~0.3
(titlex:hot^3.0 | smalldesc:hot^2.0 | titlews:hot | city:hot |
usrpcatname:hot |
mcatnametext:hot^0.5)~0.3,def=0.0),0.0,0.0,1.0),map(query(+(attribs:dupimg)~0.3
(titlex:dupimg^3.0 | smalldesc:dupimg^2.0 | titlews:dupimg |
city:dupimg | usrpcatname:dupimg |
mcatnametext:dupimg^0.5)~0.3,def=0.0),0.0,0.0,1.0),map(query(+(isphoto:T)~0.3
(),def=0.0),0.0,0.0,0.1)))</str> <lst name="explain"/> <str
name="QParser">SynonymExpandingExtendedDismaxQParser</str> <null
name="altquerystring"/> <null name="boost_queries"/> <arr
name="parsed_boost_queries"/> <null name="boostfuncs"/> <arr
name="filter_queries">
<str>{!tag=cityf}latlong:"Intersects(Circle(28.63576,77.22445
d=2.248))"</str> <str>attribs:(locprefglobal locprefnational
locprefcity)</str> <str>+((+datatype:product +attribs:(aprstatus20
aprstatus40 aprstatus50) +aggregate:true -attribs:liststatusnfl
+((+countryiso:IN +isfcp:true) CustTypeWt:[149 TO 1499]))
(+datatype:offer +iildisplayflag:true) (+datatype:company
-attribs:liststatusnfl +((+countryiso:IN +isfcp:true) CustTypeWt:[149
TO 1499]))) -attribs:liststatusdnf</str> </arr> <arr
name="parsed_filter_queries">
<str>ConstantScore(org.apache.lucene.spatial.prefix.IntersectsPrefixTreeFilter@414cd6c2)</str>
<str>attribs:locprefglobal attribs:locprefnational
attribs:locprefcity</str> <str>+((+datatype:product
+(attribs:aprstatus20 attribs:aprstatus40 attribs:aprstatus50)
+aggregate:true -attribs:liststatusnfl +((+countryiso:IN +isfcp:true)
CustTypeWt:[149 TO 1499])) (+datatype:offer +iildisplayflag:true)
(+datatype:company -attribs:liststatusnfl +((+countryiso:IN
+isfcp:true) CustTypeWt:[149 TO 1499]))) -attribs:liststatusdnf</str>
</arr> <lst name="timing"> <double name="time">10079.0</double>
<lst name="prepare"> <double name="time">3.0</double> <lst
name="query"> <double name="time">3.0</double> </lst>
<lst name="facet"> <double name="time">0.0</double> </lst>
<lst name="mlt"> <double name="time">0.0</double>
</lst> <lst name="highlight"> <double
name="time">0.0</double> </lst> <lst name="stats">
<double name="time">0.0</double> </lst> <lst
name="spellcheck"> <double name="time">0.0</double> </lst>
<lst name="debug"> <double name="time">0.0</double>
</lst> </lst> <lst name="process"> <double
name="time">10076.0</double> <lst name="query"> <double
name="time">3337.0</double> </lst> <lst name="facet">
<double name="time">6739.0</double> </lst> <lst name="mlt">
<double name="time">0.0</double> </lst> <lst
name="highlight"> <double name="time">0.0</double> </lst>
<lst name="stats"> <double name="time">0.0</double>
</lst> <lst name="spellcheck"> <double
name="time">0.0</double> </lst> <lst name="debug">
<double name="time">0.0</double> </lst> </lst>
</lst></lst></response>
With Regards
Aman Tandon
On Wed, Apr 30, 2014 at 12:09 PM, Salman Akram <
[email protected]> wrote:
> I had this issue too. timeAllowed only works for a certain phase of the
> query. I think that's the 'process' part. However, if the query is taking
> time in 'prepare' phase (e.g. I think for wildcards to get all the possible
> combinations before running the query) it won't have any impact on that.
> You can debug your query and confirm that.
>
>
> On Wed, Apr 30, 2014 at 10:43 AM, Aman Tandon <[email protected]
> >wrote:
>
> > Shawn this is the first time i raised this problem.
> >
> > My heap size is 14GB and i am not using solr cloud currently, 40GB index
> > is replicated from master to two slaves.
> >
> > I read somewhere that it return the partial results which is computed by
> > the query in that specified amount of time which is defined by this
> > timeAllowed parameter, but it doesn't seems to happen.
> >
> > Here is the link :
> > http://wiki.apache.org/solr/CommonQueryParameters#timeAllowed
> >
> > *The time allowed for a search to finish. This value only applies to the
> > search and not to requests in general. Time is in milliseconds. Values
> <= 0
> > mean no time restriction. Partial results may be returned (if there are
> > any). *
> >
> >
> >
> > With Regards
> > Aman Tandon
> >
> >
> > On Wed, Apr 30, 2014 at 10:05 AM, Shawn Heisey <[email protected]>
> wrote:
> >
> > > On 4/29/2014 10:05 PM, Aman Tandon wrote:
> > > > I am using solr 4.2 with the index size of 40GB, while querying to my
> > > index
> > > > there are some queries which is taking the significant amount of time
> > of
> > > > about 22 seconds *in the case of minmatch of 50%*. So i added a
> > parameter
> > > > timeAllowed = 2000 in my query but this doesn't seems to be work.
> > Please
> > > > help me out.
> > >
> > > I remember reading that timeAllowed has some limitations about which
> > > stages of a query it can limit, particularly in the distributed case.
> > > These limitations mean that it cannot always limit the total time for a
> > > query. I do not remember precisely what those limitations are, and I
> > > cannot find whatever it was that I was reading.
> > >
> > > When I looked through my local list archive to see if you had ever
> > > mentioned how much RAM you have and what the size of your Solr heap is,
> > > there didn't seem to be anything. There's not enough information for
> me
> > > to know whether that 40GB is the amount of index data on a single
> > > SolrCloud server, or whether it's the total size of the index across
> all
> > > servers.
> > >
> > > If we leave timeAllowed alone for a moment and treat this purely as a
> > > performance problem, usually my questions revolve around figuring out
> > > whether you have enough RAM. Here's where that conversation ends up:
> > >
> > > http://wiki.apache.org/solr/SolrPerformanceProblems
> > >
> > > I think I've probably mentioned this to you before on another thread.
> > >
> > > Thanks,
> > > Shawn
> > >
> > >
> >
>
>
>
> --
> Regards,
>
> Salman Akram
>