data import
solr indexing taking too much time . What should i do to reduce time . working on solr 4.0.
not able to import Data through DIH solr 4.2.1
Please provide the basic steps to resolve the issue Getting following error Full Import failed:java.lang.RuntimeException: java.lang.RuntimeException: org.apache.solr.handler.dataimport.DataImportHandlerException: Could not load driver: com.mysql.jdbc.Driver Processing Document # 1
Re: not able to import Data through DIH solr 4.2.1
Alex thanks for replying my solrconfig : < lib dir="../../../dist/" regex="solr-dataimporthandler-.*\.jar" /> ## data-config-new.xml On Thu, Mar 19, 2015 at 10:26 AM, Alexandre Rafalovitch wrote: > > Could not load driver: com.mysql.jdbc.Driver > > Looks like a custom driver. Is the driver name correct? Is the library > declared in solrconfig.xml? Is the library path correct (use absolute > path if in doubt). > > Regards, >Alex. > > > Solr Analyzers, Tokenizers, Filters, URPs and even a newsletter: > http://www.solr-start.com/ > > > On 19 March 2015 at 00:35, abhishek tiwari wrote: > > Please provide the basic steps to resolve the issue > > > > > > Getting following error > > > > Full Import failed:java.lang.RuntimeException: > > java.lang.RuntimeException: > > org.apache.solr.handler.dataimport.DataImportHandlerException: Could > > not load driver: com.mysql.jdbc.Driver Processing Document # 1 >
Re: not able to import Data through DIH solr 4.2.1
but still not working On Thu, Mar 19, 2015 at 10:41 AM, Alexandre Rafalovitch wrote: > Try absolute path to the jar directory. Hard to tell whether relative > path is correct without knowing exactly how you are running it. > > Regards, > Alex. > > Solr Analyzers, Tokenizers, Filters, URPs and even a newsletter: > http://www.solr-start.com/ > > > On 19 March 2015 at 01:00, abhishek tiwari wrote: > > Alex thanks for replying > > my solrconfig : > > > > > < > > lib dir="../../../dist/" regex="solr-dataimporthandler-.*\.jar" /> > > > > > > ## > > > "org.apache.solr.handler.dataimport.DataImportHandler"> name="defaults" > >> data-config-new.xml > > > > > > On Thu, Mar 19, 2015 at 10:26 AM, Alexandre Rafalovitch < > arafa...@gmail.com> > > wrote: > > > >> > Could not load driver: com.mysql.jdbc.Driver > >> > >> Looks like a custom driver. Is the driver name correct? Is the library > >> declared in solrconfig.xml? Is the library path correct (use absolute > >> path if in doubt). > >> > >> Regards, > >>Alex. > >> > >> > >> Solr Analyzers, Tokenizers, Filters, URPs and even a newsletter: > >> http://www.solr-start.com/ > >> > >> > >> On 19 March 2015 at 00:35, abhishek tiwari > wrote: > >> > Please provide the basic steps to resolve the issue > >> > > >> > > >> > Getting following error > >> > > >> > Full Import failed:java.lang.RuntimeException: > >> > java.lang.RuntimeException: > >> > org.apache.solr.handler.dataimport.DataImportHandlerException: Could > >> > not load driver: com.mysql.jdbc.Driver Processing Document # 1 > >> >
Re: data import
Hi , - architecture : master (1) - slave(3) solrconfig: 500 15000 false schema : < field name="selling_price" type="tfloat" indexed="true" stored="true" /> < field name="third_price" type="tfloat" indexed="true" stored="true" /> < field name="discount_percentage" type="tfloat" indexed="true" stored="true" /> < field name="sort_2" type="tint" indexed="true" stored="true" /> < field name="show_metacategory" type="variantFacet" indexed="true" stored= "true" /> < field name="products" type="tint" indexed="true" stored="true" /> < field name="by_drive_supported" type="text_path_new" indexed="true" stored= "true" multiValued="true"/> < field name="by_primary_camera" type="text_path_new" indexed="true" stored= "true" multiValued="true"/>< field name="by_dial_shape" type="text_path_new" indexed="true" stored="true" multiValued="true"/> < field name="by_features" type="text_path_new" indexed="true" stored="true" multiValued="true"/>< field name="speaker_configuration" type="text_path_new" indexed="true" stored="true" multiValued="true"/> id < copyField source="product" dest="product_keyword"/> < copyField source="list_price" dest="text"/> < copyField source="seo_name" dest="text"/> On Fri, Mar 13, 2015 at 2:25 PM, Antonio Jesús Sánchez Padial < antonio.sanc...@inia.es> wrote: > Maybe you should add some info about: > > - your architecture, number of servers, etc > - your schema.xml > - and the data (ammount, type, ...) you are indexing > > Best. > > El 13/03/2015 a las 9:37, abhishek tiwari escribió: > > solr indexing taking too much time . >> >> What should i do to reduce time . working on solr 4.0. >> >> > -- > Antonio Jesús Sánchez Padial > Jefe del Servicio de Biometría > antonio.sanc...@inia.es > Tlfno: +34 91 347 6831 > Instituto Nacional de Investigación y Tecnología Agraria y Alimentaria > Ctra.m de La Coruña, km.7 > 28040 Madrid > >
Need solr query help
We are doing spatial search. with following logic. a) There are shops in a city . Each provides the facility of home delivery b) each shop has different max_delivery_distance . Now my query is suppose some one is searching from point P1 with radius R. User wants the result of shops those can deliver him.(distance between P1 to shop s1 say d1 should be less than max_delivery distance say md1 ) how can i implement this by solr spatial query.
Re: help to build query
jack Thanks for your response.. we have a deal web application.. and having free text search in it . here free text means you can type any thing in it.. we have deals of different categories.. and tagged at different merchant locations.. As per requirement i have to do some tweaks in search .. for example user can search deals like : a) cat1 in location1 , location 2.( spa in malviya nagar, Ashok vihar ... here spa : cat1, location1: malviya nagar, location2:Ashok vihar b) cat1 and cat2 in location1 c) cat1 in location1 and location2 Hope i am able to explain you better.. On Wed, Jan 30, 2013 at 9:06 PM, Jack Krupansky wrote: > Start by expressing the specific semantics of those queries in strict > boolean form. I mean, what exactly do you mean by "in", and "location1, > location 2", and "location1, loc2 and loc3? Is the latter an AND or an OR? > > Or at least fully express those two queries, unambiguously in plain > English. There is too much ambiguity present to give you any solid > direction. > > -- Jack Krupansky > > -Original Message- From: Abhishek tiwari > Sent: Wednesday, January 30, 2013 12:55 AM > To: solr-user@lucene.apache.org > Subject: help to build query > > > want to execute queries like : > a) cat in location1 , location2 > b) cat 1 and cat2 in location1 ,loc2 and loc3 > > in our search . > > our challenges : > > 1) picking right keywords(category and locality) from query entered. > 2) its mapping to relevant entity > > How should i proceed for it . > > we have localities and categories data indexed . > > thanks in advance. > > ~abhishek >
Re: schema design help
thanks for replying .. In our RDBMS schema we have Establishment/Event/Movie master relations. Establishment has title ,description , ratings, tags, cuisines (multivalued), services (multivalued) and features (multivalued) like fields..similarly in Event title, description, category(multivalued) and venue(multivalued) ..fields..and in movies name,start date and end date ,genre, theater ,rating , review like fields .. we are having nearly 1 M data in each entity and movie and event expire frequently and we have to update on expire we are having the data additional to index data ( stored data) to reduce RDBMS query.. please suggest me how to proceed for schema design.. single core or multiple core for each entity? On Tue, Mar 6, 2012 at 7:40 PM, Gora Mohanty wrote: > On 6 March 2012 18:01, Abhishek tiwari > wrote: > > i am new in solr want help in shema design . i have multiple entities > > like Event , Establishments and Movies ..each have different types of > > relations.. should i make diffrent core for each entities ? > > It depends on your use case, i.e., what would your typical searches > be on. Normally, using a separate core for each entity would be > unusual, and instead one would flatten out typical RDBMS data for > Solr. > > Please describe what you want to achieve, and people might be > better able to help you. > > Regards, > Gora >
Re: schema design help
please suggest me when one should create multiple core..? On Thu, Mar 8, 2012 at 12:12 AM, Walter Underwood wrote: > Solr is not relational, so you will probably need to take a fresh look at > your data. > > Here is one method. > > 1. Sketch your search results page. > 2. Each result is a document in Solr. > 3. Each displayed item is a stored field in Solr. > 4. Each searched item is an indexed field in Solr. > > It may help to think of this as a big flat materialized view in your DBMS. > > wunder > Search Guy, Chegg.com > > On Mar 6, 2012, at 10:56 PM, Abhishek tiwari wrote: > > > thanks for replying .. > > > > In our RDBMS schema we have Establishment/Event/Movie master relations. > > Establishment has title ,description , ratings, tags, cuisines > > (multivalued), services (multivalued) and features (multivalued) like > > fields..similarly in Event title, description, category(multivalued) and > > venue(multivalued) ..fields..and in movies name,start date and end date > > ,genre, theater ,rating , review like fields .. > > > > we are having nearly 1 M data in each entity and movie and event expire > > frequently and we have to update on expire > > we are having the data additional to index data ( stored data) to reduce > > RDBMS query.. > > > > please suggest me how to proceed for schema design.. single core or > > multiple core for each entity? > > > > > > On Tue, Mar 6, 2012 at 7:40 PM, Gora Mohanty wrote: > > > >> On 6 March 2012 18:01, Abhishek tiwari > >> wrote: > >>> i am new in solr want help in shema design . i have multiple entities > >>> like Event , Establishments and Movies ..each have different types of > >>> relations.. should i make diffrent core for each entities ? > >> > >> It depends on your use case, i.e., what would your typical searches > >> be on. Normally, using a separate core for each entity would be > >> unusual, and instead one would flatten out typical RDBMS data for > >> Solr. > >> > >> Please describe what you want to achieve, and people might be > >> better able to help you. > >> > >> Regards, > >> Gora > >> > > > > > >
Re: schema design help
my page have layout in following manner *All tab* :which will contain all entities (Establishment/Event/Movie) Establishment: contain Establishment search results Event tab : will contain Event search results Movie tab : will contain Movie search results please suggest me how to design my schema ? On Thu, Mar 8, 2012 at 10:21 AM, Walter Underwood wrote: > You should create multiple cores when each core is an independent search. > If you have three separate search pages, you may want three separate cores. > > wunder > Search Guy, Chegg.com > > On Mar 7, 2012, at 8:48 PM, Abhishek tiwari wrote: > > > please suggest me when one should create multiple core..? > > > > On Thu, Mar 8, 2012 at 12:12 AM, Walter Underwood >wrote: > > > >> Solr is not relational, so you will probably need to take a fresh look > at > >> your data. > >> > >> Here is one method. > >> > >> 1. Sketch your search results page. > >> 2. Each result is a document in Solr. > >> 3. Each displayed item is a stored field in Solr. > >> 4. Each searched item is an indexed field in Solr. > >> > >> It may help to think of this as a big flat materialized view in your > DBMS. > >> > >> wunder > >> Search Guy, Chegg.com > >> > >> On Mar 6, 2012, at 10:56 PM, Abhishek tiwari wrote: > >> > >>> thanks for replying .. > >>> > >>> In our RDBMS schema we have Establishment/Event/Movie master relations. > >>> Establishment has title ,description , ratings, tags, cuisines > >>> (multivalued), services (multivalued) and features (multivalued) like > >>> fields..similarly in Event title, description, category(multivalued) > and > >>> venue(multivalued) ..fields..and in movies name,start date and end date > >>> ,genre, theater ,rating , review like fields .. > >>> > >>> we are having nearly 1 M data in each entity and movie and event expire > >>> frequently and we have to update on expire .... > >>> we are having the data additional to index data ( stored data) to > reduce > >>> RDBMS query.. > >>> > >>> please suggest me how to proceed for schema design.. single core or > >>> multiple core for each entity? > >>> > >>> > >>> On Tue, Mar 6, 2012 at 7:40 PM, Gora Mohanty > wrote: > >>> > >>>> On 6 March 2012 18:01, Abhishek tiwari > > >>>> wrote: > >>>>> i am new in solr want help in shema design . i have multiple > entities > >>>>> like Event , Establishments and Movies ..each have different types of > >>>>> relations.. should i make diffrent core for each entities ? > >>>> > >>>> It depends on your use case, i.e., what would your typical searches > >>>> be on. Normally, using a separate core for each entity would be > >>>> unusual, and instead one would flatten out typical RDBMS data for > >>>> Solr. > >>>> > >>>> Please describe what you want to achieve, and people might be > >>>> better able to help you. > >>>> > >>>> Regards, > >>>> Gora > >>>> > > > > >
Re: schema design help
Gora, we are not having the related search ... like u have mentioned ... * will a search on an Establishment also require results from Movie, such as what movies are showing at the establishment* Establishment doesnot require movie reults .. each enitity has there separate search.. On Thu, Mar 8, 2012 at 10:49 AM, Gora Mohanty wrote: > On 8 March 2012 10:40, Abhishek tiwari > wrote: > > my page have layout in following manner > > *All tab* :which will contain all entities (Establishment/Event/Movie) > > Establishment: contain Establishment search results > > Event tab : will contain Event search results > > Movie tab : will contain Movie search results > > > > please suggest me how to design my schema ? > [...] > > You will need to think more about your search requirements, and > provide more details. E.g., will a search on an Establishment > also require results from Movie, such as what movies are showing > at the establishment? Similarly, will results from an Event search > require a list of Movies showing at the events? As Solr is not a > RDBMS, if you need such correlated data, you should typically use > a single, flat index, rather than multiple cores. > > IMHO, a multi-core setup would be unusual for what you are > trying to do. However, this is difficult to say for sure without an > insight into your search requirements. > > Regards, > Gora >
Re: schema design help
Hi Gora, Thanks, My one more concern, Though Establishments, Events, Movies are not related to each other, I have to make 3 search queries to their independent cores and club the data to show, will that effect my relevancy? There is movie with title "Striker" and Establishment with title "Striker". So which one is better: - 3 queries to independent cores and clubbing data - Single query to one core which contains all the data. Thanks Abhishek On Thu, Mar 8, 2012 at 11:07 AM, Gora Mohanty wrote: > On 8 March 2012 11:05, Abhishek tiwari > wrote: > > Gora, > > we are not having the related search ... > > like u have mentioned ... * will a search on an Establishment > > also require results from Movie, such as what movies are showing > > at the establishment* > > > > Establishment doesnot require movie reults .. each enitity has there > > separate search.. > [...] > > In that case, multiple cores should be OK. > > Regards, > Gora >
query help
Hi , i have multi valued field want to sort the docs order the particular text eq:'B1' is added. how i should query? ad_text is multivalued field. t B1 B2 B3 B2 B1 B3 B1 B2 B3 B3 B2 B1
Re: query help
a) No. i do not want to sort the content within document . I want to sort the documents . b) As i have explained i have result set( documents ) and each document contains a fields "*ad_text*" (with other fields also) which is multivalued..storing some tags say "B1, B2, B3" in each. bt order of tags are different for each doc. say (B1, B2, B3) *for doc1*, B3,B1 B2*, for doc2*, B1, B3, B2*, doc3*, B2, B3, B1* for doc4* if i search for B1: result should come in following order: doc1,doc3,doc2,doc4 (As B1 is first value in maltivalued result for doc1and doc3, and B1 is in 2nd value in doc2 while B1 is at 3rd in doc4 ) if i search for B2: result should come in following order: doc4 ,doc1,doc3,doc2 I donot know whether it is possible or not .. but please suggest how it can be done. On Thu, Mar 29, 2012 at 5:18 PM, Erick Erickson wrote: > Hmmm, I don't quite get this. Are you saying that you want > to sort the documents or sort the content within the document? > > Sorting documents (i.e the results list) requires a single-valued > field. So you'd have to, at index time, sort the entries. > > Sorting the content within the document is something you'd > have to do when you index, Solr doesn't rearrange the > contents of a document. > > If all you want to do is display the results within the document > in order, your app can do that as it builds the display page. > > Best > Erick > > On Wed, Mar 28, 2012 at 9:02 AM, Abhishek tiwari > wrote: > > Hi , > > i have multi valued field want to sort the docs order the particular > > text eq:'B1' is added. > > how i should query? ad_text is multivalued field. > > > > t > > > > > > > > B1 > > B2 > > B3 > > > > > > > > > > B2 > > B1 > > B3 > > > > > > > > > > > > B1 > > B2 > > B3 > > > > > > > > > > B3 > > B2 > > B1 > > > > >
Re: query help
can i achieve this with help of boosting technique ? On Thu, Mar 29, 2012 at 10:42 PM, Erick Erickson wrote: > Solr doesn't support sorting on multValued fields so I don't think this > is possible OOB. > > I can't come up with a clever indexing solution that does this either, > sorry. > > Best > Erick > > On Thu, Mar 29, 2012 at 8:27 AM, Abhishek tiwari > wrote: > > a) No. i do not want to sort the content within document . > > I want to sort the documents . > > b) As i have explained i have result set( documents ) and each document > > contains a fields "*ad_text*" (with other fields also) which is > > multivalued..storing some tags say "B1, B2, B3" in each. bt order of tags > > are different for each doc. say (B1, B2, B3) *for doc1*, B3,B1 B2*, for > > doc2*, B1, B3, B2*, doc3*, B2, B3, B1* for doc4* > > > > if i search for B1: result should come in following order: > > doc1,doc3,doc2,doc4 > > (As B1 is first value in maltivalued result for doc1and doc3, and B1 is > in > > 2nd value in doc2 while B1 is at 3rd in doc4 ) > > if i search for B2: result should come in following order: doc4 > > ,doc1,doc3,doc2 > > > > > > I donot know whether it is possible or not .. > > > > but please suggest how it can be done. > > > > > > > > On Thu, Mar 29, 2012 at 5:18 PM, Erick Erickson >wrote: > > > >> Hmmm, I don't quite get this. Are you saying that you want > >> to sort the documents or sort the content within the document? > >> > >> Sorting documents (i.e the results list) requires a single-valued > >> field. So you'd have to, at index time, sort the entries. > >> > >> Sorting the content within the document is something you'd > >> have to do when you index, Solr doesn't rearrange the > >> contents of a document. > >> > >> If all you want to do is display the results within the document > >> in order, your app can do that as it builds the display page. > >> > >> Best > >> Erick > >> > >> On Wed, Mar 28, 2012 at 9:02 AM, Abhishek tiwari > >> wrote: > >> > Hi , > >> > i have multi valued field want to sort the docs order the particular > >> > text eq:'B1' is added. > >> > how i should query? ad_text is multivalued field. > >> > > >> > t > >> > > >> > > >> > > >> > B1 > >> > B2 > >> > B3 > >> > > >> > > >> > > >> > > >> > B2 > >> > B1 > >> > B3 > >> > > >> > > >> > > >> > > >> > > >> > B1 > >> > B2 > >> > B3 > >> > > >> > > >> > > >> > > >> > B3 > >> > B2 > >> > B1 > >> > > >> > > >> >
Re: Error
i am using 3.4 solr version... please assist... On Thu, Apr 12, 2012 at 8:41 PM, Erick Erickson wrote: > Please review: > > http://wiki.apache.org/solr/UsingMailingLists > > You haven't said whether, for instance, you're using trunk which > is the only version that supports the "termfreq" function. > > Best > Erick > > On Thu, Apr 12, 2012 at 4:08 AM, Abhishek tiwari > wrote: > > > http://xyz.com:8080/newschema/mainsearch/select/?q=*%3A*&version=2.2&start=0&rows=10&indent=on&sort=termfreq%28cuisine_priorities_list,%27Chinese%27%29%20desc > > > > Error : HTTP Status 400 - Missing sort order. > > Why i am getting error ? >
