Adding field to solr dynamically

My database model is designed using dynamic attributes (Entity Attribute Value model). For the db I have a service that adds a new attribute. But everytime a new attributes is added I need to add it to the schema.xml Is there a possibile way to add a field to solr schama.xml dynamically?

Re: Adding field to solr dynamically

; > Dynamic fields (your nominal field name plus a suffix that specifies the > type and muliplicity - as detailed in the Solr example schema) may be good > enough, depending on the rest of your requirements. > > -- Jack Krupansky > > -Original Message- From: Mysurf Mail &

Is there a way to speed up my import

I have a relational database model This is the basics of my data-config.xml Now, this takes a lot of time. 1 rows in the first query and then each other inner entities are fetched later (around 10 rows each). If I use a db profiler I see a the three inner entities que

Re: Is there a way to speed up my import

configuration Now, when I query http://localhost:8983/solr/vaultCache/select?q=*&indent=true it returns only the main entity attriburtes. Where are my inner entities attributes now? Thanks a lot. On Thu, Jun 27, 2013 at 10:15 AM, Gora Mohanty wrote: > On 27 June 2013 12:32,

Solr - Delta Query Via Full Import

I am using DIH to fetch rows from db to solr. I have many 1:n relations and I can do it only if I use caching (super fast) Therefor I am adding the following attributes to my inner entity processor="CachedSqlEntityProcessor" cacheKey="" cacheLookup="" Everything works great and fast. (First the n

parent Import Query doent run

I have 1:n relation between my main entity(PackageVersion) and its tag in my DB. I add a new tag with this date to the db at the timestamp and I run delta import command. the select retrieves the line but i dont see any other sql. Here are my data-config.xml configurations:

Solr - working with delta import and cache

I have two entities in 1:n relation - PackageVersion and Tag. I have configured DIH to use CachedSqlEntityProcessor and everything works as planned. First, Tag entity is selected using the query attribute. Then the main entity. Ultra Fast. Now I am adding the delta import. Everything runs and load

Re: Solr - working with delta import and cache

BTW: Just found out that a delta import is only supported by the SqlEntityProcessor . Does it matter that I defined processor="CachedSqlEntityProcessor"? On Tue, Jul 2, 2013 at 5:58 PM, Mysurf Mail wrote: > I have two entities in 1:n relation - PackageVersion and Tag. > I hav

two types of answers in my query

Hi, A general question: Let's say I have Car And CarParts 1:n relation. And I have discovered that the user had entered in the search field instead of car name - a part serial number (SKU). (I discovered it useing regex) Is there a way to fetch different types of answers in Solr? Is there a way

Re: two types of answers in my query

nt will be selected. And if you > have a "type" field, you can check that to see if a car or part was matched > in the results. > > -- Jack Krupansky > > -Original Message- From: Mysurf Mail > Sent: Tuesday, July 09, 2013 2:38 AM > To: solr-user@lucene.a

Disabling workd breaking for codes and SKUs

Some of the data in my index is SKUs and barcodes as follows ASDF3-DASDD-2133DD-21H44 I want to disable the wordbreaking for this type (maybe through Regex. Is there a possible way to do this?

Running Solr in a cluster - high availability only

Hi, I would like to run two Solr instances on different computers as a cluster. My main interest is High availability - meaning, in case one server crashes or is down there will be always another one. (my performances on a single instance are great. I do not need to split the data to two servers.)

adding date column to the index

I have added a date field to my index. I dont want the query to search on this field, but I want it to be returned with each row. So I have defined it in the scema.xml as follows: I added it to the select in data-config.xml and I see it selected in the profiler. now, when I query all file

deserializing highlighting json result

When I request a json result I get the following streucture in the highlighting {"highlighting":{ "394c65f1-dfb1-4b76-9b6c-2f14c9682cc9":{ "PackageName":["- Testing channel twenty."]}, "baf8434a-99a4-4046-8a4d-2f7ec09eafc8":{ "PackageName":["- Testing channel twenty."]}, "0a69

Re: adding date column to the index

nstead, all data for a field is added at the same time. To get the new > field, you have to reload all of your data. > > This is also true for deleting fields. If you remove a field, that data > does not go away until you re-index. > > > On 07/22/2013 07:31 AM, Mysurf Mail wrot

Re: deserializing highlighting json result

> Exactly why is it difficult to deserialize? Seems simple enough. > > -- Jack Krupansky > > -Original Message- From: Mysurf Mail Sent: Monday, July 22, 2013 > 11:14 AM To: solr-user@lucene.apache.org Subject: deserializing > highlighting json result > When I request a j

Re: adding date column to the index

Ahaa I deleted the data folder and now I get Invalid Date String:'2010-01-01 00:00:00 +02:00' I need to cast it to solr. as I read it in the schema using On Tue, Jul 23, 2013 at 10:50 AM, Gora Mohanty wrote: > On 23 July 2013 11:13, Mysurf Mail wrote: > > clarify: I did

Re: adding date column to the index

How do I cast datetimeoffset(7)) to solr date On Tue, Jul 23, 2013 at 11:11 AM, Mysurf Mail wrote: > Ahaa > I deleted the data folder and now I get > Invalid Date String:'2010-01-01 00:00:00 +02:00' > I need to cast it to solr. as I read it in the schema using > >

solr - Deleting a row from the index, using the configuration files only.

I am updating my solr index using deltaQuery and deltaImportQuery attributes in data-config.xml. In my condition I write where MyDoc.LastModificationTime > '${dataimporter.last_index_time}' then after I add a row I trigger an update using data-config.xml. Now, sometimes I delete a row. How ca

filter query result by user

I want to restrict the returned results to be only the documents that were created by the user. I then load to the index the createdBy attribute and set it to index false,stored="true" then in the I want to filter by "CreatedBy" so I use the dashboard, check edismax and add I check edismax a

Re: filter query result by user

s created by him? Thanks. On Tue, Jul 23, 2013 at 4:28 PM, Raymond Wiker wrote: > Simple: the field needs to be "indexed" in order to search (or filter) on > it. > > > On Tue, Jul 23, 2013 at 3:26 PM, Mysurf Mail > wrote: > > > I want to restrict the retur

Re: filter query result by user

sMax#qf_.28Query_Fields.29) On Tue, Jul 23, 2013 at 4:32 PM, Mysurf Mail wrote: > But I dont want it to be searched.on > > lets say the user name is "giraffe" > I do want to filter to be "where created by = giraffe" > > but when the user searches his name, I will want on

solr - set fileds as default search field

The following query works well for me http://[]:8983/solr/vault/select?q=VersionComments%3AWhite returns all the documents where version comments includes White I try to omit the field name and put it as a default value as follows : In solr config I write explicit 10 PackageName

Working with solr over two different db schemas

Been working on it for quitre some time. this is my config Now, this runs in my test env and the only thing I do is change the configuration to another db( and as a result also the schema name from [dbo] to another ) This result in a totally different behavior. In the first confi

solr - please help me arrange my search url

I am still doing something wrong with solr. I am querying with the following parameters http://...:8983/solr/vault/select?q=jump&qf=PackageTag&defType=edismax (meaning I am using edismax and I query on the field PackageTag ) I get nothing. when I dont declare the field and query http://...:89

Re: solr - please help me arrange my search url

> queries ("jump"). > > Are you sure that "jump" appears in that field? What does your field > analyzer look like? Or is it a string field? If the latter, does the case > match exactly and are there any extraneous spaces? > > -- Jack Krupansky

solr - using fq parameter does not retrieve an answer

When I query using http://localhost:8983/solr/vault/select?q=*:* I get reuslts including the following ... ... 7 ... Now I try to get only that row so I add to my query fq=VersionNumber:7 http://localhost:8983/solr/vault/select?q=*:*&fq=VersionNumber:7 And I get nothing. Any idea?

Re: solr - using fq parameter does not retrieve an answer

Thanks. On Mon, Aug 5, 2013 at 4:57 PM, Shawn Heisey wrote: > On 8/5/2013 2:35 AM, Mysurf Mail wrote: > > When I query using > > > > http://localhost:8983/solr/vault/select?q=*:* > > > > I get reuslts including the following > > > > > > ...

Knowing what field caused the retrival of the document

I have two indexed fields in my document.- Name, Comment. The user searches for a phrase and I need to act differently if it appeared in the comment or the name. Is there a way to know why the document was retrieved? Thanks.

How to plan field boosting

I query using qf=Name+Tag Now I want that documents that have the phrase in tag will arrive first so I use qf=Name+Tag^2 and they do appear first. What should be the rule of thumb regarding the number that comes after the field? How do I know what number to set it?

Re: Knowing what field caused the retrival of the document

gt; function, by adding something like > > matchesinname:tf(name, "whatever") > > to the 'fl' parameter - if the 'name' field contains "whatever", the > (result) field 'matchesinname' will be 1. > > > > > On Tue, Aug

Multiple sorting does not work as expected

My documents has 2 indexed attribute - name (string) and version (number) I want within the same score the documents will be displayed by the following order score(desc),name(desc),version(desc) Therefor I query using : http://localhost:8983/solr/vault/select? q=BOM&fl=*:score&

Re: Multiple sorting does not work as expected

my schema On Tue, Aug 6, 2013 at 5:06 PM, Mysurf Mail wrote: > My documents has 2 indexed attribute - name (string) and version (number) > I want within the same score the documents will be displayed by the > following order > > score(desc),name(des

Re: Multiple sorting does not work as expected

;desc". I suspect that > you wanted name to be sorted "asc" (natural order.) > > -- Jack Krupansky > > -Original Message- From: Mysurf Mail > Sent: Tuesday, August 06, 2013 10:22 AM > To: solr-user@lucene.apache.org > Subject: Re: Multiple sorting d

Solr - how do I index barcode

I have a documnet that contains the following data car { id: guid name: string sku: list } Now, The barcodes dont have a pattern. It can be either one of the follwings: ABCD-EF34GD-JOHN ABCD-C08-YUVF I want to index my documents so that search for 1. ABCD will return both. 2

Re: Solr - how do I index barcode

2. notes 1. My current query is similiar to this http://127.0.0.1:8983/solr/vault/select?q=ABCD&qf=Name+SKU&defType=edismax 2. I want it to be case insensitive On Thu, Aug 8, 2013 at 2:52 PM, Mysurf Mail wrote: > I have a documnet that contains the following data > &g

solr not writing logs when it runs not from its main folder

When I run solr using java -jar "C:\solr\example\start.jar" It writes logs to C:\solr\example\logs. When I run it using java -Dsolr.solr.home="C:\solr\example\solr" -Djetty.home="C:\solr\example" -Djetty.logs="C:\solr\example\logs" -jar "C:\solr\example\ start.jar" it writes lo

autocomplete feature - where to begin

I have indexed the data from the db and so far it searches really well. Now I want to create auto-complete/suggest feature in my website So far I have seen articles about Suggester, spellchecker, and searchComponents. Can someone point me to a good article about basic autocomplete implementation?

Re: autocomplete feature - where to begin

ns for improvements to that doc (such as steps > that aren't clear), you're welcome to set up an account there and > leave a comment. > > Cassandra > > On Tue, Aug 13, 2013 at 11:16 AM, Mysurf Mail > wrote: > > I have indexed the data from the db and so far it

Troubles defining suggester/ understanding results

I am having troubles defining suggester for auto complete after reading the tutorial. Here are my shcema definitions: ... I also added two field types Now since I want to make suggestions from multiple fields and I cant declare two fields I d

Problem parsing suggest response

Hi, I am having problems parsing suggest json response in c#. Here is an example { - responseHeader: { - status: 0, - QTime: 1 }, - spellcheck: { - suggestions: [ - "at", - { - numFound: 1, - startOffset:

solr suggestion -

the following request http://127.0.0.1:8983/solr/vault/suggest?wt=json&q=at%20l Returns phrases that starts with at and with l (as shown below ) Now, what if I want phrases that starts with "At l" such as "At Least..." Thanks. { - responseHeader: { - status: 0, - QTime: 1

Solr suggest - How to define solr suggest as case insensitive

My suggest (spellchecker) is returning case sensitive answers. (I use it to autocomplete - dog and Dog return different phrases)\ my suggest is defined as follows - in solrconfig - suggest org.apache.solr.spelling.suggest.Suggester org.apache.solr.spelling.suggest.tst.TSTLookup

Re: solr suggestion -

Yes. I understood that from the result. But how do I change that behaviour? "Don't do any analysis on the field you are using for suggestion" Please elaborate. On Mon, Sep 9, 2013 at 8:48 PM, tamanjit.bin...@yahoo.co.in < tamanjit.bin...@yahoo.co.in> wrote: > Don't do any analysis on the field

Re: Solr suggest - How to define solr suggest as case insensitive

I have added it and it didnt work. Still returning different result to 1=C and q=c On Tue, Sep 10, 2013 at 1:52 AM, Chris Hostetter wrote: > > : This is probably because your dictionary is made up of all lower case > tokens, > : but when you query the spell-checker similar analysis doesnt happen

Solr Suggester - How do I filter autocomplete results

I want to filter the auto complete results from my suggester Lets say I have a book table Table (Id Guid, BookName String, BookOwner id) I want each user to get a list to autocomplete from its own books. I want to add something like the http://.../solr/vault/suggest?q=c&fq=BookOwner:3 This doe

Solr doesnt return answer when searching numbers

I am querying using http://...:8983/solr/vault/select?q="design test"&fl=PackageName I get 3 result: - design test - design test 2013 - design test for jobs Now when I query using q="test for jobs" -> I get only "design test for jobs" But when I query using q = 2013 http://...:8983/s

How to define facet.prefix as case-insensitive

I am using facet.prefix for auto complete. This is my definition explicit ... true on Suggest this is my field and all works fine but when I search using caps lock it doesn't return answers. Even when the field contains capitals letters - it doesn't. I assu

Re: How to define facet.prefix as case-insensitive

thanks. On Sun, Sep 22, 2013 at 6:24 PM, Erick Erickson wrote: > You'll have to lowercase the term in your app and set > terms.prefix to that value, there's no analysis done > on the terms.prefix value. > > Best, > Erick > > On Sun, Sep 22, 2013 at 4:07 AM, My

solr - searching part of words

My field is defined as *text_en is defined as in the original schema.xml that comes with solr Now, my field has the following vaues - "one" - "one1" searching for "one" returns only the field "one". What causes it? how can I change it?

installing & configuring solr over ms sql server - tutorial needed

I am trying to config solr over ms sql server. I found only this tutorial whih is a bit old (2011) Is there an updated / formal tutorial?

Re: installing & configuring solr over ms sql server - tutorial needed

> - Time is the quality of nature that keeps events from happening all > at once. Lately, it doesn't seem to be working. (Anonymous - via GTD > book) > > > On Fri, May 31, 2013 at 11:03 AM, Mysurf Mail > wrote: > > I am trying to config solr over ms sql server. >

Re: installing & configuring solr over ms sql server - tutorial needed

n.com/in/alexandrerafalovitch > - Time is the quality of nature that keeps events from happening all > at once. Lately, it doesn't seem to be working. (Anonymous - via GTD > book) > > > On Fri, May 31, 2013 at 11:29 AM, Mysurf Mail > wrote: > > Thanks. > > A

Re: installing & configuring solr over ms sql server - tutorial needed

btw: The other stages still refer to location relative to tomcat On Sat, Jun 1, 2013 at 12:02 AM, Mysurf Mail wrote: > for instance step 5 - Download and install a SQL Server JDBC drive. > Where do I put it when using jetty? > > * Just asked here a question if an official tutoria

Re: installing & configuring solr over ms sql server - tutorial needed

Hi, I am still having a problem with this tutorial trying to get solr on tomcat. in step 4 when I copy apache-solr-1.4.0\example\solr to my tomcat dir I get a folder with bin and collection1 folder. Do I need them? should I create conf under

Re: installing & configuring solr over ms sql server - tutorial needed

My problem was with sql server. This is a great "step by step" On Sat, Jun 1, 2013 at 2:06 AM, bbarani wrote: > Why dont you follow this one tutorial to set the SOLR on tomcat.. > > http://wiki.apache.org/solr/SolrTomcat > > > >

Estimating the required volume to

Hi, I am just starting to learn about solr. I want to test it in my env working with ms sql server. I have followed the tutorial and imported some rows to the Solr. Now I have a few noob question regarding the benefits of implementing Solr on a sql environment. 1. As I understand, When I send a

Clearing a specific index / all indice

I am running solr with two cores in solr.xml One is product (import from db) and one is collection1 (from the tutorial) Now in order to clear the index I run http://localhost:8983/solr/update?stream.body=*:* http://localhost:8983/solr/update?stream.body= only the "collection1" core (of the tut

word stem

Using solr over my sql db I query the following http://localhost:8983/solr/products/select?q=require&wt=xml&indent=true&fl=*,score where the queried word "require" is found in the index since I imported the following: "Each frame is hand-crafted in our Bothell facility to the optimum diameter an

Re: Estimating the required volume to

gt;control what the search experience is. etc. > > 2> Not really :(. See: > > http://searchhub.org/dev/2012/07/23/sizing-hardware-in-the-abstract-why-we-dont-have-a-definitive-answer/ > > Best > Erick > > On Sat, Jun 1, 2013 at 1:07 PM, Mysurf Mail wrote: > &g

Re: Estimating the required volume to

e in those cases. It's all about selecting the > right tool for the use-case. > > FWIW, > Erick > > On Mon, Jun 3, 2013 at 4:44 AM, Mysurf Mail wrote: > > Thanks for your answer. > > Can you please elaborate on > > "mssql text searching is pretty primi

Need assistance in defining solr to process user generated query text

Hi, I have been reading solr wiki pages and configured solr successfully over my flat table. I have a few question though regarding the querying and parsing of user generated text. 1. I have understood through this page that I want to use dismax. Through thi

Re: Need assistance in defining solr to process user generated query text

ou are using the "keyword" tokenizer > rather than the standard tokenizer. > > What is your default or query fields for dismax/edismax? And what are the > field types for those fields? > > -- Jack Krupansky > > -Original Message- From: Mysurf Mail >

How to define my data in schema.xml

Hi, I have created a flat table from my DB and defined a solr core on it. It works excellent so far. My problem is that my table has two hierarchies. So when flatted it is too big. Lets consider the following example scenario My Tables are School Students (1:n with school) Teachers(1:n with scho

Is there a way to encrypt username and pass in the solr config file

Hi, I want to encrypt (rsa maybe?) my user name/pass in solr . Cant leave a simple plain text on the server. What is the recomended way? Thanks.

Solr data files

Where are the core data files located? Can I just delete folder/files in order to quick clean the core/indexes? Thanks

Re: How to define my data in schema.xml

and students as multiple value or something like this and than teacherCourses and studentHobbies as 1:n respectively. This is quite similiar to my real life demand, so I came here to get some tips as a solr noob. On Mon, Jun 17, 2013 at 9:08 PM, Gora Mohanty wrote: > On 17 June 2013 21:39,

Re: Solr data files

ovitch > - Time is the quality of nature that keeps events from happening all > at once. Lately, it doesn't seem to be working. (Anonymous - via GTD > book) > > > On Mon, Jun 17, 2013 at 3:33 PM, Mysurf Mail > wrote: > > Where are the core data files located? > > Can I just delete folder/files in order to quick clean the core/indexes? > > Thanks >

Re: How to define my data in schema.xml

this will work great on solar - searching for the school name will retrieve 8.1 B rows. 3. Lets say all my searches are user generated free text search that is searching name and comments columns. Thanks. On Tue, Jun 18, 2013 at 7:32 AM, Gora Mohanty wrote: > On 18 June 2013 01:10, Mysurf M

implementing identity authentication in SOLR

Hi, In order to add solr to my prod environmnet I have to implement some security restriction. Is there a way to add user/pass to the requests and to keep them *encrypted*in a file. thanks.

Re: implementing identity authentication in SOLR

you. On Tue, Jun 18, 2013 at 10:56 AM, Gora Mohanty wrote: > On 18 June 2013 13:10, Mysurf Mail wrote: > > Hi, > > In order to add solr to my prod environmnet I have to implement some > > security restriction. > > Is there a way to add user/pass to the requests and to

Re: Need assistance in defining solr to process user generated query text

words you need to use, say, the > "text_general" type, which would index > "my" "dog" "has" "fleas" > > Best > Erick > > On Mon, Jun 17, 2013 at 11:26 AM, Mysurf Mail > wrote: > > I have one fact table with a lot of

Re: Is there a way to encrypt username and pass in the solr config file

e wanted to encrypt the > username/password in the DIH configuration file. > "Mysurf Mail", could you please clarify? > > Regards, > Gora >

Re: How to define my data in schema.xml

t; Right. Each Student has 300 hobbies? If you say so, but... > > Don't worry about schema.xml until you get your data model under control. > > For an initial focus, try envisioning the use cases for user queries. That > will guide you in thinking about how the data would need to be

Re: How to define my data in schema.xml

olr effectively. > > Again, start with the queries - what problem are you trying to solve. > Nobody stores data just for the sake of storing it - how will the data be > used? > > > -- Jack Krupansky > > -----Original Message- From: Mysurf Mail > Sent: Tuesday, June 18, 201

modeling multiple values on 1:n connection

I try to model my db using thisexample from solr wiki. I have a table called item and a table called features with id,featureName,description here is the updated xml (added featureName)

Re: modeling multiple values on 1:n connection

wrote: > On 23 June 2013 01:31, Mysurf Mail wrote: > > I try to model my db using > > this<http://wiki.apache.org/solr/DataImportHandler#Full_Import_Example > >example > > from solr wiki. > > > > I have a table called item and a table called features with &

Need assistance in defining search urls

Now, each doc looks like this (i generated random user text in the freetext columns in the DB) We have located the ship. d1771fc0-d3c2-472d-aa33-4bf5d1b79992 b2986a4f-9687-404c-8d45-57b073d900f7 a99cf760-d78e-493f-a827-585d11a765f3 ba349832-c655-4a02-a552-d5b76b45d58c 35e86a61-eba8-49f4-95af-8

What should be the definitions ( field type ) for a field that will be search with user free text

currently I am using text_general. I want to search with user free text search, therefor I would like tokenization, stemmings ... How do I define stemmers? Should I use text_en instead of text_general? Thank you.

Re: Need assistance in defining search urls

ould do this in > just a couple of lines and make the query much faster. > > For question 1.b the two queries seem identical - was that the case? > > There is no "*:" feature to query all fields in Solr - although the > LucidWorks Search query parser does supp

Re: Need assistance in defining search urls

Regarding "There is no "*:" feature to query all fields in Solr" When I enter the dashboard -> solr/#/[core]/query the default is "*:*" and it brings everything. On Mon, Jun 24, 2013 at 5:41 PM, Mysurf Mail wrote: > Thanks Jack and Giovanni. > Jack: >

why does the has to be indexed.

Currently, I cant describe my unique key with indexed false. As I understand from the docs the field attribute should be true only if i want the field to be searchable or sortable. Let's say I have a schema with id and name only, wouldn't I want the following configuration id - indexed "false",

Re: What should be the definitions ( field type ) for a field that will be search with user free text

better starting point for adding in the more > advanced language processing features. > > -- Jack Krupansky > > -----Original Message- From: Mysurf Mail > Sent: Monday, June 24, 2013 10:26 AM > To: solr-user@lucene.apache.org > Subject: What should be the definitions ( field t