Hi Sohan, Given you have 15 days and this looks like a class project, I would suggest going with John Berryman's approach - he also provides code which you can just apply to your data. Even if you don't get the exact expansions you desire, I think you will get results that will pleasantly surprise you :-).
-sujit On Mon, Mar 10, 2014 at 11:07 PM, Sohan Kalsariya <sohankalsar...@gmail.com>wrote: > Hey Sujit thanks a lot. > But what do you think about Berryman blog post ? > Is it feasible to apply or should i apply the synonym stuff ? > which one is good? > And the 3rd approach you told me about, seems like difficult and > time consuming for students like me as i will have to submit this in next > 15 Days. > Please suggest me something. > > > On Tue, Mar 11, 2014 at 5:12 AM, Sujit Pal <sujit....@comcast.net> wrote: > > > Hi Sohan, > > > > You would be the best person to answer your question of how to proceed > :-). > > From your original query term "musical events in New York" rewriting to > > "musical nights at ABC place" OR "concerts events" OR "classical music > > event" you would have to build into your knowledge base that "ABC place" > is > > a synonym for "New York", and that "musical event at New York" is a > synonym > > for "concerts events" and "classical music event". You can do this using > > approach #1 (from the Berryman blog post) and the approach #2 (my first > > suggestion) but these results are not guaranteed - because your corpus > may > > not contain this relationship. Approach #3 (my second suggestion) > involves > > lots of work and possibly domain knowledge but much cleaner > relationships. > > OTOH, you could get away for this one query by adding the three queries > > into your synonyms.txt and enabling synonym support in Solr. > > > > http://stackoverflow.com/questions/18790256/solr-synonym-not-working > > > > So how much effort you put into supporting this feature would be dictated > > by how important it is to your environment - that is a question only you > > can answer. > > > > -sujit > > > > > > > > On Sun, Mar 9, 2014 at 11:26 PM, Sohan Kalsariya > > <sohankalsar...@gmail.com>wrote: > > > > > Thanks Sujit and all for your views about semantic search in solr. > > > But How do i proceed towards, i mean how do i start off the things to > get > > > on track ? > > > > > > > > > > > > On Sat, Mar 8, 2014 at 10:50 PM, Sujit Pal <sujit....@comcast.net> > > wrote: > > > > > > > Thanks for sharing this link Sohan, its an interesting approach. > Since > > > you > > > > have effectively defined what you mean by Semantic Search, there are > > > couple > > > > other approaches I know of to do something like this: > > > > 1) preprocess your documents looking for terms that co-occur in the > > same > > > > document. The more such cooccurrences you find the more strongly > these > > > > terms are related (can help with ordering related terms from most > > related > > > > to least related). At query time expand the query to include /most/ > > > related > > > > concepts and search. > > > > 2) use an external knowledgebase such as a taxonomy that indicates > > > > relationships between concepts (this is the approach we use). At > query > > > time > > > > expand the query to include related concepts and search. > > > > > > > > -sujit > > > > > > > > On Sat, Mar 8, 2014 at 8:21 AM, Sohan Kalsariya < > > > sohankalsar...@gmail.com > > > > >wrote: > > > > > > > > > Basically, when i searched it on Google I got this result : > > > > > > > > > > > > > > > > > > > > > > > > > http://www.opensourceconnections.com/2013/08/25/semantic-search-with-solr-and-python-numpy/ > > > > > > > > > > And I am working on this. > > > > > > > > > > So is this useful ? > > > > > > > > > > > > > > > On Sat, Mar 8, 2014 at 3:11 PM, Alexandre Rafalovitch < > > > > arafa...@gmail.com > > > > > >wrote: > > > > > > > > > > > And how would it know to give you those results? Obviously, you > > have > > > > > > some sort of magic/algorithm in your mind. Are you doing > geographic > > > > > > location match, category match, synonyms match? > > > > > > > > > > > > We can't really help with generic questions. You still need to > > figure > > > > > > out what "semantic" means for you specifically. > > > > > > > > > > > > Regards, > > > > > > Alex. > > > > > > Personal website: http://www.outerthoughts.com/ > > > > > > LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch > > > > > > - Time is the quality of nature that keeps events from happening > > all > > > > > > at once. Lately, it doesn't seem to be working. (Anonymous - > via > > > GTD > > > > > > book) > > > > > > > > > > > > > > > > > > On Sat, Mar 8, 2014 at 4:27 PM, Sohan Kalsariya > > > > > > <sohankalsar...@gmail.com> wrote: > > > > > > > Hello, > > > > > > > > > > > > > > I am working on an event listing and promotions website( > > > > > > > http://allevents.in) and I want to apply semantic search on > > solr. > > > > > > > For example, if someone search : > > > > > > > > > > > > > > "Musical Events in New York" > > > > > > > So it would give me results such as : > > > > > > > > > > > > > > * Musical Night at ABC place > > > > > > > * Concerts Events > > > > > > > * Classical Music Event > > > > > > > I mean all results should be Semantic to the Search_Query it > > should > > > > not > > > > > > > give the results only based on "tf-idf". So can you please make > > me > > > > > > > understand how do i proceed to apply Semantic Search in Solr. ( > > > > > > allevents.in) > > > > > > > > > > > > > > -- > > > > > > > Regards, > > > > > > > *Sohan Kalsariya* > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > Regards, > > > > > *Sohan Kalsariya* > > > > > > > > > > > > > > > > > > > > > -- > > > Regards, > > > *Sohan Kalsariya* > > > > > > > > > -- > Regards, > *Sohan Kalsariya* >
