DataImportHandler - Delta Import
Hello, I am running *Solr 3.5* and using Data Import Handler. I am using the following query - Although the FULL Import is running fine but the delta import is having trouble. Here is what I am experiencing - 1. Delta Imports are working in cumulative fashion - any increment (delta) is the cumulative from the point last FULL import was taken. 2. Delta Import is running for only records that have been added (New Inserted) and *not* updated (Metadata Changes to the records indexed during FULL Import). Will appreciate your inputs to fix these two issues. Thanks!
Issue while searching with escape characters
Hello I am searching Solr 6 via http call by providing a "UserID". Its just that the data is in the format of (DVeto1) So, in my call I have to provide parenthesis but since its a special character I need to provide escape also. Looks like its not working Provided the search string over http like these but none worked - (DVeto1) \(DVeto1\) Since this is not working I am sure I am missing something. Will appreciate your inputs. Thanks!
Re: Issue while searching with escape characters
Thanks Jan. It must be a late night. Not sure what I was thinking.
I provided *%5C%28DVeto1%5C%29* but still not able to get the search results
I also have a situation where I have to search something like *(ID#DVeto2)*
and I am providing *%5C%28ID%23DVeto2%5C%2*9 and still not able to get the
resultsets.
Its not throwing any error but no result found in these two scenarios.
Although we know there should be some records.
Am I missing anything?
Thanks!
On Wed, Dec 6, 2017 at 4:13 AM, <
jan.christopher.schluchtmann-...@continental-corporation.com> wrote:
> hmm ... it seems, you are using XML/HTML-encoding, but you need
> HTTP-encoding, which looks like this:
>
>
> ␣ ! " # $ % & ' ( )
> * + , - . / : ; < =
> > ? @ [ \ ] { | }
>
> %20 %21 %22 %23 %24 %25 %26 %27 %28 %29
> %2A %2B %2C %2D %2E %2F %3A %3B %3C %3D
> %3E %3F %40 %5B %5C %5D %7B %7C %7D
>
>
> good luck! :)
>
>
> Mit freundlichen Grüßen/ With kind regards
>
> Jan Schluchtmann
> Systems Engineering Cluster Instruments
> VW Group
> Continental Automotive GmbH
> Division Interior
> ID S3 RM
> VDO-Strasse 1, 64832 Babenhausen, Germany
>
> Telefon/Phone: +49 6073 12-4346
> Telefax: +49 6073 12-79-4346
>
>
>
> Von:Roopesh Uniyal
> An: solr-user@lucene.apache.org,
> Datum: 06.12.2017 09:57
> Betreff:Issue while searching with escape characters
>
>
>
> Hello I am searching Solr 6 via http call by providing a "UserID".
>
> Its just that the data is in the format of (DVeto1)
>
> So, in my call I have to provide parenthesis but since its a special
> character I need to provide escape also. Looks like its not working
>
> Provided the search string over http like these but none worked -
>
> (DVeto1)
> \(DVeto1\)
>
> Since this is not working I am sure I am missing something. Will
> appreciate
> your inputs.
>
> Thanks!
>
>
>
Re: Issue while searching with escape characters
Thanks Emir & Jan!
I have a situation where I need to search a field value is
between parenthesis () like - *(DVeto1)*
Based on the documentation
<http://lucene.apache.org/core/7_1_0/queryparser/org/apache/lucene/queryparser/classic/package-summary.html#Escaping_Special_Characters>
parenthesis just need escape character but no matter what way I provide it,
its not providing resultset.
%28*DVeto1*%29
%5C%28*DVeto1*%5C%29
%22%28%22*DVeto1*%22%29%22
%22%5C%28%22*DVeto1*%22%5C%29%22
Thanks,
Roopesh
On Wed, Dec 6, 2017 at 7:44 AM, Emir Arnautović <
emir.arnauto...@sematext.com> wrote:
> Hi,
> You need to escape special chars with \ and if you are sending it in URL
> you can URL encode it, but that is URL related thing not Solr.
>
> Here is the list of Lucene characters that need to be escaped:
> http://lucene.apache.org/core/7_1_0/queryparser/org/apache/
> lucene/queryparser/classic/package-summary.html#Escaping_
> Special_Characters <http://lucene.apache.org/core/7_1_0/queryparser/org/
> apache/lucene/queryparser/classic/package-summary.html#
> Escaping_Special_Characters>
>
> HTH,
> Emir
> --
> Monitoring - Log Management - Alerting - Anomaly Detection
> Solr & Elasticsearch Consulting Support Training - http://sematext.com/
>
>
>
> > On 6 Dec 2017, at 10:33, Roopesh Uniyal
> wrote:
> >
> > Thanks Jan. It must be a late night. Not sure what I was thinking.
> >
> > I provided *%5C%28DVeto1%5C%29* but still not able to get the search
> results
> >
> > I also have a situation where I have to search something like
> *(ID#DVeto2)*
> > and I am providing *%5C%28ID%23DVeto2%5C%2*9 and still not able to get
> the
> > resultsets.
> >
> > Its not throwing any error but no result found in these two scenarios.
> > Although we know there should be some records.
> >
> > Am I missing anything?
> >
> > Thanks!
> >
> >
> > On Wed, Dec 6, 2017 at 4:13 AM, <
> > jan.christopher.schluchtmann-...@continental-corporation.com> wrote:
> >
> >> hmm ... it seems, you are using XML/HTML-encoding, but you need
> >> HTTP-encoding, which looks like this:
> >>
> >>
> >> ␣ ! " # $ % & ' ( )
> >> * + , - . / : ; <
> =
> >>> ? @ [ \ ] { | }
> >>
> >> %20 %21 %22 %23 %24 %25 %26 %27 %28 %29
> >> %2A %2B %2C %2D %2E %2F %3A %3B %3C %3D
> >> %3E %3F %40 %5B %5C %5D %7B %7C %7D
> >>
> >>
> >> good luck! :)
> >>
> >>
> >> Mit freundlichen Grüßen/ With kind regards
> >>
> >> Jan Schluchtmann
> >> Systems Engineering Cluster Instruments
> >> VW Group
> >> Continental Automotive GmbH
> >> Division Interior
> >> ID S3 RM
> >> VDO-Strasse 1, 64832 Babenhausen, Germany
> >>
> >> Telefon/Phone: +49 6073 12-4346
> >> Telefax: +49 6073 12-79-4346
> >>
> >>
> >>
> >> Von:Roopesh Uniyal
> >> An: solr-user@lucene.apache.org,
> >> Datum: 06.12.2017 09:57
> >> Betreff:Issue while searching with escape characters
> >>
> >>
> >>
> >> Hello I am searching Solr 6 via http call by providing a "UserID".
> >>
> >> Its just that the data is in the format of (DVeto1)
> >>
> >> So, in my call I have to provide parenthesis but since its a special
> >> character I need to provide escape also. Looks like its not working
> >>
> >> Provided the search string over http like these but none worked -
> >>
> >> (DVeto1)
> >> \(DVeto1\)
> >>
> >> Since this is not working I am sure I am missing something. Will
> >> appreciate
> >> your inputs.
> >>
> >> Thanks!
> >>
> >>
> >>
>
>
Re: Issue while searching with escape characters
Oh, that might be because I made DVeto1 in bold but it converted bold into
*. So you can ignore both *.
On Wed, Dec 6, 2017 at 10:35 AM, Emir Arnautović <
emir.arnauto...@sematext.com> wrote:
> Hi Roopesh,
> What are *? Is it wildcard or special char as well? Examples that you
> provided are not what you said you want to search - * are not on the same
> position. If you are not finding anything, that can be due to your analysis
> - are you sure that your analysis does not trim parenthesis?
>
> Regards,
> Emir
> --
> Monitoring - Log Management - Alerting - Anomaly Detection
> Solr & Elasticsearch Consulting Support Training - http://sematext.com/
>
>
>
> > On 6 Dec 2017, at 16:13, Roopesh Uniyal
> wrote:
> >
> > Thanks Emir & Jan!
> >
> > I have a situation where I need to search a field value is
> > between parenthesis () like - *(DVeto1)*
> >
> > Based on the documentation
> > <http://lucene.apache.org/core/7_1_0/queryparser/org/
> apache/lucene/queryparser/classic/package-summary.html#
> Escaping_Special_Characters>
> > parenthesis just need escape character but no matter what way I provide
> it,
> > its not providing resultset.
> >
> > %28*DVeto1*%29
> > %5C%28*DVeto1*%5C%29
> > %22%28%22*DVeto1*%22%29%22
> > %22%5C%28%22*DVeto1*%22%5C%29%22
> >
> >
> > Thanks,
> > Roopesh
> >
> > On Wed, Dec 6, 2017 at 7:44 AM, Emir Arnautović <
> > emir.arnauto...@sematext.com> wrote:
> >
> >> Hi,
> >> You need to escape special chars with \ and if you are sending it in URL
> >> you can URL encode it, but that is URL related thing not Solr.
> >>
> >> Here is the list of Lucene characters that need to be escaped:
> >> http://lucene.apache.org/core/7_1_0/queryparser/org/apache/
> >> lucene/queryparser/classic/package-summary.html#Escaping_
> >> Special_Characters <http://lucene.apache.org/
> core/7_1_0/queryparser/org/
> >> apache/lucene/queryparser/classic/package-summary.html#
> >> Escaping_Special_Characters>
> >>
> >> HTH,
> >> Emir
> >> --
> >> Monitoring - Log Management - Alerting - Anomaly Detection
> >> Solr & Elasticsearch Consulting Support Training - http://sematext.com/
> >>
> >>
> >>
> >>> On 6 Dec 2017, at 10:33, Roopesh Uniyal
> >> wrote:
> >>>
> >>> Thanks Jan. It must be a late night. Not sure what I was thinking.
> >>>
> >>> I provided *%5C%28DVeto1%5C%29* but still not able to get the search
> >> results
> >>>
> >>> I also have a situation where I have to search something like
> >> *(ID#DVeto2)*
> >>> and I am providing *%5C%28ID%23DVeto2%5C%2*9 and still not able to get
> >> the
> >>> resultsets.
> >>>
> >>> Its not throwing any error but no result found in these two scenarios.
> >>> Although we know there should be some records.
> >>>
> >>> Am I missing anything?
> >>>
> >>> Thanks!
> >>>
> >>>
> >>> On Wed, Dec 6, 2017 at 4:13 AM, <
> >>> jan.christopher.schluchtmann-...@continental-corporation.com> wrote:
> >>>
> >>>> hmm ... it seems, you are using XML/HTML-encoding, but you need
> >>>> HTTP-encoding, which looks like this:
> >>>>
> >>>>
> >>>> ␣ ! " # $ % & ' (
> )
> >>>> * + , - . / : ; <
> >> =
> >>>>> ? @ [ \ ] { | }
> >>>>
> >>>> %20 %21 %22 %23 %24 %25 %26 %27 %28
> %29
> >>>> %2A %2B %2C %2D %2E %2F %3A %3B %3C
> %3D
> >>>> %3E %3F %40 %5B %5C %5D %7B %7C %7D
> >>>>
> >>>>
> >>>> good luck! :)
> >>>>
> >>>>
> >>>> Mit freundlichen Grüßen/ With kind regards
> >>>>
> >>>> Jan Schluchtmann
> >>>> Systems Engineering Cluster Instruments
> >>>> VW Group
> >>>> Continental Automotive GmbH
> >>>> Division Interior
> >>>> ID S3 RM
> >>>> VDO-Strasse 1, 64832 Babenhausen, Germany
> >>>>
> >>>> Telefon/Phone: +49 6073 12-4346
> >>>> Telefax: +49 6073 12-79-4346
> >>>>
> >>>>
> >>>>
> >>>> Von:Roopesh Uniyal
> >>>> An: solr-user@lucene.apache.org,
> >>>> Datum: 06.12.2017 09:57
> >>>> Betreff:Issue while searching with escape characters
> >>>>
> >>>>
> >>>>
> >>>> Hello I am searching Solr 6 via http call by providing a "UserID".
> >>>>
> >>>> Its just that the data is in the format of (DVeto1)
> >>>>
> >>>> So, in my call I have to provide parenthesis but since its a special
> >>>> character I need to provide escape also. Looks like its not working
> >>>>
> >>>> Provided the search string over http like these but none worked -
> >>>>
> >>>> (DVeto1)
> >>>> \(DVeto1\)
> >>>>
> >>>> Since this is not working I am sure I am missing something. Will
> >>>> appreciate
> >>>> your inputs.
> >>>>
> >>>> Thanks!
> >>>>
> >>>>
> >>>>
> >>
> >>
>
>
Re: Issue while searching with escape characters
Thanks Emir. Got it fixed. End customer's solr was not having the records itself. They were trying to compare apples with oranges. On Thu, Dec 7, 2017 at 7:43 AM Emir Arnautović wrote: > Hi Roopesh, > If escaping special char with \ does not result in error but in no > results, then it might be worth checking if your indexing is ok - does it > strip parenthesis. > > Can you share example query and schema snippet where you define your field > and fieldType. > > Regards, > Emir > -- > Monitoring - Log Management - Alerting - Anomaly Detection > Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > > > > > On 6 Dec 2017, at 16:39, Roopesh Uniyal > wrote: > > > > Oh, that might be because I made DVeto1 in bold but it converted bold > into > > *. So you can ignore both *. > > > > On Wed, Dec 6, 2017 at 10:35 AM, Emir Arnautović < > > emir.arnauto...@sematext.com> wrote: > > > >> Hi Roopesh, > >> What are *? Is it wildcard or special char as well? Examples that you > >> provided are not what you said you want to search - * are not on the > same > >> position. If you are not finding anything, that can be due to your > analysis > >> - are you sure that your analysis does not trim parenthesis? > >> > >> Regards, > >> Emir > >> -- > >> Monitoring - Log Management - Alerting - Anomaly Detection > >> Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > >> > >> > >> > >>> On 6 Dec 2017, at 16:13, Roopesh Uniyal > >> wrote: > >>> > >>> Thanks Emir & Jan! > >>> > >>> I have a situation where I need to search a field value is > >>> between parenthesis () like - *(DVeto1)* > >>> > >>> Based on the documentation > >>> <http://lucene.apache.org/core/7_1_0/queryparser/org/ > >> apache/lucene/queryparser/classic/package-summary.html# > >> Escaping_Special_Characters> > >>> parenthesis just need escape character but no matter what way I provide > >> it, > >>> its not providing resultset. > >>> > >>> %28*DVeto1*%29 > >>> %5C%28*DVeto1*%5C%29 > >>> %22%28%22*DVeto1*%22%29%22 > >>> %22%5C%28%22*DVeto1*%22%5C%29%22 > >>> > >>> > >>> Thanks, > >>> Roopesh > >>> > >>> On Wed, Dec 6, 2017 at 7:44 AM, Emir Arnautović < > >>> emir.arnauto...@sematext.com> wrote: > >>> > >>>> Hi, > >>>> You need to escape special chars with \ and if you are sending it in > URL > >>>> you can URL encode it, but that is URL related thing not Solr. > >>>> > >>>> Here is the list of Lucene characters that need to be escaped: > >>>> http://lucene.apache.org/core/7_1_0/queryparser/org/apache/ > >>>> lucene/queryparser/classic/package-summary.html#Escaping_ > >>>> Special_Characters <http://lucene.apache.org/ > >> core/7_1_0/queryparser/org/ > >>>> apache/lucene/queryparser/classic/package-summary.html# > >>>> Escaping_Special_Characters> > >>>> > >>>> HTH, > >>>> Emir > >>>> -- > >>>> Monitoring - Log Management - Alerting - Anomaly Detection > >>>> Solr & Elasticsearch Consulting Support Training - > http://sematext.com/ > >>>> > >>>> > >>>> > >>>>> On 6 Dec 2017, at 10:33, Roopesh Uniyal > >>>> wrote: > >>>>> > >>>>> Thanks Jan. It must be a late night. Not sure what I was thinking. > >>>>> > >>>>> I provided *%5C%28DVeto1%5C%29* but still not able to get the search > >>>> results > >>>>> > >>>>> I also have a situation where I have to search something like > >>>> *(ID#DVeto2)* > >>>>> and I am providing *%5C%28ID%23DVeto2%5C%2*9 and still not able to > get > >>>> the > >>>>> resultsets. > >>>>> > >>>>> Its not throwing any error but no result found in these two > scenarios. > >>>>> Although we know there should be some records. > >>>>> > >>>>> Am I missing anything? > >>>>> > >>>>> Thanks! > >>>>> > >>>>> > >>>>> On Wed, De
Enroll
Please enroll me to the group
Re: is there a way to escape in # in solr
Hello Ravi, I am new to Solr and I am facing an issue for which I want to confirm if I need to fix anything. May be you have answer to this - I have to use data import so that I can index some info from MS SQL database in Solr. I am done with it. I can query/see records in solr also. But the column like location where there were "\" in there (e.g., "\solr\solr-6.5\bin"), it is showing - "\\solr\\solr-6.5\\bin"), My SQL is returning only one escape when I run the query in SQL but when I search in solr locally (http://localhost:8983/solr/), it showing double escape. Is it a problem? Will it be returned as double escape if another application (java program) tried to search from this solr index? How can I remove these extra escape. Thanks, Roopesh On Fri, May 12, 2017 at 10:49 AM, ravi432 wrote: > > > > > -- > View this message in context: http://lucene.472066.n3. > nabble.com/is-there-a-way-to-escape-in-in-solr-tp4334838.html > Sent from the Solr - User mailing list archive at Nabble.com. >
