Re: [EXT] Re: Looking for tips on improving full-text search quality in Postgres

[Atri Sharma]

Can you define what "high quality" is?

Are you referring to precision? Or recall? Or speed? Or query dialect?

On Fri, Mar 4, 2022 at 8:59 PM Bayer, Samuel  wrote:
>
> Thanks for replying. My problem is that I can't provide enough guidance on 
> what isn't working, because (a) I don't have good enough intuitions about how 
> the normalization options are expected to affect the results, and (b) I can't 
> identify a specific missing function - I'm just observing that I can't make 
> the results as high-quality as Solr.
>
> My apologies.
>
> Sam
>
> On 3/4/22 10:25 AM, Bruce Momjian wrote:
> > On Fri, Mar 4, 2022 at 08:10:48AM -0500, Bayer, Samuel wrote:
> >> Hi all -
> >>
> >> When I have a need for both sophisticated database querying and
> >> full-text search, I'd rather not stand up a technology stack with
> >> multiple tools (e.g., Postgres and Apache Solr, or Postgres and
> >> ElasticSearch with a zomboDB bridge). So I've been looking at the
> >> Postgres full-text search capability, and comparing it to Apache
> >> Solr. My experience so far - which has not been entirely anecdotal,
> >> but hasn't amounted to a formal TREC-style evaluation - is that
> >> Postgres full-text search, in any ranking/normalization configuration
> >> I can create, is reliably worse than Solr. Now, I understand that the
> >> whole point of Solr is search, and this is a sideline for Postgres,
> >> but I'd like to figure out how close Postgres can get, and while I'm
> >> knowledgeable about search technologies, I'm not an expert. And I've
> >> looked for information on the Web about comparing Postgres search
> >> to other search capabilities, and everything I've found so far is
> >> extremely basic.
> >>
> >> Does anybody have any pointers to resources (people, sites, journal
> >> articles, blogs, etc.) which are deeply knowledgeable about this
> >> comparison?
> >
> > Uh, most of our full text seach is done by Russian developers, who are
> > obviously very good at it.  It would be helpful if you could list
> > exactly what is missing and then we can have a discussion the hackers
> > list to see what is possible.  I think it would be helpful  if we just
> > document what we _don't_ have.
> >
>
>


-- 
Regards,

Atri
l'apprenant

Re: [EXT] Re: Looking for tips on improving full-text search quality in Postgres

[Atri Sharma]

TF/IDF should be pretty simple to implement IMO.

And no, Solr does not give preference to prior documents.

However, Solr allows you to "boost" specific terms, thus creating the
impression of preference.

On Fri, 4 Mar 2022, 22:15 Bruce Momjian,  wrote:

> On Fri, Mar  4, 2022 at 11:43:57AM -0500, Tom Lane wrote:
> > "Bayer, Samuel"  writes:
> > > One concrete question, I suppose, is: the classic TF/IDF search
> strategy relies on inverse document frequency, which looks across the
> corpus. I can't tell whether that corpus-wide frequency information is
> taken into account in either ranking function.
> >
> > The documentation is pretty clear that they don't, they just consider
> each
> > document in isolation.  Building a structure that would allow more-global
> > info to be taken into account is an interesting project that nobody's
> > tackled.
>
> Oh, you mean like, "pizza" is used only in this document vs it being
> used in every document.  Should we add some documentation about this or
> is it already clear?
>
> --
>   Bruce Momjian  https://momjian.us
>   EDB  https://enterprisedb.com
>
>   If only the physical world exists, free will is an illusion.
>
>

Re: Foreign Data Wrapper

[Atri Sharma]

Which FDW?



On Thu, Dec 21, 2017 at 5:54 PM, Virendra Shaktawat - Quipment India <
virendra.shakta...@quipment.nl> wrote:

> [image: Quipment Logo]
>
> Hello ,
>
>
>
> I have stuck at foreign data wrapper. I am accessing the form MS Sql
> Server. Foreign table has been created with data. unfortunately I am unable
> to perform DML operation like insert, update and delete on foreign table.
> Whenever I tried to perform DML operation on foreign table we are getting
> error i.e. “ERROR: cannot insert into foreign table "test12"
>
> SQL state: 0A000”
>
>
>
> Kindly give me response soon because I am stuck at the middle of the
> project.
>
>
>
> Thanks,
>
> *Virendra Shaktawat*
> *Database Developer*
>
> R&D .Net Department
>
> T / +91 (0) 9099907116 <+91%2090999%2007116>
> virendra.shaktawat@ <%20virendra.shakta...@quipment.in> / www.quipment.in
>
>
>
> *QTwee Group BV*
> KvK Arnhem 60858001
> BTW NL854090721B01
> mail@  / www.quipment.nl
>
> *Hoofdkantoor Nijmegen
> *
> Kerkenbos 1236 C
> 6546 BE Nijmegen
>
> Tel.
>
> +31 (0)24 372 47 00
>
> Fax.
>
> +31 (0)24 372 47 07
>
> *Quipment India*
> 903-904 Landmark,
> Beside Titanium City Centre,
> Anandnagar Road, 100ft Ring Road,
> Ahmedabad
> Gujarat - 380015 - India
> Tel. +91 (0) 79 4009 7847 <+91%2079%204009%207847>
>
> *Disclaimer*
>
> This e-mail message (including any attachment) is intended only for the
> personal use of the recipient(s) named above. This message is confidential
> and may be legally privileged. If you are not an intended recipient, you
> may not review, copy or distribute this message. If you have received this
> communication in error, please notify us immediately by e-mail and delete
> the original message.
>
>
>



-- 
Regards,

Atri
*l'apprenant*