Re: Solr storage of fields <-> indexed data

2020-09-28 Thread Edward Turner
That's really good and helpful info, thank you. Perfect. Best wishes, Edd On Mon, 28 Sep 2020, 5:53 pm Shawn Heisey, wrote: > On 9/28/2020 8:56 AM, Edward Turner wrote: > > By removing the copyfields, we've found that our index sizes have reduced > > by ~40% in some cases, which is great! We'r

Re: Solr storage of fields <-> indexed data

2020-09-28 Thread Shawn Heisey
On 9/28/2020 8:56 AM, Edward Turner wrote: By removing the copyfields, we've found that our index sizes have reduced by ~40% in some cases, which is great! We're just curious now as to exactly how this can be ... That's not surprising. My question is, given the following two schemas, if we in

Re: Solr storage of fields <-> indexed data

2020-09-28 Thread Erick Erickson
Fields are placed in the index totally separately from each other, so it’s no wonder that removing the copyField results in this kind of savings. And they have to be separate. Consider what comes out of the end of the analysis chain. The same input could produce totally different output. As a tri

Solr storage of fields <-> indexed data

2020-09-28 Thread Edward Turner
Hi all, We have recently switched to using edismax + qf fields, and no longer use copyfields to allow us to easily search over values in multiple fields (by copying multiple fields' values to the copyfield destinations, and then performing queries over the destination field). By removing the copy