Jetty JNDI connection pooling

2021-02-26 Thread Srinivas Kashyap
added below entry in server/solr-webapp/webapp/WEB-INF/web.xml jdbc/tss javax.sql.DataSource Container What is the default connection pool limit for this datasource? Also, how to set the max connections that can be made from jetty? Thanks, Srinivas

RE: QueryResponse ordering

2021-01-14 Thread Srinivas Kashyap
e to fetch the QueryResponse(SolrJ) solrdocumentList sorted based on this sorting criteria. Yes, I understand bosst parameter bq doesn't apply on filter queries. Is there an alternative? Thanks, Srinivas From: Alessandro Benedetti Sent: 14 January 2021 01:55 To: solr-user@lucene.apache.org

QueryResponse ordering

2021-01-13 Thread Srinivas Kashyap
Y.PARTY_ID:%22abc%22%5e2+PARTY.PARTY_ID:%22def%22%5e1&defType=dismax&fq=PARTY.PARTY_ID:%22abc>" OR PARTY.PARTY_ID:"def"&q=*:* Thanks, Srinivas DISCLAIMER: E-mails and attachments from Bamboo Rose, LLC are confidential. If you are not

RE: Avoiding duplicate entry for a multivalued field

2020-10-30 Thread Srinivas Kashyap
Thanks Munendra, this will really help me. Are there any performance overhead with this? Thanks, Srinivas From: Munendra S N Sent: 30 October 2020 19:20 To: solr-user@lucene.apache.org Subject: Re: Avoiding duplicate entry for a multivalued field Srinivas, For atomic updates, you could use

RE: Avoiding duplicate entry for a multivalued field

2020-10-29 Thread Srinivas Kashyap
, Srinivas From: Dwane Hall Sent: 29 October 2020 14:33 To: solr-user@lucene.apache.org Subject: Re: Avoiding duplicate entry for a multivalued field Srinivas this is possible by adding an unique field update processor to the update processor chain you are using to perform your updates (/update, /update

Avoiding duplicate entry for a multivalued field

2020-10-28 Thread Srinivas Kashyap
Hello, Say, I have a schema field which is multivalued. Is there a way to maintain distinct values for that field though I continue to add duplicate values through atomic update via solrj? Is there some property setting to have only unique values in a multi valued fields? Thanks, Srinivas

RE: Sql entity processor sortedmapbackedcache out of memory issue

2020-10-02 Thread Srinivas Kashyap
org Subject: Re: Sql entity processor sortedmapbackedcache out of memory issue On 4/8/2019 11:47 PM, Srinivas Kashyap wrote: > I'm using DIH to index the data and the structure of the DIH is like below > for solr core: > > > 16 child entities > > > During indexing, since

RE: PDF extraction using Tika

2020-08-25 Thread Srinivas Kashyap
Thanks Phil, I will modify it according to the need. Thanks, Srinivas -Original Message- From: Phil Scadden Sent: 26 August 2020 02:44 To: solr-user@lucene.apache.org Subject: RE: PDF extraction using Tika Code for solrj is going to be very dependent on your needs but the beating

RE: PDF extraction using Tika

2020-08-24 Thread Srinivas Kashyap
from PDF and pushes into solr? Thanks, Srinivas Kashyap -Original Message- From: Alexandre Rafalovitch Sent: 24 August 2020 20:54 To: solr-user Subject: Re: PDF extraction using Tika The issue seems to be more with a specific file and at the level way below Solr's or possibly

PDF extraction using Tika

2020-08-24 Thread Srinivas Kashyap
pper.java:319) at org.apache.pdfbox.text.PDFTextStripper.writeText(PDFTextStripper.java:266) at org.apache.tika.parser.pdf.PDF2XHTML.process(PDF2XHTML.java:117) ... 15 more Can you please suggest, how to extract PDF from linux based file system? Thanks, Srinivas Kashyap ___

HttpSolrClient Connection Evictor

2020-08-09 Thread Srinivas Kashyap
27;t cause log statements to appear? Thanks, Srinivas DISCLAIMER: E-mails and attachments from Bamboo Rose, LLC are confidential. If you are not the intended recipient, please notify the sender immediately by replying to the e-mail, and then delete it without making copies

Question on sorting

2020-07-22 Thread Srinivas Kashyap
sort command, query result should be Doc2: "124561" Doc1: "84806" But I'm getting: Doc1: "84806" Doc2: "124561" Is this because, field type is string and doc1 has 5 digits and doc2 has 6 digits? Please provide solution for this. Thanks, Sriniv

Nested grouping

2020-06-25 Thread Srinivas Kashyap
quot;docs":[ { "PHY_KEY2":"HQ010399"}] }}, { "groupValue":"HQ010377", "doclist":{"numFound":8,"start":0,"docs":[

Re: Solr takes time to warm up core with huge data

2020-06-08 Thread Srinivas Kashyap
asc,PHY_KEY10 asc,FIELD_NAME asc Instead of q=*:* I pass only those fields which I want to retrieve. Will this be faster? Related to earlier question: We are using 8.4.1 version All the fields that I'm using on sorting are all string data type(modify ts date) with indexed=true stored=true

RE: Solr takes time to warm up core with huge data

2020-06-05 Thread Srinivas Kashyap
GUI console. It takes around 2 hours to show. My question is, even for the simple query with filter query mentioned as shown above, it is consuming JVM memory. So, how much memory or what configuration should I be doing on solrconfig.xml to make it work. Thanks, Srinivas From: Jörn Franke S

RE: Solr takes time to warm up core with huge data

2020-06-04 Thread Srinivas Kashyap
solr cloud? If yes, can you let us know, how many shards/replica do we require for this core considering we allow it to grow as users transact. The updates to this core is not thru DIH delta import rather, we are using SolrJ to push the changes. Thanks, Srinivas On 6/4/2020

Solr takes time to warm up core with huge data

2020-06-04 Thread Srinivas Kashyap
query(*:*) with filterqueries is overshooting the memory with OOM. Please advise on what I need to configure. Thanks, Srinivas DISCLAIMER: E-mails and attachments from Bamboo Rose, LLC are confidential. If you are not the intended recipient, please notify the sender immediate

RE: Indexing huge data onto solr

2020-05-25 Thread Srinivas Kashyap
documents, should I iterate over each one of parent tuples and execute the child entity sql’s(with where condition of parent) to create one solr document? Won’t it be more load on database by executing more sqls? Is there an optimum solution? Thanks, Srinivas From: Erick Erickson Sent: 22 May 2020

Indexing huge data onto solr

2020-05-22 Thread Srinivas Kashyap
JVM memory while running. Are there any speedier/alternates ways to load data onto this solr core. P.S: Only initial data import is problem, further updates/additions to this core is being done through SolrJ. Thanks, Srinivas DISCLAIMER: E-mails and attachments

RE: How upgrade to Solr 8 impact performance

2020-04-23 Thread Srinivas Kashyap
Can you share with details, what performance was degraded? Thanks, srinivas From: Natarajan, Rajeswari Sent: 23 April 2020 12:41 To: solr-user@lucene.apache.org Subject: Re: How upgrade to Solr 8 impact performance With the same hardware and configuration we also saw performance degradation

TikaEntityProcessor with DIH

2020-04-20 Thread Srinivas Kashyap
uot;, "text":"", "_version_":1664474933885927424}, { As you can see, the text field is empty & author, title fields are not getting indexed and any search on that text field is not returning the documents. Please help me in this regard.

RE: OutOfMemory error solr 8.4.1

2020-03-09 Thread Srinivas Kashyap
if(client!=null) { try { client.close(); } catch (IOException e) { // TODO Auto-generated catch block e.printStackTrace(); } } } Thanks and Regards, Srinivas Kashyap F

RE: OutOfMemory error solr 8.4.1

2020-03-09 Thread Srinivas Kashyap
nection evictor (1106) java.lang.Thread.sleep​(Native Method) org.apache.http.impl.client.IdleConnectionEvictor$1.run​(IdleConnectionEvictor.java:66) java.lang.Thread.run​(Thread.java:748) Thanks and Regards, Srinivas Kashyap -Original Message- From: Erick Erickson Sent: 06 March 2020 21:3

Re: OutOfMemory error solr 8.4.1

2020-03-06 Thread Srinivas Kashyap
object. And after that in the finally block we are closing it too. Never faced this issue while we were in solr5.2.1 version though. The same jar was placed there too. Thanks, Srinivas On 06-Mar-2020 8:55 pm, Erick Erickson wrote: This one can be a bit tricky. You’re not running out of overall

OutOfMemory error solr 8.4.1

2020-03-06 Thread Srinivas Kashyap
) [?:1.8.0_242] Thanks and Regards, Srinivas Kashyap DISCLAIMER: E-mails and attachments from Bamboo Rose, LLC are confidential. If you are not the intended recipient, please notify the sender immediately by replying to the e-mail, and then delete it without

RE: Solr datePointField facet

2020-02-25 Thread Srinivas Kashyap
, Srinivas

Solr datePointField facet

2020-02-25 Thread Srinivas Kashyap
id full reindex of the core and restarted as well. But still facing the same error. Can somebody please help. Thanks, Srinivas DISCLAIMER: E-mails and attachments from Bamboo Rose, LLC are confidential. If you are not the intended recipient, please notify the sen

RE: Solr 8.4.1 error

2020-02-03 Thread Srinivas Kashyap
Sorry for the interruption, This error was due to wrong context path mentioned in solr-jetty-context.xml And in jetty.xml it was referring /solr. So index was locked. Thanks, Srinivas -Original Message- From: Srinivas Kashyap Sent: 04 February 2020 11:04 To: solr-user

RE: Solr 8.4.1 error

2020-02-03 Thread Srinivas Kashyap
. In solr-config.xml if I replace ${solr.lock.type:native} with ${solr.lock.type:single}. It starts without any error. Please let me know how to find if other servers are running or if it is an issue with solr 8.4.1 version. Thanks, Srinivas -Original Message- From: Shawn Heisey Sent: 04

Solr 8.4.1 error

2020-02-03 Thread Srinivas Kashyap
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1292) ~[?:?] ... 7 more Any pointers would be helpful. Thanks and regards, Srinivas DISCLAIMER: E-mails and attachments from Bamboo Rose, LLC are confidential. If you are not the intended recipient, please no

RE: Dataimport problem

2019-07-31 Thread Srinivas Kashyap
working fine with AWS hosting. Really baffled. Thanks and Regards, Srinivas Kashyap -Original Message- From: Erick Erickson Sent: 31 July 2019 08:00 PM To: solr-user@lucene.apache.org Subject: Re: Dataimport problem This code is a little old, but should give you a place to start: https

RE: Dataimport problem

2019-07-31 Thread Srinivas Kashyap
architecture given the complexity of your needs Can you please give pointers to look into, We are using DIH for production and facing few issues. We need to start phasing out Thanks and Regards, Srinivas Kashyap             -Original Message- From: Alexandre Rafalovitch Sent: 31 July

Dataimport problem

2019-07-31 Thread Srinivas Kashyap
hosting. Am I missing some configuration? Please let me know. Thanks and Regards, Srinivas Kashyap DISCLAIMER: E-mails and attachments from Bamboo Rose, LLC are confidential. If you are not the intended recipient, please notify the sender immediately by replying to

Search using filter query on multivalued fields

2019-05-03 Thread Srinivas Kashyap
age is more than 20. How do I write a filter query for this? P.S: I should only fetch records, whose Salt Composition percentage is more than 20 and not other percentages. Thanks and Regards, Srinivas Kashyap DISCLAIMER: E-mails and attachments from Bamboo Rose, LLC a

RE: multi-level Nested entities in dih

2019-04-30 Thread Srinivas Kashyap
Hi Alexandre, Yes, the whole tree gets mapped to and returned as single flat document. When you search, it should return all the matching documents if it matches that nested field. Thanks and Regards, Srinivas Kashyap -Original Message- From: Alexandre Rafalovitch Sent: 30 April

multi-level Nested entities in dih

2019-04-30 Thread Srinivas Kashyap
e the child entities which have some more child entities in them until I'm done with all the children. Thanks and Regards, Srinivas Kashyap DISCLAIMER: E-mails and attachments from Bamboo Rose, LLC are confidential. If you are not the intended recipient, please

RE: Sql entity processor sortedmapbackedcache out of memory issue

2019-04-24 Thread Srinivas Kashyap
Hi Shawn, Mikhail Any suggestions/pointers for using zipper algorithm. I'm facing below error. Thanks and Regards, Srinivas Kashyap ** From: Srinivas Kashyap Sent: 12 April 2019 03:10 PM To: solr

RE: Sql entity processor sortedmapbackedcache out of memory issue

2019-04-12 Thread Srinivas Kashyap
hanks and Regards, Srinivas Kashyap -Original Message- From: Shawn Heisey Sent: 09 April 2019 01:27 PM To: solr-user@lucene.apache.org Subject: Re: Sql entity processor sortedmapbackedcache out of memory issue On 4/8/2019 11:47 PM, Sri

Sql entity processor sortedmapbackedcache out of memory issue

2019-04-08 Thread Srinivas Kashyap
in to the memory. For Dev and QA environments, the above memory config is sufficient. When we move to production, we have to increase the memory to around 16GB of RAM and 12 GB of JVM. Is there any logic/configurations to limit the memory usage? Thanks and Regards, Srinivas Ka

Alternative for DIH

2019-01-31 Thread Srinivas Kashyap
use apache kafka to pull data from DB and push into solr? If there are any other alternatives please suggest. Thanks and Regards, Srinivas Kashyap DISCLAIMER: E-mails and attachments from Bamboo Rose, LLC are confidential. If you are not the intended recipient, ple

FW: Sort index by size

2018-11-27 Thread Srinivas Kashyap
Hi Shawn and everyone who replied to the thread, The solr version is 5.2.1 and each document is returning multi-valued fields for majority of fields defined in schema.xml. I'm in the process of pasting the content of my files to a paste website and soon will update. Thanks, Srinivas On

Sort index by size

2018-11-19 Thread Srinivas Kashyap
possibility where I can go and check, which document is consuming more memory? Put in another way, can I sort the index based on size? Thanks and Regards, Srinivas Kashyap DISCLAIMER: E-mails and attachments from Bamboo Rose, LLC are confidential. If you are not

Jetty Sqlserver config

2018-09-20 Thread Srinivas Kashyap
SQL server database. Thanks and Regards, Srinivas Kashyap

Solr upgrade issues

2018-09-07 Thread Srinivas Kashyap
ew InitialContext(); DataSource ds = null; Context webContext = (Context)initContext.lookup("java:/comp/env"); ds = (DataSource) webContext.lookup("jdbc/tssindex"); How to fetch it in jetty. Thanks in advance, Srinivas kashyap

RE: API to convert solr response to Rowset

2018-07-18 Thread Srinivas Kashyap
I have a collection and thru solrJ, Ii query the collection and get QueryResponse SolrJ object. Is there a way I can convert this query response to Rowset(JDBC). I see the parallel SQL interface is introduced in 7.x version, but is it possible in Solr 5.2.1? Thanks and Regards, Srinivas

API to convert solr response to Rowset

2018-07-17 Thread Srinivas Kashyap
Hello, Is there any API to convert Solr query response to JDBC Rowset? Thanks and Regards, Srinivas Kashyap

Upgrading to higher version

2018-07-17 Thread Srinivas Kashyap
is much appreciated. Also, our application was running on tomcat/websphere, will it be any different in Jetty? Thanks and Regards, Srinivas Kashyap Senior Software Engineer "GURUDAS HERITAGE" 100 Feet Ring Road, Kadirenahalli, Banashankari 2nd Stage, Bangalore-560070 P: 97

Re: Drive Change for existing Solr Setup

2018-06-27 Thread Srinivas Muppu (US)
PMDM_CacheIndexer/en_cache_config/conf c) Once the upload is done, no success or failure message will be displayed *14. Scheduling indexing tasks* Thanks, Srinivas On Mon, Jun 25, 2018 at 11:34 AM, Shawn Heisey wrote: > On 6/25/2018 1:41 AM, Srinivas Muppu (US) wrote: > >>

Drive Change for existing Solr Setup

2018-06-25 Thread Srinivas Muppu (US)
-Drive (New Drive) without any impact to the existing application(it should not create re indexing again) Please let us know your suggestions if required will create the JIRA ticket for this. Your earliest response will be appreciated!! Thanks, Srinivas

Reg Solr System configuration

2018-06-24 Thread Srinivas Muppu (US)
Hi Solr Team, We are facing Solr System Configuration issues(Existing Solr installation setup needs to move window New Drive) which needs help. Please let us know whom to post our Questions/Queries. Thanks, Srinivas __ The

Re: WELCOME to solr-user@lucene.apache.org

2018-06-24 Thread Srinivas Muppu (US)
Hi Solr Team, We are facing Solr System Configuration issues which needs help. Please let us know whom to post our Questions/Queries. Thanks, Srinivas On Mon, Jun 25, 2018 at 2:22 AM, wrote: > Hi! This is the ezmlm program. I'm managing the > solr-user@lucene.apache.org mailing li

Drive Change for Solr Setup

2018-06-20 Thread Srinivas Muppu (US)
his.Your earliest help will be appreciated!!Thanks,Srinivas __ The information transmitted, including any attachments, is intended only for the person or entity to which it is addressed and may contain confidential and/or p

Solr facet on facet field returns junk values

2018-05-16 Thread Srinivas Kashyap
uot;110", 0, "115", 0, "117", 0, "12", 0, "120", 0, "122", 0, "123", 0, "124", 0, "125", 0, "126", 0, "127", Thanks and Regards, Srinivas Kashyap

count mismatch: number of records indexed

2018-05-02 Thread Srinivas Kashyap
nsole(*:*), numfound is only 41 thousand records. Am I missing some configuration to index all records? Physical memory: 16GB JVM memory: 4GB Thanks, Srinivas

Solr performance issue

2018-02-15 Thread Srinivas Kashyap
n-memory' which is causing the JVM memory go out of memory. Is there a way to specify in the child query entity to pull the record related to parent entity in the full-import mode. Thanks and Regards, Srinivas Kashyap DISCLAIMER: E-mails and attachments from TradeStone Software, Inc. a

Database logins and active sessions

2018-02-07 Thread Srinivas Kashyap
server resources. Is there a way to reduce the number of logins and logouts and have a persistent DB connection from solr? Thanks and Regards, Srinivas Kashyap DISCLAIMER: E-mails and attachments from TradeStone Software, Inc. are confidential. If you are not the intended recipient, please notify

OnImportEnd EventListener

2018-01-31 Thread Srinivas Kashyap
alternative way I can find them? Thanks and Regards, Srinivas Kashyap DISCLAIMER: E-mails and attachments from Bamboo Rose, LLC are confidential. If you are not the intended recipient, please notify the sender immediately by replying to the e-mail, and then de

RE: OnImportEnd EventListener

2018-01-31 Thread Srinivas Kashyap
when import was completed("onImportEnd" eventlistener). Thanks and Regards, Srinivas Kashyap -Original Message- From: Emir Arnautović [mailto:emir.arnauto...@sematext.com] Sent: 31 January 2018 04:14 PM To: solr-user@lucene.apache.org Subject: Re: OnImportEnd EventListener

OnImportEnd EventListener

2018-01-31 Thread Srinivas Kashyap
alternative way I can find them? Thanks and Regards, Srinivas Kashyap DISCLAIMER: E-mails and attachments from TradeStone Software, Inc. are confidential. If you are not the intended recipient, please notify the sender immediately by replying to the e-mail, and then delete it without making cop

Connection rest by peer error

2017-08-16 Thread Srinivas Kashyap
Hello, In one of our tomcat based solr 5.2.1 deployment environment, we are experiencing the below error which is occurring recursively. When the app is restarted, the error won't show up until sometime. Max allowed connections in tomcat context xml and JVM memory of solr is sufficient enough.

RE: How to synchronize the imports (DIH) delta imports

2017-06-21 Thread Srinivas Kashyap
Thanks Mikhail, Can you please explain the same? How can it be done in SolrJ Thanks and Regards, Srinivas Kashyap Senior Software Engineer “GURUDAS HERITAGE” 100 Feet Ring Road, Kadirenahalli, Banashankari 2nd Stage, Bangalore-560070 P: 973-986-6105 Bamboo Rose The only B2B marketplace powered

How to synchronize the imports (DIH) delta imports

2017-06-20 Thread Srinivas Kashyap
can poll the import status of index server in SolrJ, so that we can refrain sending another adhoc import command while the index is still runnning? Thanks and Regards, Srinivas Kashyap Senior Software Engineer "GURUDAS HERITAGE" 100 Feet Ring Road, Kadirenahalli, Banashankari 2nd Stage,

RE: Performance warning: Overlapping onDeskSearchers=2 solr

2017-05-18 Thread Srinivas Kashyap
documents. Below are some more config details in solrconfig.xml 20 200 false 2 Thanks and Regards, Srinivas Kashyap -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: 17 May 2017 08:51 PM To: solr-user mailto:solr-user@lucene.apache.org

RE: Performance warning: Overlapping onDeskSearchers=2 solr

2017-05-18 Thread Srinivas Kashyap
documents. Below are some more config details in solrconfig.xml 20 200 false 2 Thanks and Regards, Srinivas Kashyap -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: 17 May 2017 08:51 PM To: solr-user Subject: Re: Performance warning: Overlapping

Performance warning: Overlapping onDeskSearchers=2 solr

2017-05-17 Thread Srinivas Kashyap
me. Thanks and Regards, Srinivas Kashyap DISCLAIMER: E-mails and attachments from Bamboo Rose, LLC are confidential. If you are not the intended recipient, please notify the sender immediately by replying to the e-mail, and then delete it without making copies or

Broken pipe error

2016-11-29 Thread Srinivas Kashyap
15000" maxActive="1000" maxIdle="50". Thanks and Regards, Srinivas DISCLAIMER: E-mails and attachments from TradeStone Software, Inc. are confidential. If you are not the intended recipient, please notify the sender immediately by replying to the e-mail, and then delete it withou

Solr Grouping

2016-05-09 Thread Srinivas Mudam
Hi How can i customize the group limit, I have 5 groups, i want different limit for each group like 3,3,3,2,1. Could please provide solution for this. Thanks, Srinivas Mudam.

Trim trailing whitespaces

2016-04-12 Thread Srinivas Kashyap
[ { "TECHSPEC.REQUEST_NO": "HQ22 ", "TECH_SPEC_ID": "HQ22 ", "DOCUMENT_TYPE": "TECHSPEC", "TECHSPEC.OWNER": "SHOP ",

Curious case of DataSource.getConnection()

2016-04-12 Thread Srinivas Kashyap
nection? P.S: Normal IMPORT process is running unaffected i.e Data is being indexed into solr with the same datasource configuration in context xml. Thanks and Regards, Srinivas Kashyap Senior Software Engineer "GURUDAS HERITAGE" 'Block A' , No 59/2, 2nd Floor, 100 Feet Ring Road

Out of memory error during full import

2016-02-04 Thread Srinivas Kashyap
d to do initial data load without running into this error? I found that 'batchSize=-1' parameter needs to be specified in the datasource for MySql, is there a way to specify for others Databases as well? Thanks and Regards, Srinivas Kashyap DISCLAIMER: E-mails and attachments f

Out of memory error during full import

2016-02-03 Thread Srinivas Kashyap
d to do initial data load without running into this error? I found that 'batchSize=-1' parameter needs to be specified in the datasource for MySql, is there a way to specify for others Databases as well? Thanks and Regards, Srinivas Kashyap DISCLAIMER: E-mails and attachments from

Re: MLT causing Problems

2015-04-23 Thread Srinivas Rishindra
gards Srinivas Rishindra *Regards* *Birla Inst**itute of Technology & Science,* Pilani K K Birla Goa Campus Goa, India. 403 726 Mobile: (+91)8600077149 E.mail: f2011...@goa.bits-pilani.ac.in On Wed, Apr 22, 2015 at 3:15 PM, Srinivas Rishindra wrote: > Hello, > > I am working on a

MLT causing Problems

2015-04-22 Thread Srinivas Rishindra
Hello, I am working on a project in which i have to find similar documents. While I implementing the following error is occurring. Please let me know what to do. Exception in thread "main" org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://localhost:

document contained more than 100000 characters

2015-03-23 Thread Srinivas
,Please let me know. Regards, Srinivas B