I'll have to take a look and see if I can reproduce this exact behavior. Let's create a jira ticket so we can track the discussion.
Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Sep 13, 2018 at 1:03 PM Kojo <rbsnk...@gmail.com> wrote: > Same query feeding 25000 tuples to gatherNodes: > > gatherNodes(graph_auxilios, > search(graph_auxilios, zkHost="localhost:9983",qt="/select", rows=25000, > q=*:*, fl="numero_processo", sort="numero_processo asc"), > walk="numero_processo->projeto_pai", > gather="numero_processo", > ) > > > About 350 nodes returned. This is the last one: > > { > "node": "97/13422-6", > "collection": "graph_auxilios", > "field": "numero_processo", > "level": 1 > }, > { > "EOF": true, > "RESPONSE_TIME": 3996 > } > ] > } > } > > > > This is the log: > > INFO - 2018-09-13 16:55:05.949; [c:graph_auxilios s:shard6 r:core_node3 > x:graph_auxilios_shard6_replica1] org.apache.solr.core.SolrCore; > [graph_auxilios_shard6_replica1] webapp=/solr path=/export > > params={q={!terms+f%3Dprojeto_pai}95/07551-2,95/07553-5,95/07554-1,95/07555-8,95/07557-0,95/07561-8,95/07571-3,95/07572-0,95/07575-9,95/07583-1,95/07591-4,95/07592-0,95/07595-0,95/07619-6,95/07624-0,95/07631-6,95/07633-9,95/07635-1,95/07637-4,95/07639-7,95/07641-1,95/07646-3,95/07648-6,95/07650-0,95/07652-3,95/07653-0,95/07654-6,95/07660-6,95/07661-2,95/07662-9,95/07665-8,95/07666-4,95/07667-0,95/07668-7,95/07669-3,95/07672-4,95/07673-0,95/07674-7,95/07675-3,95/07682-0,95/07686-5,95/07688-8,95/07689-4,95/07692-5,95/07695-4,95/07698-3,95/07699-0,95/07700-8,95/07706-6,95/07711-0,95/07712-6,95/07717-8,95/07726-7,95/07729-6,95/07730-4,95/07739-1,95/07741-6,95/07745-1,95/07746-8,95/07748-0,95/07750-5,95/07755-7,95/07757-0,95/07759-2,95/07763-0,95/07764-6,95/07765-2,95/07767-5,95/07768-1,95/07769-8,95/07775-8,95/07784-7,95/07789-9,95/07796-5,95/07799-4,95/07802-5,95/07803-1,95/07807-7,95/07812-0,95/07813-7,95/07821-0,95/07824-9,95/07826-1,95/07828-4,95/07830-9,95/07831-5,95/07833-8,95/07834-4,95/07838-0,95/07839-6,95/07840-4,95/07843-3,95/07844-0,95/07849-1,95/07851-6,95/07852-2,95/07853-9,95/07855-1,95/07858-0,95/07868-6,95/07869-2,95/07873-0,95/07874-6,95/07876-9,95/07877-5,95/07881-2,95/07883-5,95/07884-1,95/07885-8,95/07886-4,95/07888-7,95/07892-4,95/07902-0,95/07914-8,95/07915-4,95/07917-7,95/07920-8,95/07922-0,95/07928-9,95/07930-3,95/07949-6,95/07951-0,95/07952-7,95/07960-0,95/07961-6,95/07962-2,95/07969-7,95/07981-7,95/07986-9,95/07997-0,95/08000-0,95/08001-6,95/08003-9,95/08008-0,95/08021-7,95/08034-1,95/08038-7,95/08041-8,95/08042-4,95/08046-0,95/08049-9,95/08050-7,95/08051-3,95/08053-6,95/08056-5,95/08063-1,95/08066-0,95/08070-8,95/08073-7,95/08078-9,95/08080-3,95/08092-1,95/08099-6,95/08105-6,95/08106-2,95/08108-5,95/08114-5,95/08118-0,95/08119-7,95/08120-5,95/08123-4,95/08128-6,95/08132-3,95/08134-6,95/08135-2,95/08155-3,95/08156-0,95/08158-2,95/08164-2,95/08165-9,95/08166-5,95/08169-4,95/08171-9,95/08184-3,95/08188-9,95/08191-0,95/08209-6,95/08218-5,95/08235-7,95/08248-1,95/08250-6,95/08254-1,95/08273-6,95/08275-9,95/08277-1,95/08280-2,95/08281-9,95/08287-7,95/08294-3,95/08297-2,95/08301-0,95/08304-9,95/08333-9,95/08336-8,95/08339-7,95/08342-8,95/08343-4,95/08346-3,95/08382-0,95/08386-5,95/08414-9,95/08415-5,95/08453-4,95/08471-2,95/08472-9,95/08475-8,95/08503-1,95/08505-4,95/08524-9,95/08560-5,95/08569-2,95/08583-5,95/08592-4,95/08601-3,95/08634-9,95/08640-9,95/08654-0,95/08706-0,95/08707-6,95/08713-6,95/08717-1,95/08725-4,95/08737-2,95/08746-1,95/08752-1,95/08775-1,95/08798-1,95/08806-4,95/08823-6,95/08856-1,95/08860-9,95/08865-0,95/08872-7,95/08875-6,95/08881-6,95/08908-1,95/08917-0,95/08918-7,95/08955-0,95/08969-0,95/08973-8,95/08990-0,95/09023-3,95/09045-7,95/09058-1,95/09068-7,95/09080-7,95/09085-9,95/09101-4,95/09108-9,95/09135-6,95/09156-3,95/09159-2,95/09160-0,95/09167-5,95/09202-5,95/09207-7,95/09222-6,95/09260-5,95/09263-4,95/09269-2,95/09290-1,95/09305-9,95/09311-9,95/09319-0,95/09329-5,95/09330-3,95/09361-6,95/09379-2,95/09382-3,95/09417-1,95/09432-0,95/09440-3,95/09531-9,95/09538-3,95/09545-0,95/09552-6,95/09557-8,95/09576-2,95/09577-9,95/09584-5,95/09590-5,95/09599-2,95/09607-5,95/09608-1,95/09625-3,95/09637-1,95/09660-3,95/09716-9,95/09727-0,95/09744-2,95/09755-4,95/09756-0,95/09777-8,95/09780-9,95/09795-6,95/09809-7,95/09810-5,95/09812-8,95/09825-2,95/09836-4,95/09843-0,95/09889-0,95/09896-7,95/09898-0,95/09906-2,95/09916-8,95/09921-1,95/09968-8,95/09969-4,95/09976-0,95/09977-7,95/09980-8,95/09982-0,95/09997-8,95/09998-4,96/00003-2,96/00027-9,96/00030-0,96/00039-7,96/00042-8,96/00074-7,96/00083-6,96/00106-6,96/00119-0,96/00122-1,96/00123-8,96/00125-0,96/00136-2,96/00139-1,96/00159-2,96/00170-6,96/00183-0,96/00187-6,96/00190-7,96/00192-0,96/00193-6,96/00194-2,96/00220-3,96/00225-5,96/00230-9,96/00234-4,96/00246-2,96/00261-1,96/00263-4,96/00301-3,96/00335-5,96/00345-0,96/00351-0,96/00359-1,96/00362-2,96/00389-8,96/00393-5,96/00395-8,96/00413-6,96/00421-9,96/00425-4,96/00431-4,96/00434-3,96/00437-2,96/00446-1,96/00453-8,96/00470-0,96/00489-2,96/00518-2,96/00533-1,96/00544-3,96/00554-9,96/00568-0,96/00589-7,96/00592-8,96/00596-3,96/00603-0,96/00604-6,96/00612-9,96/00613-5,96/00621-8,96/00640-2,96/00641-9,96/00657-2,96/00675-0,96/00699-7,96/00700-5,96/00703-4,96/00753-1,96/00756-0,96/00768-9,96/00769-5,96/00770-3,96/00773-2,96/00779-0,96/00782-1,96/00793-3,96/00829-8,96/00830-6,96/00832-9,96/00837-0,96/00852-0,96/00873-7&distrib=false&fl=numero_processo,projeto_pai&sort=numero_processo+asc,projeto_pai+asc&wt=json&version=2.2} > hits=4 status=0 QTime=1 > > > Reading your last msg again, I am not sure that you were asking a different > question than this logs I sent now. > > I can run different tests if you need more information. > > Thanks for your help Joel. > > > > > Em qui, 13 de set de 2018 às 13:50, Joel Bernstein <joels...@gmail.com> > escreveu: > > > I see that the hits=0 in this log request. Are there log requests that > show > > results found for one of these queries? > > > > > > Joel Bernstein > > http://joelsolr.blogspot.com/ > > > > > > On Thu, Sep 13, 2018 at 10:15 AM Kojo <rbsnk...@gmail.com> wrote: > > > > > I have just run this expression: > > > > > > > > > gatherNodes(graph_auxilios, > > > search(graph_auxilios, zkHost="localhost:9983",qt="/select", > > rows=30000, > > > q=*:*, fl="numero_processo", sort="numero_processo asc"), > > > walk="numero_processo->projeto_pai", > > > gather="numero_processo", > > > ) > > > > > > > > > > > > This is the response: > > > > > > { "result-set": { "docs": [ { "EOF": true, "RESPONSE_TIME": 5091 } ] } > } > > > > > > > > > > > > Many logs until it stops quietly. This is the last line on > > > /opt/solr-6.6.2/example/cloud/node1/logs > > > > > > INFO - 2018-09-13 14:09:20.783; [c:graph_auxilios s:shard6 > r:core_node3 > > > x:graph_auxilios_shard6_replica1] org.apache.solr.core.SolrCore; > > > [graph_auxilios_shard6_replica1] webapp=/solr path=/export > > > > > > > > > params={q={!terms+f%3Dprojeto_pai}16/25417-0,16/25418-6,16/25423-0,16/25425-2,16/25426-9,16/25429-8,16/25436-4,16/25437-0,16/25441-8,16/25442-4,16/25446-0,16/25448-2,16/25450-7,16/25452-0,16/25457-1,16/25459-4,16/25463-1,16/25464-8,16/25467-7,16/25468-3,16/25469-0,16/25471-4,16/25474-3,16/25475-0,16/25476-6,16/25478-9,16/25480-3,16/25483-2,16/25484-9,16/25485-5,16/25486-1,16/25489-0,16/25490-9,16/25498-0,16/25499-6,16/25500-4,16/25501-0,16/25502-7,16/25504-0,16/25506-2,16/25509-1,16/25520-5,16/25521-1,16/25524-0,16/25526-3,16/25528-6,16/25529-2,16/25531-7,16/25532-3,16/25533-0,16/25535-2,16/25537-5,16/25538-1,16/25540-6,16/25544-1,16/25546-4,16/25549-3,16/25551-8,16/25556-0,16/25557-6,16/25562-0,16/25563-6,16/25565-9,16/25573-1,16/25574-8,16/25583-7,16/25590-3,16/25594-9,16/25599-0,16/25600-9,16/25604-4,16/25609-6,16/25610-4,16/25611-0,16/25613-3,16/25615-6,16/25617-9,16/25619-1,16/25621-6,16/25626-8,16/25632-8,16/25634-0,16/25635-7,16/25637-0,16/25639-2,16/25642-3,16/25644-6,16/25647-5,16/25651-2,16/25652-9,16/25658-7,16/25659-3,16/25661-8,16/25669-9,16/25676-5,16/25680-2,16/25681-9,16/25682-5,16/25683-1,16/25685-4,16/25686-0,16/25687-7,16/25698-9,16/25703-2,16/25705-5,16/25706-1,16/25708-4,16/25717-3,16/25729-1,16/25730-0,16/25734-5,16/25735-1,16/25737-4,16/25745-7,16/25747-0,16/25749-2,16/25750-0,16/25751-7,16/25755-2,16/25764-1,16/25766-4,16/25769-3,16/25771-8,16/25776-0,16/25778-2,16/25779-9,16/25782-0,16/25783-6,16/25784-2,16/25785-9,16/25791-9,16/25793-1,16/25795-4,16/25798-3,16/25800-8,16/25806-6,16/25810-3,16/25813-2,16/25817-8,16/25821-5,16/25824-4,16/25826-7,16/25831-0,16/25832-7,16/25833-3,16/25836-2,16/25837-9,16/25840-0,16/25845-1,16/25847-4,16/25851-1,16/25853-4,16/25855-7,16/25861-7,16/25864-6,16/25865-2,16/25866-9,16/25867-5,16/25868-1,16/25870-6,16/25876-4,16/25878-7,16/25882-4,16/25883-0,16/25884-7,16/25891-3,16/25893-6,16/25894-2,16/25895-9,16/25896-5,16/25898-8,16/25900-2,16/25901-9,16/25905-4,16/25907-7,16/25910-8,16/25913-7,16/25914-3,16/25915-0,16/25916-6,16/25917-2,16/25919-5,16/25920-3,16/25925-5,16/25926-1,16/25928-4,16/25929-0,16/25931-5,16/25933-8,16/25935-0,16/25938-0,16/25945-6,16/25946-2,16/25947-9,16/25952-2,16/25953-9,16/25955-1,16/25959-7,16/25962-8,16/25963-4,16/25964-0,16/25965-7,16/25967-0,16/25968-6,16/25969-2,16/25970-0,16/25971-7,16/25979-8,16/25984-1,16/25985-8,16/25986-4,16/25987-0,16/25988-7,16/25990-1,16/25996-0,16/25999-9,16/26000-5,16/26001-1,16/26003-4,16/26011-7,16/26012-3,16/26013-0,16/26014-6,16/26016-9,16/26022-9,16/26024-1,16/26026-4,16/26028-7,16/26029-3,16/26030-1,16/26031-8,16/26032-4,16/26033-0,16/26034-7,16/26035-3,16/26040-7,16/26041-3,16/26043-6,16/26044-2,16/26050-2,16/26054-8,16/26055-4,16/26060-8,16/26061-4,16/26064-3,16/26069-5,16/26071-0,16/26076-1,16/26080-9,16/26081-5,16/26082-1,16/26083-8,16/26095-6,16/26098-5,16/26101-6,16/26103-9,16/26108-0,16/26110-5,16/26113-4,16/26117-0,16/26118-6,16/26121-7,16/26123-0,16/26124-6,16/26130-6,16/26132-9,16/26135-8,16/26140-1,16/26145-3,16/26148-2,16/26151-3,16/26154-2,16/26156-5,16/26158-8,16/26160-2,16/26167-7,16/26169-0,16/26170-8,16/26171-4,16/26172-0,16/26173-7,16/26176-6,16/26177-2,16/26182-6,16/26183-2,16/26184-9,16/26189-0,16/26196-7,16/26198-0,16/26200-4,16/26201-0,16/26209-1,16/26212-2,16/26215-1,16/26216-8,16/26220-5,16/26221-1,16/26230-0,16/26234-6,16/26239-8,16/26240-6,16/26243-5,16/26244-1,16/26250-1,16/26252-4,16/26255-3,16/26263-6,16/26274-8,16/26275-4,16/26281-4,16/26288-9,16/26289-5,16/26290-3,16/50001-1,16/50003-4,16/50004-0,16/50005-7,16/50006-3,16/50007-0,16/50008-6,16/50009-2,16/50010-0,16/50011-7,16/50013-0,16/50014-6,16/50015-2,16/50016-9,16/50018-1,16/50019-8,16/50020-6,16/50021-2,16/50022-9,16/50023-5,16/50033-0,16/50034-7,16/50035-3,16/50038-2,16/50039-9,16/50040-7,16/50041-3,16/50042-0,16/50043-6,16/50044-2,16/50050-2,16/50052-5,16/50054-8,16/50055-4,16/50060-8,16/50062-0,16/50067-2,16/50068-9,16/50070-3,16/50077-8,16/50080-9,16/50082-1,16/50083-8,16/50097-9,16/50108-0,16/50109-7,16/50112-8,16/50121-7,16/50123-0,16/50127-5,16/50137-0,16/50142-4,16/50143-0,16/50144-7,16/50147-6,16/50148-2,16/50150-7,16/50154-2,16/50158-8,16/50160-2,16/50161-9,16/50162-5,16/50163-1,16/50164-8,16/50167-7,16/50172-0,16/50173-7,16/50175-0,16/50178-9,16/50180-3,16/50183-2,16/50185-5,16/50186-1,16/50187-8,16/50188-4,16/50189-0,16/50192-1,16/50193-8,16/50195-0,16/50196-7,16/50197-3,16/50198-0,16/50199-6,16/50200-4,16/50201-0,16/50204-0,16/50205-6&distrib=false&fl=numero_processo,projeto_pai&sort=numero_processo+asc,projeto_pai+asc&wt=json&version=2.2} > > > hits=0 status=0 QTime=2 > > > > > > > > > > > > Four nodes seems to stop logging at the same time when it returns empty > > > result. > > > > > > Em qui, 13 de set de 2018 às 10:34, Joel Bernstein <joels...@gmail.com > > > > > escreveu: > > > > > > > That's odd behavior. What do the logs look like? This will produce a > > > series > > > > of queries against the projects collection. Are you seeing those in > the > > > > logs? Any errors? > > > > > > > > Joel Bernstein > > > > http://joelsolr.blogspot.com/ > > > > > > > > > > > > On Thu, Sep 13, 2018 at 9:25 AM Kojo <rbsnk...@gmail.com> wrote: > > > > > > > > > Hi, > > > > > > > > > > If I try to feed gatherNodes with more than 25000 tuples, it gives > me > > > > empty > > > > > result-set. > > > > > > > > > > gatherNodes(projects, > > > > > search(projects, zkHost="localhost:9983",qt="/select", > rows=30000, > > > > > q=*:*, fl="id", sort="id asc"), > > > > > walk="id->parent_id", > > > > > gather="id", > > > > > ) > > > > > > > > > > Response: > > > > > { "result-set": { "docs": [ { "EOF": true, "RESPONSE_TIME": 4499 } > ] > > } > > > } > > > > > > > > > > > > > > > This works: > > > > > search(graph_auxilios, zkHost="localhost:9983",qt="/select", > > > rows=30000, > > > > > q=*:*, fl="id", sort="id asc"), > > > > > > > > > > If I feed the gatherNodes with less tuples, lets say, 25000, it > > works. > > > > > > > > > > Is it an expected behaviour? > > > > > > > > > > I am on Solr 6.6. And my box has 128Gb RAM. The only infra that is > > > still > > > > > not set right is that I am using standalone Zookeper. > > > > > > > > > > > > > > >